Jul 30 09:49:44.358347 ip-10-0-130-75 systemd[1]: Starting Kubernetes Kubelet... Jul 30 09:49:44.740426 ip-10-0-130-75 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 09:49:44.740426 ip-10-0-130-75 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 09:49:44.740426 ip-10-0-130-75 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 09:49:44.740426 ip-10-0-130-75 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 09:49:44.740426 ip-10-0-130-75 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 09:49:44.741340 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.741190 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746237 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746258 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746262 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746265 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746269 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.746263 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746272 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746275 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746278 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746281 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746285 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746290 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746292 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746295 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746298 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746301 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746303 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746306 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746309 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746312 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746314 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746317 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746320 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746323 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746326 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746328 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.746496 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746331 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746334 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746337 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746339 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746342 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746345 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746348 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746353 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746357 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746360 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746363 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746366 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746370 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746373 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746381 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746384 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746387 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746389 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746392 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.746979 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746395 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746398 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746402 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746405 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746407 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746410 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746419 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746422 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746425 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746427 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746430 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746433 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746436 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746439 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746442 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746445 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746448 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746450 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746453 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.747460 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746456 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746459 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746461 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746464 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746467 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746471 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746475 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746478 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746483 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746486 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746488 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746491 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746494 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746498 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746502 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746506 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746509 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746512 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.747941 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746515 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746523 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746526 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746529 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746532 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746534 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746537 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746540 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746543 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746546 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746549 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746551 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746554 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746557 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746559 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746562 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.746565 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747363 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747370 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747374 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.748410 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747376 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747379 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747382 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747387 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747390 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747393 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747396 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747399 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747402 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747404 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747407 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747410 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747412 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747415 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747427 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747430 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747433 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747436 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747438 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747441 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.748925 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747445 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747449 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747452 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747455 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747458 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747461 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747464 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747466 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747469 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747472 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747475 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747478 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747481 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747483 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747486 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747489 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747491 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747494 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747497 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747500 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.749447 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747503 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747506 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747508 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747511 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747513 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747516 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747519 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747527 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747530 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747533 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747535 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747538 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747541 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747545 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747549 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747553 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747555 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747558 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747561 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.749957 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747565 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747567 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747571 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747574 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747576 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747579 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747582 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747584 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747587 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747589 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747592 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747595 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747597 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747600 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747603 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747605 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747608 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747611 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747613 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747619 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.750439 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747623 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747632 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747634 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747637 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747640 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747643 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747646 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747648 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747651 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747654 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747657 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747660 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747663 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747665 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747668 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747671 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.747676 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748122 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748128 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748131 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.750921 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748134 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748137 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748140 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748143 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748146 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748148 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748151 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748154 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748157 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748160 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748164 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748168 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748172 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748180 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748184 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748187 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748190 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748193 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748196 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.751429 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748199 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748201 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748204 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748207 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748210 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748212 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748215 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748218 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748220 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748228 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748231 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748234 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748237 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748239 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748242 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748244 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748247 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748250 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748252 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.751890 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748257 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748260 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748263 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748266 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748268 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748271 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748274 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748282 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748285 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748287 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748290 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748293 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748296 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748300 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748304 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748307 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748309 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748313 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748316 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.752362 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748319 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748322 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748324 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748327 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748330 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748332 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748335 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748337 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748340 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748347 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748349 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748352 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748354 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748357 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748360 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748363 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748365 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748368 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748394 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748398 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.752955 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748401 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748411 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748414 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748417 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748420 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748424 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748427 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748430 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748433 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748435 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748438 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748441 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748443 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748446 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748448 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748451 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748454 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.748456 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748524 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748537 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748544 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 09:49:44.753465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748549 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748553 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748557 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748561 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748566 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748569 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748572 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748576 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748579 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748582 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748586 2576 flags.go:64] FLAG: --cgroup-root="" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748588 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748591 2576 flags.go:64] FLAG: --client-ca-file="" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748595 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748598 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748602 2576 flags.go:64] FLAG: --cluster-domain="" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748605 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748608 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748612 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748615 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748619 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748622 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748625 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 09:49:44.754000 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748628 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748631 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748634 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748637 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748641 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748643 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748648 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748651 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748654 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748657 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748660 2576 flags.go:64] FLAG: --enable-server="true" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748663 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748668 2576 flags.go:64] FLAG: --event-burst="100" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748671 2576 flags.go:64] FLAG: --event-qps="50" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748674 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748680 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748684 2576 flags.go:64] FLAG: --eviction-hard="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748688 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748691 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748694 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748698 2576 flags.go:64] FLAG: --eviction-soft="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748701 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748704 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748708 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748711 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 09:49:44.754587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748714 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748717 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748720 2576 flags.go:64] FLAG: --feature-gates="" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748724 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748727 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748730 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748733 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748736 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748739 2576 flags.go:64] FLAG: --help="false" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748742 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-75.ec2.internal" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748745 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748748 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748751 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748755 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748758 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748762 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748765 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748768 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748771 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748774 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748788 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748792 2576 flags.go:64] FLAG: --kube-reserved="" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748800 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748803 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 09:49:44.755232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748807 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748810 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748813 2576 flags.go:64] FLAG: --lock-file="" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748816 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748819 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748822 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748828 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748832 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748835 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748838 2576 flags.go:64] FLAG: --logging-format="text" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748841 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748844 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748847 2576 flags.go:64] FLAG: --manifest-url="" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748851 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748855 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748859 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748863 2576 flags.go:64] FLAG: --max-pods="110" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748866 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748869 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748872 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748875 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748878 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748882 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748888 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748895 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 09:49:44.755839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748899 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748902 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748905 2576 flags.go:64] FLAG: --pod-cidr="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748908 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748913 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748917 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748920 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748923 2576 flags.go:64] FLAG: --port="10250" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748927 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748930 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0135d4b0466554f77" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748934 2576 flags.go:64] FLAG: --qos-reserved="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748937 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748940 2576 flags.go:64] FLAG: --register-node="true" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748951 2576 flags.go:64] FLAG: --register-with-taints="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748955 2576 flags.go:64] FLAG: --registry-burst="10" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748959 2576 flags.go:64] FLAG: --registry-qps="5" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748962 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748965 2576 flags.go:64] FLAG: --reserved-memory="" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748969 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748972 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748975 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748978 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748981 2576 flags.go:64] FLAG: --runonce="false" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748984 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748987 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 09:49:44.756487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748990 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748993 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748996 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.748999 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749002 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749005 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749009 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749012 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749015 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749018 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749021 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749036 2576 flags.go:64] FLAG: --system-cgroups="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749041 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749047 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749050 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749053 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749057 2576 flags.go:64] FLAG: --tls-min-version="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749060 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749063 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749066 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749069 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749072 2576 flags.go:64] FLAG: --v="2" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749076 2576 flags.go:64] FLAG: --version="false" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749081 2576 flags.go:64] FLAG: --vmodule="" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749085 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 09:49:44.757116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.749088 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749220 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749224 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749227 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749229 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749232 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749235 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749237 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749241 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749243 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749247 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749249 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749252 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749256 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749260 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749262 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749265 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749268 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749270 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749276 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.757752 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749279 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749282 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749285 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749288 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749291 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749293 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749296 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749299 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749301 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749304 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749307 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749310 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749313 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749316 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749318 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749321 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749324 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749326 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749329 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749332 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.758250 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749334 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749337 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749339 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749342 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749344 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749348 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749351 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749354 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749357 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749361 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749364 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749368 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749371 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749374 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749376 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749380 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749384 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749387 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749390 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.758767 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749392 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749395 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749398 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749400 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749403 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749408 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749411 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749414 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749417 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749420 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749422 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749425 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749427 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749430 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749433 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749436 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749438 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749441 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749445 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749448 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.759249 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749451 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749454 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749457 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749460 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749464 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749467 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749470 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749473 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749476 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749478 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749481 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749484 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749486 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749489 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749492 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749494 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749497 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749499 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749503 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749505 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.759722 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.749508 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.751140 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.757763 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.757783 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.757804 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.757810 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757870 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757876 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757880 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757883 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757885 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757888 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757891 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757895 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757897 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.760310 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757900 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757903 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757906 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757908 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757911 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757914 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757917 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757919 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757922 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757925 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757927 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757930 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757932 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757935 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757938 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757940 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757945 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757947 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757952 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757956 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.760679 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757961 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757964 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757967 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757970 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757973 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757976 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757979 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757981 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757984 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757987 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757990 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757992 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757995 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.757997 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758000 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758003 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758006 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758008 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758011 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758014 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.761197 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758016 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758019 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758022 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758037 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758041 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758043 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758046 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758049 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758052 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758054 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758057 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758060 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758063 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758067 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758070 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758072 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758075 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758078 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758080 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.761703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758083 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758086 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758089 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758092 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758094 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758097 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758100 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758102 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758106 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758123 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758128 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758131 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758136 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758140 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758143 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758146 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758149 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758152 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758155 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.762176 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758161 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758164 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758167 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758170 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758173 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758176 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758179 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758182 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758185 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758188 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758191 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.758197 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758339 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758344 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 09:49:44.762875 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758347 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758350 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758353 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758356 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758359 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758361 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758364 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758367 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758370 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758372 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758375 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758378 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758381 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758383 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758386 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758389 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758391 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758394 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758397 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 09:49:44.763467 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758400 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758402 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758404 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758407 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758410 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758414 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758418 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758421 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758424 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758427 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758430 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758434 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758437 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758440 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758443 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758445 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758448 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758450 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758453 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 09:49:44.763940 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758456 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758459 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758462 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758464 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758467 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758469 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758472 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758475 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758477 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758480 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758482 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758485 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758487 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758490 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758493 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758495 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758498 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758500 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758503 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758505 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 09:49:44.764542 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758508 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758511 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758514 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758516 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758519 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758521 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758524 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758526 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758529 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758531 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758534 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758536 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758539 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758542 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758545 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758547 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758550 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758552 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758555 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758557 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 09:49:44.765216 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758560 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758562 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758565 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758567 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758570 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758572 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758575 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758577 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758581 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758584 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758587 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758590 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758593 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758596 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758600 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758603 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758606 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758609 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 09:49:44.765885 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:44.758611 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.758616 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.758733 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.761037 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.762211 2576 server.go:1019] "Starting client certificate rotation" Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.762329 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.762377 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 09:49:44.766335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.764528 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 09:49:44.767273 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.767254 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 09:49:44.778169 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.778150 2576 log.go:25] "Validated CRI v1 runtime API" Jul 30 09:49:44.780052 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.780022 2576 log.go:25] "Validated CRI v1 image API" Jul 30 09:49:44.780933 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.780916 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 09:49:44.784716 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.784695 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aee55691-3438-41fd-a048-4c8f1cb01d7d:/dev/nvme0n1p4 d7cfcd6b-c3e5-4193-b388-4adee3f62ec0:/dev/nvme0n1p3] Jul 30 09:49:44.784788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.784715 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 09:49:44.790557 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.790442 2576 manager.go:216] Machine: {Timestamp:2026-07-30 09:49:44.789243027 +0000 UTC m=+0.315670347 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102286 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2195fdacfda00a1689c4add2f442bd SystemUUID:ec2195fd-acfd-a00a-1689-c4add2f442bd BootID:cb5effe2-ff0e-4a99-a9b3-839067c05a4c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:8f:d5:b5:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:8f:d5:b5:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:ef:2d:30:ad:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 09:49:44.790557 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.790550 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 09:49:44.790679 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.790667 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 09:49:44.794121 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.794094 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 09:49:44.794278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.794124 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-75.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 09:49:44.795440 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.795428 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 09:49:44.795483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.795441 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 09:49:44.795483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.795456 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 09:49:44.796205 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.796193 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 09:49:44.796924 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.796914 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 09:49:44.798568 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798554 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 30 09:49:44.798696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798686 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 09:49:44.798758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798750 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 30 09:49:44.798788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798764 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 09:49:44.798788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798778 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 09:49:44.798854 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798789 2576 kubelet.go:398] "Adding apiserver pod source" Jul 30 09:49:44.798854 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.798798 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 09:49:44.799191 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.799179 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 09:49:44.799235 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.799198 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 09:49:44.802214 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.802185 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 09:49:44.803146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.803127 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 09:49:44.804783 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.804769 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 09:49:44.804846 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.804799 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 09:49:44.806048 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806021 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 09:49:44.806048 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806050 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806057 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806063 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806072 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806078 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806087 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806092 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806099 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806105 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806113 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 09:49:44.806146 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.806119 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 09:49:44.807049 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.807040 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 09:49:44.807049 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.807048 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 09:49:44.810039 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.810015 2576 server.go:1268] "Started kubelet" Jul 30 09:49:44.810174 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.810147 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 09:49:44.810286 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.810247 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 09:49:44.810341 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.810312 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 09:49:44.810917 ip-10-0-130-75 systemd[1]: Started Kubernetes Kubelet. Jul 30 09:49:44.812278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.812261 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 09:49:44.812731 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.812696 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 30 09:49:44.815194 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.815152 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 09:49:44.815274 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.815204 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 09:49:44.815501 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.815480 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-75.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 09:49:44.817114 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.817090 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 09:49:44.819958 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.819936 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 09:49:44.819958 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.819951 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 09:49:44.820124 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.820090 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:44.820533 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820518 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 09:49:44.820685 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820548 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 09:49:44.820685 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820689 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 09:49:44.820835 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820818 2576 factory.go:55] Registering systemd factory Jul 30 09:49:44.820895 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820854 2576 factory.go:223] Registration of the systemd container factory successfully Jul 30 09:49:44.820895 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820820 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 30 09:49:44.820895 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.820880 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 30 09:49:44.821151 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821134 2576 factory.go:153] Registering CRI-O factory Jul 30 09:49:44.821151 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821152 2576 factory.go:223] Registration of the crio container factory successfully Jul 30 09:49:44.821307 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821207 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 09:49:44.821307 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821232 2576 factory.go:103] Registering Raw factory Jul 30 09:49:44.821307 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821250 2576 manager.go:1196] Started watching for new ooms in manager Jul 30 09:49:44.821872 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.821693 2576 manager.go:349] Starting recovery of all containers Jul 30 09:49:44.823432 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.823403 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-75.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 30 09:49:44.823556 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.823533 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 30 09:49:44.824046 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.823018 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-75.ec2.internal.18c7085fcbcfa3d7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-75.ec2.internal,UID:ip-10-0-130-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-75.ec2.internal,},FirstTimestamp:2026-07-30 09:49:44.809989079 +0000 UTC m=+0.336416397,LastTimestamp:2026-07-30 09:49:44.809989079 +0000 UTC m=+0.336416397,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-75.ec2.internal,}" Jul 30 09:49:44.832555 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.832537 2576 manager.go:354] Recovery completed Jul 30 09:49:44.837237 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.837224 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:44.839210 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839188 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:44.839298 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839225 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:44.839298 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839239 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:44.839740 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839727 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 09:49:44.839804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839740 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 09:49:44.839804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839760 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 30 09:49:44.839804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.839785 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:44.841157 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841142 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:44.841229 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841169 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:44.841229 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841181 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:44.841363 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841308 2576 policy_none.go:49] "None policy: Start" Jul 30 09:49:44.841363 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841325 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 09:49:44.841363 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.841340 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 09:49:44.841552 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.841455 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-75.ec2.internal.18c7085fcd8d80fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-75.ec2.internal,UID:ip-10-0-130-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-75.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-75.ec2.internal,},FirstTimestamp:2026-07-30 09:49:44.839209214 +0000 UTC m=+0.365636536,LastTimestamp:2026-07-30 09:49:44.839209214 +0000 UTC m=+0.365636536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-75.ec2.internal,}" Jul 30 09:49:44.842436 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.842424 2576 policy_none.go:47] "Start" Jul 30 09:49:44.853090 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.852890 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wnm67" Jul 30 09:49:44.853090 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.852846 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-75.ec2.internal.18c7085fcd8ddcfe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-75.ec2.internal,UID:ip-10-0-130-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-75.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-75.ec2.internal,},FirstTimestamp:2026-07-30 09:49:44.839232766 +0000 UTC m=+0.365660084,LastTimestamp:2026-07-30 09:49:44.839232766 +0000 UTC m=+0.365660084,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-75.ec2.internal,}" Jul 30 09:49:44.861687 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.861663 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wnm67" Jul 30 09:49:44.863764 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.863664 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-75.ec2.internal.18c7085fcd8e07df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-75.ec2.internal,UID:ip-10-0-130-75.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-75.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-75.ec2.internal,},FirstTimestamp:2026-07-30 09:49:44.839243743 +0000 UTC m=+0.365671063,LastTimestamp:2026-07-30 09:49:44.839243743 +0000 UTC m=+0.365671063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-75.ec2.internal,}" Jul 30 09:49:44.878694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.878673 2576 manager.go:337] "Starting Device Plugin manager" Jul 30 09:49:44.878782 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.878710 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 09:49:44.878782 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.878721 2576 server.go:87] "Starting device plugin registration server" Jul 30 09:49:44.878976 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.878963 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 09:49:44.879018 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.878979 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 09:49:44.879099 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.879082 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 09:49:44.879181 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.879169 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 09:49:44.879219 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.879182 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 09:49:44.879718 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.879699 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 09:49:44.879804 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.879745 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:44.922167 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.922124 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 09:49:44.924037 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.923356 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 09:49:44.924037 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.923390 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 09:49:44.924037 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.923411 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 09:49:44.924037 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.923443 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 09:49:44.925782 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.925762 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 09:49:44.979605 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.979552 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:44.980647 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.980628 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:44.980754 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.980659 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:44.980754 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.980675 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:44.980754 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.980701 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-75.ec2.internal" Jul 30 09:49:44.988526 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:44.988508 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-75.ec2.internal" Jul 30 09:49:44.988632 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:44.988536 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-75.ec2.internal\": node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.003018 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.002937 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.023648 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.023614 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal"] Jul 30 09:49:45.023787 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.023696 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:45.025987 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.025972 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:45.026057 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.026003 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:45.026057 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.026022 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:45.027196 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.027182 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:45.027305 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.027289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.027354 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.027320 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:45.028017 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.027997 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:45.028017 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.028006 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:45.028198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.028042 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:45.028198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.028044 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:45.028198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.028054 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:45.028198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.028059 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:45.029140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.029123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.029191 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.029157 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 09:49:45.030223 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.030208 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientMemory" Jul 30 09:49:45.030289 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.030236 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 09:49:45.030289 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.030248 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeHasSufficientPID" Jul 30 09:49:45.059046 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.059000 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-75.ec2.internal\" not found" node="ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.063631 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.063612 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-75.ec2.internal\" not found" node="ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.103293 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.103268 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.123432 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.123404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.123552 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.123442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.123552 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.123462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.205198 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.205161 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.223855 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.223931 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.223931 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.223931 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.224067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/632792feb0225915f638d426896756da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal\" (UID: \"632792feb0225915f638d426896756da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.224067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.223913 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cfe6536f353a8e0145bc66b1c5423231-config\") pod \"kube-apiserver-proxy-ip-10-0-130-75.ec2.internal\" (UID: \"cfe6536f353a8e0145bc66b1c5423231\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.306051 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.305960 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.363777 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.363744 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.366415 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.366392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.406628 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.406591 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.513527 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.513489 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.614465 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.614373 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.715332 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:45.715293 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-75.ec2.internal\" not found" Jul 30 09:49:45.762270 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.762232 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 09:49:45.762739 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.762387 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 09:49:45.813489 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.813465 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 09:49:45.821245 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.821219 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 09:49:45.821392 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.821266 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.833144 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.833115 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 09:49:45.834962 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.834941 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" Jul 30 09:49:45.835136 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.834947 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 09:49:45.842060 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.842042 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 09:49:45.861229 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.861206 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwrks" Jul 30 09:49:45.867966 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.867886 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 09:44:45 +0000 UTC" deadline="2028-02-03 19:29:21.937341614 +0000 UTC" Jul 30 09:49:45.867966 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.867924 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13281h39m36.06942198s" Jul 30 09:49:45.867966 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.867938 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rwrks" Jul 30 09:49:45.907641 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:45.907603 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe6536f353a8e0145bc66b1c5423231.slice/crio-e7de32bf089079e01408c5b555728af4b04480765baf44416c3bae4ac3d8089e WatchSource:0}: Error finding container e7de32bf089079e01408c5b555728af4b04480765baf44416c3bae4ac3d8089e: Status 404 returned error can't find the container with id e7de32bf089079e01408c5b555728af4b04480765baf44416c3bae4ac3d8089e Jul 30 09:49:45.908068 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:45.908048 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632792feb0225915f638d426896756da.slice/crio-73d7a86956ec84a3f22ac45e32a43367686ecf6e3090cdf146b98b34b978a2ca WatchSource:0}: Error finding container 73d7a86956ec84a3f22ac45e32a43367686ecf6e3090cdf146b98b34b978a2ca: Status 404 returned error can't find the container with id 73d7a86956ec84a3f22ac45e32a43367686ecf6e3090cdf146b98b34b978a2ca Jul 30 09:49:45.913957 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.913941 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 09:49:45.926878 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.926838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerStarted","Data":"73d7a86956ec84a3f22ac45e32a43367686ecf6e3090cdf146b98b34b978a2ca"} Jul 30 09:49:45.927834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:45.927803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" event={"ID":"cfe6536f353a8e0145bc66b1c5423231","Type":"ContainerStarted","Data":"e7de32bf089079e01408c5b555728af4b04480765baf44416c3bae4ac3d8089e"} Jul 30 09:49:46.102697 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.102672 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 09:49:46.139872 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.139787 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 09:49:46.800776 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.800563 2576 apiserver.go:52] "Watching apiserver" Jul 30 09:49:46.810998 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.810934 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 09:49:46.811402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.811367 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-5trhz","openshift-dns/node-resolver-h82g8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal","openshift-multus/multus-additional-cni-plugins-g24kc","openshift-multus/multus-vrclm","kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal","openshift-image-registry/node-ca-xrhqz","openshift-multus/network-metrics-daemon-rxqwm","openshift-network-diagnostics/network-check-target-pmwsw","openshift-network-operator/iptables-alerter-n2bx2","openshift-ovn-kubernetes/ovnkube-node-gkqrv","kube-system/global-pull-secret-syncer-j24lw","kube-system/konnectivity-agent-zjczc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp"] Jul 30 09:49:46.813576 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.813541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.815165 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.815134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.816386 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.816091 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.816386 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.816141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 09:49:46.816386 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.816177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-86wz5\"" Jul 30 09:49:46.816386 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.816295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.816659 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.816598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.817536 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.817555 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.817795 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.817964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.818065 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.818200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nqnfm\"" Jul 30 09:49:46.818399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.818258 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 09:49:46.819156 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.819138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.820170 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.820149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 09:49:46.820397 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.820382 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.820657 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.820640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.820970 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.820949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2955s\"" Jul 30 09:49:46.821047 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.821431 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821415 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 09:49:46.821669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821654 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.821758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821715 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkblx\"" Jul 30 09:49:46.821758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821734 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.821937 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821919 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.821937 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.821929 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 09:49:46.822067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.822013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 09:49:46.822965 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.822945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:46.823061 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:46.823020 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:46.823863 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.823842 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.823998 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.823981 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.824081 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.824020 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.824362 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.824341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zdjfv\"" Jul 30 09:49:46.824579 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.824560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.824666 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.824635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbpdk\"" Jul 30 09:49:46.824791 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.824771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:46.825963 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.825943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.826984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.826964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 09:49:46.827454 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.827432 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mhgvj\"" Jul 30 09:49:46.827568 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.827543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 09:49:46.827692 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.827676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:46.828336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.828318 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kr9w5\"" Jul 30 09:49:46.828433 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.828416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 09:49:46.829069 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.828937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:46.829069 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:46.829020 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:46.830220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.829889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlmzz\"" Jul 30 09:49:46.830220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.829920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 09:49:46.830220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.830041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 09:49:46.830220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.830212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 09:49:46.830601 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.830583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:46.830685 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:46.830649 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:46.831906 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.831886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-tuned\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.832042 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6115eb50-b6f1-47d6-b97c-688be9838f2c-hosts-file\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.832168 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832168 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-script-lib\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832299 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-socket-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.832351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-netns\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-var-lib-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-log-socket\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-cnibin\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.832450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1318bb10-bc41-4191-9e29-2c363b7dace6-host-slash\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-systemd-units\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-systemd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-conf\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-node-log\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-config\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-os-release\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zxr\" (UniqueName: \"kubernetes.io/projected/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-kube-api-access-79zxr\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832685 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-slash\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-etc-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-device-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-run\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bnbb\" (UniqueName: \"kubernetes.io/projected/1318bb10-bc41-4191-9e29-2c363b7dace6-kube-api-access-7bnbb\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-bin\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysconfig\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.832903 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22px4\" (UniqueName: \"kubernetes.io/projected/6115eb50-b6f1-47d6-b97c-688be9838f2c-kube-api-access-22px4\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwbq6\" (UniqueName: \"kubernetes.io/projected/3580874b-3601-4499-be1b-e554a5cc0163-kube-api-access-dwbq6\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.832996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-env-overrides\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-var-lib-kubelet\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1318bb10-bc41-4191-9e29-2c363b7dace6-iptables-alerter-script\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-netd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-lib-modules\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-ovn\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drp5h\" (UniqueName: \"kubernetes.io/projected/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-kube-api-access-drp5h\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-registration-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-sys-fs\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-kubernetes\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.833524 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-sys\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-host\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-tmp\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-kubelet\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-system-cni-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-systemd\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6115eb50-b6f1-47d6-b97c-688be9838f2c-tmp-dir\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-modprobe-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.834331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.833768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhsm9\" (UniqueName: \"kubernetes.io/projected/5f859dd3-0a01-499a-b30e-daa37d6464e2-kube-api-access-dhsm9\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.869496 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.869409 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 09:44:46 +0000 UTC" deadline="2028-01-24 15:13:48.88894091 +0000 UTC" Jul 30 09:49:46.869617 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.869498 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13037h24m2.019448339s" Jul 30 09:49:46.921854 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.921828 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 09:49:46.934606 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-log-socket\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-cnibin\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1318bb10-bc41-4191-9e29-2c363b7dace6-host-slash\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-systemd-units\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934711 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-log-socket\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.934726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-cnibin\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1318bb10-bc41-4191-9e29-2c363b7dace6-host-slash\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-kubelet\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934786 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-systemd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-conf\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-node-log\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-config\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934893 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-systemd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-os-release\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-os-release\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-conf\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zxr\" (UniqueName: \"kubernetes.io/projected/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-kube-api-access-79zxr\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935011 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-node-log\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-hostroot\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-etc-kubernetes\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.934771 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-systemd-units\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-slash\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-etc-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-device-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-kubelet-config\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-slash\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-multus\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-etc-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-run\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-device-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bnbb\" (UniqueName: \"kubernetes.io/projected/1318bb10-bc41-4191-9e29-2c363b7dace6-kube-api-access-7bnbb\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-run\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-bin\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-system-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935533 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-bin\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-os-release\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh72f\" (UniqueName: \"kubernetes.io/projected/5d5c78b5-df7c-4073-a4e3-2a690f03a465-kube-api-access-wh72f\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:46.935905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba76faf9-4a95-4daf-932c-e86c7ee83388-serviceca\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysconfig\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22px4\" (UniqueName: \"kubernetes.io/projected/6115eb50-b6f1-47d6-b97c-688be9838f2c-kube-api-access-22px4\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysconfig\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-config\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935809 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwbq6\" (UniqueName: \"kubernetes.io/projected/3580874b-3601-4499-be1b-e554a5cc0163-kube-api-access-dwbq6\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-dbus\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-conf-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.935946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-env-overrides\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-sysctl-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee858e02-b84e-4f6f-b50d-96f28f172477-konnectivity-ca\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-var-lib-kubelet\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.936624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1318bb10-bc41-4191-9e29-2c363b7dace6-iptables-alerter-script\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-netd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-var-lib-kubelet\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-cnibin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-cni-netd\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-multus-certs\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-lib-modules\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-ovn\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drp5h\" (UniqueName: \"kubernetes.io/projected/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-kube-api-access-drp5h\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-registration-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-sys-fs\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-cni-binary-copy\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-env-overrides\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-kubernetes\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.937428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-sys\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-k8s-cni-cncf-io\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-netns\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-bin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22ns\" (UniqueName: \"kubernetes.io/projected/ba76faf9-4a95-4daf-932c-e86c7ee83388-kube-api-access-r22ns\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-host\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-tmp\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-kubelet\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-system-cni-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1318bb10-bc41-4191-9e29-2c363b7dace6-iptables-alerter-script\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936861 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936866 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-lib-modules\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-run-ovn\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-socket-dir-parent\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-registration-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.936986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-systemd\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.938285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6115eb50-b6f1-47d6-b97c-688be9838f2c-tmp-dir\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-sys-fs\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsf24\" (UniqueName: \"kubernetes.io/projected/3801a2f5-0031-4793-a053-f024890bfd89-kube-api-access-jsf24\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937179 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-etc-selinux\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-kubernetes\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937282 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-sys\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-host\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937444 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-systemd\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6115eb50-b6f1-47d6-b97c-688be9838f2c-tmp-dir\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937484 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-kubelet\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-modprobe-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937611 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f859dd3-0a01-499a-b30e-daa37d6464e2-system-cni-dir\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhsm9\" (UniqueName: \"kubernetes.io/projected/5f859dd3-0a01-499a-b30e-daa37d6464e2-kube-api-access-dhsm9\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937699 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-multus-daemon-config\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-modprobe-d\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba76faf9-4a95-4daf-932c-e86c7ee83388-host\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937768 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.937790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-tuned\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6115eb50-b6f1-47d6-b97c-688be9838f2c-hosts-file\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-script-lib\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-socket-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6115eb50-b6f1-47d6-b97c-688be9838f2c-hosts-file\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938197 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f859dd3-0a01-499a-b30e-daa37d6464e2-cni-binary-copy\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee858e02-b84e-4f6f-b50d-96f28f172477-agent-certs\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-netns\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.939943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-var-lib-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.940805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3580874b-3601-4499-be1b-e554a5cc0163-socket-dir\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.940805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938355 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-host-run-netns\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.940805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-var-lib-openvswitch\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.940805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.938715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovnkube-script-lib\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.941741 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.941697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-tmp\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.941942 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.941920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-ovn-node-metrics-cert\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:46.942107 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.942087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-etc-tuned\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.950584 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.950225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwbq6\" (UniqueName: \"kubernetes.io/projected/3580874b-3601-4499-be1b-e554a5cc0163-kube-api-access-dwbq6\") pod \"aws-ebs-csi-driver-node-wj6hp\" (UID: \"3580874b-3601-4499-be1b-e554a5cc0163\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:46.950584 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.950555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22px4\" (UniqueName: \"kubernetes.io/projected/6115eb50-b6f1-47d6-b97c-688be9838f2c-kube-api-access-22px4\") pod \"node-resolver-h82g8\" (UID: \"6115eb50-b6f1-47d6-b97c-688be9838f2c\") " pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:46.950904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.950882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zxr\" (UniqueName: \"kubernetes.io/projected/fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40-kube-api-access-79zxr\") pod \"tuned-5trhz\" (UID: \"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40\") " pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:46.951378 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.951357 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bnbb\" (UniqueName: \"kubernetes.io/projected/1318bb10-bc41-4191-9e29-2c363b7dace6-kube-api-access-7bnbb\") pod \"iptables-alerter-n2bx2\" (UID: \"1318bb10-bc41-4191-9e29-2c363b7dace6\") " pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:46.952018 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.951992 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhsm9\" (UniqueName: \"kubernetes.io/projected/5f859dd3-0a01-499a-b30e-daa37d6464e2-kube-api-access-dhsm9\") pod \"multus-additional-cni-plugins-g24kc\" (UID: \"5f859dd3-0a01-499a-b30e-daa37d6464e2\") " pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:46.953121 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:46.953078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drp5h\" (UniqueName: \"kubernetes.io/projected/0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7-kube-api-access-drp5h\") pod \"ovnkube-node-gkqrv\" (UID: \"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:47.039502 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh72f\" (UniqueName: \"kubernetes.io/projected/5d5c78b5-df7c-4073-a4e3-2a690f03a465-kube-api-access-wh72f\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:47.039502 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba76faf9-4a95-4daf-932c-e86c7ee83388-serviceca\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-dbus\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-dbus\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-conf-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee858e02-b84e-4f6f-b50d-96f28f172477-konnectivity-ca\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:47.039758 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.039759 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-cnibin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-multus-certs\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.039834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:47.539800178 +0000 UTC m=+3.066227506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-multus-certs\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-cni-binary-copy\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-conf-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-k8s-cni-cncf-io\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-netns\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-bin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-k8s-cni-cncf-io\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22ns\" (UniqueName: \"kubernetes.io/projected/ba76faf9-4a95-4daf-932c-e86c7ee83388-kube-api-access-r22ns\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.039982 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-cnibin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-socket-dir-parent\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-run-netns\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040125 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-bin\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.040186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsf24\" (UniqueName: \"kubernetes.io/projected/3801a2f5-0031-4793-a053-f024890bfd89-kube-api-access-jsf24\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-multus-socket-dir-parent\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-multus-daemon-config\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba76faf9-4a95-4daf-932c-e86c7ee83388-host\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.040268 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee858e02-b84e-4f6f-b50d-96f28f172477-agent-certs\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040303 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba76faf9-4a95-4daf-932c-e86c7ee83388-host\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.040324 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:47.540304846 +0000 UTC m=+3.066732168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-kubelet\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-hostroot\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-etc-kubernetes\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-kubelet-config\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-multus\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-cni-binary-copy\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-system-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040534 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-hostroot\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee858e02-b84e-4f6f-b50d-96f28f172477-konnectivity-ca\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-kubelet\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-host-var-lib-cni-multus\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-etc-kubernetes\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-os-release\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040604 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-system-cni-dir\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040644 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-kubelet-config\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040648 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba76faf9-4a95-4daf-932c-e86c7ee83388-serviceca\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3801a2f5-0031-4793-a053-f024890bfd89-os-release\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.041683 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.040752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3801a2f5-0031-4793-a053-f024890bfd89-multus-daemon-config\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.043115 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.043093 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee858e02-b84e-4f6f-b50d-96f28f172477-agent-certs\") pod \"konnectivity-agent-zjczc\" (UID: \"ee858e02-b84e-4f6f-b50d-96f28f172477\") " pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:47.048484 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.048456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22ns\" (UniqueName: \"kubernetes.io/projected/ba76faf9-4a95-4daf-932c-e86c7ee83388-kube-api-access-r22ns\") pod \"node-ca-xrhqz\" (UID: \"ba76faf9-4a95-4daf-932c-e86c7ee83388\") " pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.049039 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.049016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh72f\" (UniqueName: \"kubernetes.io/projected/5d5c78b5-df7c-4073-a4e3-2a690f03a465-kube-api-access-wh72f\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:47.050147 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.050127 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:49:47.050147 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.050147 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:49:47.050309 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.050157 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:47.050309 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.050222 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:47.550208892 +0000 UTC m=+3.076636200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:47.055221 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.055165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsf24\" (UniqueName: \"kubernetes.io/projected/3801a2f5-0031-4793-a053-f024890bfd89-kube-api-access-jsf24\") pod \"multus-vrclm\" (UID: \"3801a2f5-0031-4793-a053-f024890bfd89\") " pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.128560 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.128525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2bx2" Jul 30 09:49:47.132952 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.132929 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 09:49:47.137264 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.137245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:49:47.146347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.146327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" Jul 30 09:49:47.154112 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.154094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g24kc" Jul 30 09:49:47.160915 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.160892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5trhz" Jul 30 09:49:47.168668 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.168644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h82g8" Jul 30 09:49:47.176425 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.176407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:49:47.185089 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.185072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrclm" Jul 30 09:49:47.191650 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.191632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrhqz" Jul 30 09:49:47.545322 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.545228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:47.545322 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.545317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.545551 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.545401 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:47.545551 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.545423 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:47.545551 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.545484 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:48.545465159 +0000 UTC m=+4.071892489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:47.545551 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.545503 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:48.545493372 +0000 UTC m=+4.071920680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:47.646488 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.646284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:47.646488 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.646460 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:49:47.646488 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.646479 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:49:47.646488 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.646491 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:47.646806 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.646555 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:48.646538151 +0000 UTC m=+4.172965459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:47.870054 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.869928 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 09:44:46 +0000 UTC" deadline="2028-03-15 01:11:09.102399822 +0000 UTC" Jul 30 09:49:47.870054 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.869995 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14247h21m21.232409769s" Jul 30 09:49:47.924424 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.924389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:47.924589 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:47.924388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:47.924589 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.924505 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:47.924721 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:47.924594 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:47.983901 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:47.983867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba76faf9_4a95_4daf_932c_e86c7ee83388.slice/crio-a0f5da56e307c52983639ff805c38b8b5eeec7a01a1503fdaf6eb398fdbe2e56 WatchSource:0}: Error finding container a0f5da56e307c52983639ff805c38b8b5eeec7a01a1503fdaf6eb398fdbe2e56: Status 404 returned error can't find the container with id a0f5da56e307c52983639ff805c38b8b5eeec7a01a1503fdaf6eb398fdbe2e56 Jul 30 09:49:47.999823 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:47.999795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3580874b_3601_4499_be1b_e554a5cc0163.slice/crio-19b23cd49fe1d8fe8db1e5425c9643cf1a54cc31bcf1ed110ca737d992645f9d WatchSource:0}: Error finding container 19b23cd49fe1d8fe8db1e5425c9643cf1a54cc31bcf1ed110ca737d992645f9d: Status 404 returned error can't find the container with id 19b23cd49fe1d8fe8db1e5425c9643cf1a54cc31bcf1ed110ca737d992645f9d Jul 30 09:49:48.000346 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.000320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3801a2f5_0031_4793_a053_f024890bfd89.slice/crio-7176c04fab3e98867feb64c1c0b4f4719c9701799266996aafca0a612f1ea38f WatchSource:0}: Error finding container 7176c04fab3e98867feb64c1c0b4f4719c9701799266996aafca0a612f1ea38f: Status 404 returned error can't find the container with id 7176c04fab3e98867feb64c1c0b4f4719c9701799266996aafca0a612f1ea38f Jul 30 09:49:48.001458 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.001319 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f859dd3_0a01_499a_b30e_daa37d6464e2.slice/crio-b4356fe6894b17573a23ca2b4e3b58cdbd16bb35b5c22b739e99f2e9f0d01b36 WatchSource:0}: Error finding container b4356fe6894b17573a23ca2b4e3b58cdbd16bb35b5c22b739e99f2e9f0d01b36: Status 404 returned error can't find the container with id b4356fe6894b17573a23ca2b4e3b58cdbd16bb35b5c22b739e99f2e9f0d01b36 Jul 30 09:49:48.002757 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.002728 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1318bb10_bc41_4191_9e29_2c363b7dace6.slice/crio-dde14e17acfbc977ac1fd0604b4c6cd4550455b3dfe56f553ef02cde85a0a24a WatchSource:0}: Error finding container dde14e17acfbc977ac1fd0604b4c6cd4550455b3dfe56f553ef02cde85a0a24a: Status 404 returned error can't find the container with id dde14e17acfbc977ac1fd0604b4c6cd4550455b3dfe56f553ef02cde85a0a24a Jul 30 09:49:48.004226 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.004192 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5e1ac9_dbb1_4b23_a34a_ffdddd2faa40.slice/crio-401a2b0bd93244d2f1772047c9f72d81140ef283053a7b3d049d98d1bf5f6eca WatchSource:0}: Error finding container 401a2b0bd93244d2f1772047c9f72d81140ef283053a7b3d049d98d1bf5f6eca: Status 404 returned error can't find the container with id 401a2b0bd93244d2f1772047c9f72d81140ef283053a7b3d049d98d1bf5f6eca Jul 30 09:49:48.004951 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.004919 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6115eb50_b6f1_47d6_b97c_688be9838f2c.slice/crio-32898b873c93de8266c1da5e93b716146f7345233c6c22e4fc512821c263e76e WatchSource:0}: Error finding container 32898b873c93de8266c1da5e93b716146f7345233c6c22e4fc512821c263e76e: Status 404 returned error can't find the container with id 32898b873c93de8266c1da5e93b716146f7345233c6c22e4fc512821c263e76e Jul 30 09:49:48.008323 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:49:48.008203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee858e02_b84e_4f6f_b50d_96f28f172477.slice/crio-50d265078e5ad53ce97e63eba9a3e14bd765b95c226917f02aae073f77cf726c WatchSource:0}: Error finding container 50d265078e5ad53ce97e63eba9a3e14bd765b95c226917f02aae073f77cf726c: Status 404 returned error can't find the container with id 50d265078e5ad53ce97e63eba9a3e14bd765b95c226917f02aae073f77cf726c Jul 30 09:49:48.554879 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.554751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:48.555098 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.554867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:48.555098 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.555063 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:48.555235 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.555174 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.555154048 +0000 UTC m=+6.081581360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:48.555730 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.555707 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:48.555833 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.555772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.555751991 +0000 UTC m=+6.082179302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:48.655917 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.655876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:48.656156 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.656103 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:49:48.656230 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.656166 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:49:48.656230 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.656181 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:48.656350 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.656248 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:50.65622765 +0000 UTC m=+6.182654979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:48.926297 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.926201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:48.926887 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:48.926369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:48.943917 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.943876 2576 generic.go:356] "Generic (PLEG): container finished" podID="632792feb0225915f638d426896756da" containerID="c22cc01d802a1c616182ea75f8401d6a3985643e96d3d8ab32ec27ce033fc5f2" exitCode=0 Jul 30 09:49:48.944134 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.943963 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerDied","Data":"c22cc01d802a1c616182ea75f8401d6a3985643e96d3d8ab32ec27ce033fc5f2"} Jul 30 09:49:48.949276 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.949190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjczc" event={"ID":"ee858e02-b84e-4f6f-b50d-96f28f172477","Type":"ContainerStarted","Data":"50d265078e5ad53ce97e63eba9a3e14bd765b95c226917f02aae073f77cf726c"} Jul 30 09:49:48.951724 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.951557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"04cff66dfa7d338eb3e808510e859b269d56da0a5d2b6fb9fe54412b38ba6fb7"} Jul 30 09:49:48.964195 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.963016 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h82g8" event={"ID":"6115eb50-b6f1-47d6-b97c-688be9838f2c","Type":"ContainerStarted","Data":"32898b873c93de8266c1da5e93b716146f7345233c6c22e4fc512821c263e76e"} Jul 30 09:49:48.967169 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.967009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5trhz" event={"ID":"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40","Type":"ContainerStarted","Data":"401a2b0bd93244d2f1772047c9f72d81140ef283053a7b3d049d98d1bf5f6eca"} Jul 30 09:49:48.971852 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.971814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerStarted","Data":"b4356fe6894b17573a23ca2b4e3b58cdbd16bb35b5c22b739e99f2e9f0d01b36"} Jul 30 09:49:48.984012 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.983900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrclm" event={"ID":"3801a2f5-0031-4793-a053-f024890bfd89","Type":"ContainerStarted","Data":"7176c04fab3e98867feb64c1c0b4f4719c9701799266996aafca0a612f1ea38f"} Jul 30 09:49:48.990684 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:48.989914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" event={"ID":"cfe6536f353a8e0145bc66b1c5423231","Type":"ContainerStarted","Data":"0625a2a620b18ffda1b55388c2ecc2676eb7112452feb0d913caff93b1736519"} Jul 30 09:49:49.003345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:49.003213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2bx2" event={"ID":"1318bb10-bc41-4191-9e29-2c363b7dace6","Type":"ContainerStarted","Data":"dde14e17acfbc977ac1fd0604b4c6cd4550455b3dfe56f553ef02cde85a0a24a"} Jul 30 09:49:49.009666 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:49.009565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" event={"ID":"3580874b-3601-4499-be1b-e554a5cc0163","Type":"ContainerStarted","Data":"19b23cd49fe1d8fe8db1e5425c9643cf1a54cc31bcf1ed110ca737d992645f9d"} Jul 30 09:49:49.030551 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:49.030506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrhqz" event={"ID":"ba76faf9-4a95-4daf-932c-e86c7ee83388","Type":"ContainerStarted","Data":"a0f5da56e307c52983639ff805c38b8b5eeec7a01a1503fdaf6eb398fdbe2e56"} Jul 30 09:49:49.923943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:49.923890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:49.924162 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:49.924070 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:49.924514 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:49.924490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:49.924623 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:49.924600 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:50.042825 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.042784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" event={"ID":"632792feb0225915f638d426896756da","Type":"ContainerStarted","Data":"306cf529da27f06012b300074e8ecb024e63e93ffbef13dc3dd20a8f01a2a395"} Jul 30 09:49:50.059586 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.058721 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-75.ec2.internal" podStartSLOduration=4.058694015 podStartE2EDuration="4.058694015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:49:49.006941625 +0000 UTC m=+4.533368962" watchObservedRunningTime="2026-07-30 09:49:50.058694015 +0000 UTC m=+5.585121554" Jul 30 09:49:50.582513 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.582475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:50.582723 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.582578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:50.582791 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.582756 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:50.582848 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.582824 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:54.582801976 +0000 UTC m=+10.109229287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:50.583373 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.583256 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:50.583373 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.583315 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:54.583297982 +0000 UTC m=+10.109725291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:50.683575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.683533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:50.683771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.683721 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:49:50.683771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.683745 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:49:50.683771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.683760 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:50.683943 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.683825 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:49:54.683805056 +0000 UTC m=+10.210232391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:50.925981 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:50.925392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:50.925981 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:50.925543 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:51.923675 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:51.923605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:51.924184 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:51.923731 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:51.924184 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:51.924139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:51.924327 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:51.924252 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:52.925159 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:52.924725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:52.925159 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:52.924883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:53.924250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:53.924072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:53.924250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:53.924139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:53.924493 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:53.924248 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:53.924493 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:53.924347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:54.618310 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:54.618266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:54.618810 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:54.618358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:54.618810 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.618471 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:54.618810 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.618502 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:54.618810 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.618562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:02.618537248 +0000 UTC m=+18.144964558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:49:54.618810 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.618587 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:02.618575673 +0000 UTC m=+18.145002987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:49:54.719560 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:54.719459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:54.719771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.719682 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:49:54.719771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.719717 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:49:54.719771 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.719733 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:54.719948 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.719802 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:02.719775525 +0000 UTC m=+18.246202856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:49:54.925613 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:54.925368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:54.925613 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:54.925508 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:55.924188 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:55.924138 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:55.924188 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:55.924194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:55.924827 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:55.924309 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:55.924827 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:55.924450 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:56.924934 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:56.924889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:56.925489 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:56.925066 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:57.923987 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:57.923956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:57.924183 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:57.923957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:57.924183 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:57.924095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:49:57.924275 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:57.924173 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:58.924522 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:58.924488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:49:58.925043 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:58.924608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:49:59.923968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:59.923878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:49:59.924150 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:49:59.923898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:49:59.924150 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:59.924007 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:49:59.924150 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:49:59.924065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:00.923904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:00.923868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:00.924317 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:00.924001 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:01.924204 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:01.924162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:01.924709 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:01.924163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:01.924709 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:01.924300 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:01.924709 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:01.924374 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:02.680970 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:02.680930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:02.681186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:02.681017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:02.681186 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.681104 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:50:02.681186 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.681142 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:50:02.681186 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.681176 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:18.681156129 +0000 UTC m=+34.207583435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:50:02.681395 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.681192 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:18.681184813 +0000 UTC m=+34.207612118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:50:02.782092 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:02.782055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:02.782287 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.782254 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:50:02.782287 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.782280 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:50:02.782399 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.782294 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:50:02.782399 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.782361 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:18.782341885 +0000 UTC m=+34.308769208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:50:02.924070 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:02.924039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:02.924243 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:02.924172 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:03.923939 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:03.923908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:03.924140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:03.923912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:03.924140 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:03.924045 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:03.924140 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:03.924123 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:04.924972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:04.924938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:04.925403 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:04.925076 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:05.924446 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:05.924405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:05.924624 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:05.924543 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:05.924624 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:05.924592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:05.924736 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:05.924709 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:06.924422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:06.924389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:06.924826 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:06.924513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:07.924513 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:07.924067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:07.925255 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:07.924522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:07.925255 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:07.924096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:07.925255 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:07.924617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:08.101266 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.101172 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjczc" event={"ID":"ee858e02-b84e-4f6f-b50d-96f28f172477","Type":"ContainerStarted","Data":"64032fdbabd410fde5f0181a734dec7005bea759edecdd07c4bba59fc00c10bd"} Jul 30 09:50:08.104731 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104699 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"8b9c52ecaa90503ade77606232db08941522fdfc2dc7fad3d74e584366968043"} Jul 30 09:50:08.104878 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"514f0e74e66462a02e9f856cb597206ae6953c70e023afb4163acb58bbfb907d"} Jul 30 09:50:08.104878 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"1f561cfe236809a918a67d392d3baf027b1686f08d04302f9ec6a4aedc528ead"} Jul 30 09:50:08.104984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"fb09dc954f60c37677b1a1e9660f0a05cea839682e518ca80167715906e6766e"} Jul 30 09:50:08.104984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"67aeea87b55af2d9d12fe1919d4bb368a7ac477090d689c773366f15c1e867e2"} Jul 30 09:50:08.104984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.104957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"8cdd94ac4d01526ec185bdb4151625be7982f1f290cec5e67df95838a928ed93"} Jul 30 09:50:08.107339 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.107314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h82g8" event={"ID":"6115eb50-b6f1-47d6-b97c-688be9838f2c","Type":"ContainerStarted","Data":"8d3fdbacdbf96972602d7bed87851d6164ca12550679397037d179531557980d"} Jul 30 09:50:08.109147 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.109121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5trhz" event={"ID":"fd5e1ac9-dbb1-4b23-a34a-ffdddd2faa40","Type":"ContainerStarted","Data":"edfa61f4b333222fa8a308cd8a25bf49dc002b5f21f62ff684f7c207bbb2c0ce"} Jul 30 09:50:08.110716 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.110690 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="3c94dce9a896269c5b3c5320ac1081a7a0087fecd7a9b7a4507a0b7a45e06c9d" exitCode=0 Jul 30 09:50:08.110820 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.110772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"3c94dce9a896269c5b3c5320ac1081a7a0087fecd7a9b7a4507a0b7a45e06c9d"} Jul 30 09:50:08.112441 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.112416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrclm" event={"ID":"3801a2f5-0031-4793-a053-f024890bfd89","Type":"ContainerStarted","Data":"31f86489c71a3be80f4a19cd3981cbc2305b42de6e627c9dbf667d9c188cb150"} Jul 30 09:50:08.114124 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.114096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" event={"ID":"3580874b-3601-4499-be1b-e554a5cc0163","Type":"ContainerStarted","Data":"f941fcc1e2c5dd2500810222b3c3cd4cf19a37781651a53354a70b4c1e123635"} Jul 30 09:50:08.115600 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.115576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrhqz" event={"ID":"ba76faf9-4a95-4daf-932c-e86c7ee83388","Type":"ContainerStarted","Data":"4534caf0753ed5aa10dc38bf3ff65570d38eadce3f98e4347f9950e2dbafc556"} Jul 30 09:50:08.116338 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.116291 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zjczc" podStartSLOduration=3.907491781 podStartE2EDuration="23.116274907s" totalImagesPullingTime="19.208783126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.115859007 +0000 UTC m=+23.642286336" watchObservedRunningTime="2026-07-30 09:50:08.116274907 +0000 UTC m=+23.642702237" Jul 30 09:50:08.116636 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.116603 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-75.ec2.internal" podStartSLOduration=22.116593754 podStartE2EDuration="22.116593754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:49:50.059529741 +0000 UTC m=+5.585957073" watchObservedRunningTime="2026-07-30 09:50:08.116593754 +0000 UTC m=+23.643021087" Jul 30 09:50:08.153861 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.153801 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vrclm" podStartSLOduration=2.879199542 podStartE2EDuration="22.153778778s" totalImagesPullingTime="19.274579236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.153614729 +0000 UTC m=+23.680042068" watchObservedRunningTime="2026-07-30 09:50:08.153778778 +0000 UTC m=+23.680206108" Jul 30 09:50:08.170537 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.170486 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5trhz" podStartSLOduration=3.936489157 podStartE2EDuration="23.170470799s" totalImagesPullingTime="19.233981642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.169994125 +0000 UTC m=+23.696421464" watchObservedRunningTime="2026-07-30 09:50:08.170470799 +0000 UTC m=+23.696898147" Jul 30 09:50:08.185467 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.185401 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h82g8" podStartSLOduration=3.97757958 podStartE2EDuration="23.185388082s" totalImagesPullingTime="19.207808502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.18493696 +0000 UTC m=+23.711364290" watchObservedRunningTime="2026-07-30 09:50:08.185388082 +0000 UTC m=+23.711815409" Jul 30 09:50:08.199531 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.199460 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xrhqz" podStartSLOduration=2.979110856 podStartE2EDuration="22.199445144s" totalImagesPullingTime="19.220334288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:08.198814944 +0000 UTC m=+23.725242273" watchObservedRunningTime="2026-07-30 09:50:08.199445144 +0000 UTC m=+23.725872474" Jul 30 09:50:08.700999 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.700964 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 09:50:08.897341 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.897180 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T09:50:08.70097989Z","UUID":"d5fc558a-2273-4185-af62-1bc72e36f6a5","Handler":null,"Name":"","Endpoint":""} Jul 30 09:50:08.899684 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.899656 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 09:50:08.899805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.899713 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 09:50:08.924277 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:08.924245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:08.924508 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:08.924411 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:09.120567 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.120129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2bx2" event={"ID":"1318bb10-bc41-4191-9e29-2c363b7dace6","Type":"ContainerStarted","Data":"84ce6f5b38ced911a32dd1604a26e6297b1a6eee578770ddece2a5f06fe08595"} Jul 30 09:50:09.122597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.122510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" event={"ID":"3580874b-3601-4499-be1b-e554a5cc0163","Type":"ContainerStarted","Data":"3d9c712737a252e7e9795e94338efa118c0a73b108fbdbd9442254b3405f7942"} Jul 30 09:50:09.924712 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.924626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:09.924916 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:09.924762 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:09.924916 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.924814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:09.925066 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:09.924923 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:09.961448 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.961399 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:50:09.962092 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.962075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:50:09.989908 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:09.989848 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2bx2" podStartSLOduration=5.780705099 podStartE2EDuration="24.989830285s" totalImagesPullingTime="19.209125186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:09.138287005 +0000 UTC m=+24.664714334" watchObservedRunningTime="2026-07-30 09:50:09.989830285 +0000 UTC m=+25.516257613" Jul 30 09:50:10.129571 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:10.129531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"0118966ff2f615b74de4cf849dd1bc5cb9da9bcb8a09d1b1b7813690fe86c3c3"} Jul 30 09:50:10.132344 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:10.132312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" event={"ID":"3580874b-3601-4499-be1b-e554a5cc0163","Type":"ContainerStarted","Data":"82f75c0ecebb81f15fa47ccab306ee0c07e38951bcbd441f65f3473357f99ec4"} Jul 30 09:50:10.150867 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:10.150804 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wj6hp" podStartSLOduration=3.788675579 podStartE2EDuration="25.15078222s" totalImagesPullingTime="21.362106641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:10.150468406 +0000 UTC m=+25.676895736" watchObservedRunningTime="2026-07-30 09:50:10.15078222 +0000 UTC m=+25.677209548" Jul 30 09:50:10.924700 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:10.924657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:10.924884 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:10.924819 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:11.102289 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:11.102256 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h82g8_6115eb50-b6f1-47d6-b97c-688be9838f2c/dns-node-resolver/0.log" Jul 30 09:50:11.135364 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:11.135334 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 30 09:50:11.924708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:11.924522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:11.924902 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:11.924529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:11.924902 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:11.924794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:11.924902 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:11.924887 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:12.076908 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:12.076876 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrhqz_ba76faf9-4a95-4daf-932c-e86c7ee83388/node-ca/0.log" Jul 30 09:50:12.924164 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:12.923965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:12.925001 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:12.924264 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:13.144080 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.143953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" event={"ID":"0cf0200c-a9f5-4dd3-b38c-d5fb287b17e7","Type":"ContainerStarted","Data":"27a8f7dbc58bfe9cd288270e3b23f572543ef6931d791039bf2dc35dfbe11690"} Jul 30 09:50:13.144343 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.144251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:13.145743 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.145721 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="156c7a810fa254704bd11b7c7674b8956f8eb4d6209be37e32aa03df6bf01009" exitCode=0 Jul 30 09:50:13.145859 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.145753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"156c7a810fa254704bd11b7c7674b8956f8eb4d6209be37e32aa03df6bf01009"} Jul 30 09:50:13.160407 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.160382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:13.195789 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.195719 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" podStartSLOduration=8.923173699 podStartE2EDuration="28.195703348s" totalImagesPullingTime="19.272529649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:13.170167061 +0000 UTC m=+28.696594388" watchObservedRunningTime="2026-07-30 09:50:13.195703348 +0000 UTC m=+28.722131035" Jul 30 09:50:13.924385 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.924350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:13.924896 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:13.924355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:13.924896 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:13.924454 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:13.924896 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:13.924555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:14.148754 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.148726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:14.148926 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.148790 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:14.162957 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.162933 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:14.527278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.527202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxqwm"] Jul 30 09:50:14.527430 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.527314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:14.527430 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:14.527411 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:14.530079 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.530011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j24lw"] Jul 30 09:50:14.530245 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.530113 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:14.530245 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:14.530195 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:14.530813 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.530788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmwsw"] Jul 30 09:50:14.530911 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:14.530898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:14.531007 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:14.530987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:15.152402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:15.152367 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="bdf0d8207a0e4894c89e0733313e8d90de2fc00540a49b11f70ed277070912da" exitCode=0 Jul 30 09:50:15.152841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:15.152455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"bdf0d8207a0e4894c89e0733313e8d90de2fc00540a49b11f70ed277070912da"} Jul 30 09:50:15.923949 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:15.923911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:15.924143 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:15.923914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:15.924143 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:15.924024 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:15.924143 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:15.924115 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:15.924143 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:15.923914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:15.924278 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:15.924197 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:17.068943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.068761 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:50:17.069466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.069075 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 30 09:50:17.069466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.069446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zjczc" Jul 30 09:50:17.158602 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.158564 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="34de059f7254323590eca0efc425ac99c1e7807f890fcdaa14e9c6fe388e06f0" exitCode=0 Jul 30 09:50:17.158757 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.158648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"34de059f7254323590eca0efc425ac99c1e7807f890fcdaa14e9c6fe388e06f0"} Jul 30 09:50:17.924348 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.924312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:17.924533 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.924432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:17.924533 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:17.924443 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:17.924533 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:17.924466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:17.924702 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:17.924564 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:17.924702 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:17.924627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:18.703403 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:18.703363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:18.703995 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:18.703444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:18.703995 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.703518 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:50:18.703995 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.703559 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 09:50:18.703995 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.703594 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs podName:5d5c78b5-df7c-4073-a4e3-2a690f03a465 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:50.703574182 +0000 UTC m=+66.230001509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs") pod "network-metrics-daemon-rxqwm" (UID: "5d5c78b5-df7c-4073-a4e3-2a690f03a465") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 09:50:18.703995 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.703612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret podName:f4a228ab-95eb-44cc-94e5-e67aa7f761d4 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:50.70360395 +0000 UTC m=+66.230031256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret") pod "global-pull-secret-syncer-j24lw" (UID: "f4a228ab-95eb-44cc-94e5-e67aa7f761d4") : object "kube-system"/"original-pull-secret" not registered Jul 30 09:50:18.803914 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:18.803886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:18.804088 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.804071 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 09:50:18.804150 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.804094 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 09:50:18.804150 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.804106 2576 projected.go:196] Error preparing data for projected volume kube-api-access-6vp5t for pod openshift-network-diagnostics/network-check-target-pmwsw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:50:18.804223 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:18.804157 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t podName:7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0 nodeName:}" failed. No retries permitted until 2026-07-30 09:50:50.804142195 +0000 UTC m=+66.330569513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vp5t" (UniqueName: "kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t") pod "network-check-target-pmwsw" (UID: "7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 09:50:19.923765 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:19.923733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:19.924345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:19.923771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:19.924345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:19.923740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:19.924345 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:19.923858 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:19.924345 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:19.923956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:19.924345 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:19.924068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:21.924380 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:21.924340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:21.924380 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:21.924383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:21.924912 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:21.924333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:21.924912 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:21.924452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:21.924912 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:21.924518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:21.924912 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:21.924586 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:22.173321 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:22.173286 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="b656ca264bb9e711c72f67c4fb38b2610717b4afeef76cabf4f801962de8ff39" exitCode=0 Jul 30 09:50:22.173459 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:22.173349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"b656ca264bb9e711c72f67c4fb38b2610717b4afeef76cabf4f801962de8ff39"} Jul 30 09:50:23.178228 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:23.178193 2576 generic.go:356] "Generic (PLEG): container finished" podID="5f859dd3-0a01-499a-b30e-daa37d6464e2" containerID="59bf9d9c2f4c479b388780b9faf918f705ce00c87fc2cc9658b5385c5e9ca3a4" exitCode=0 Jul 30 09:50:23.178696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:23.178235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerDied","Data":"59bf9d9c2f4c479b388780b9faf918f705ce00c87fc2cc9658b5385c5e9ca3a4"} Jul 30 09:50:23.924483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:23.924288 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:23.924669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:23.924328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:23.924669 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:23.924595 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:23.924669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:23.924337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:23.924791 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:23.924623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:23.924791 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:23.924711 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:24.183587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:24.183511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g24kc" event={"ID":"5f859dd3-0a01-499a-b30e-daa37d6464e2","Type":"ContainerStarted","Data":"1f895e693d0b8d7dea349ab55be1107292374a20b01ac2b5f4ab8ed5752e6b47"} Jul 30 09:50:24.204199 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:24.204156 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g24kc" podStartSLOduration=9.624529672 podStartE2EDuration="39.204137934s" totalImagesPullingTime="29.579608262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:24.203199498 +0000 UTC m=+39.729626826" watchObservedRunningTime="2026-07-30 09:50:24.204137934 +0000 UTC m=+39.730565262" Jul 30 09:50:25.923743 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:25.923713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:25.924189 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:25.923808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:25.924189 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:25.923828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:25.924189 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:25.923811 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:25.924189 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:25.923916 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:25.924189 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:25.923955 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:27.924449 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:27.924407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:27.924449 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:27.924408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:27.924875 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:27.924428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:27.924875 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:27.924533 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:27.924875 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:27.924581 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:27.924875 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:27.924647 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:29.923913 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:29.923873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:29.923913 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:29.923896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:29.923913 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:29.923896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:29.924516 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:29.923979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:29.924516 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:29.924070 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:29.924516 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:29.924121 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:31.924546 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:31.924503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:31.924546 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:31.924529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:31.924986 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:31.924612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:31.924986 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:31.924623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pmwsw" podUID="7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0" Jul 30 09:50:31.924986 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:31.924706 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxqwm" podUID="5d5c78b5-df7c-4073-a4e3-2a690f03a465" Jul 30 09:50:31.924986 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:50:31.924747 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j24lw" podUID="f4a228ab-95eb-44cc-94e5-e67aa7f761d4" Jul 30 09:50:32.805092 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.805064 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-75.ec2.internal" event="NodeReady" Jul 30 09:50:32.805257 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.805192 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 09:50:32.847120 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.847080 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85876df6b7-5z8xf"] Jul 30 09:50:32.860176 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.860142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.862444 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.862411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 30 09:50:32.862596 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.862475 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fk8k\"" Jul 30 09:50:32.862596 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.862501 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 30 09:50:32.862596 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.862476 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 30 09:50:32.868421 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.868400 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4ctlg"] Jul 30 09:50:32.875604 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.875578 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 30 09:50:32.892224 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.892196 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dbbjn"] Jul 30 09:50:32.892367 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.892321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:32.896250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.896004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw2kw\"" Jul 30 09:50:32.896250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.896212 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 09:50:32.896448 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.896357 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 09:50:32.900619 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f367437a-d53f-4047-9a61-624b0f08eaca-metrics-tls\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:32.900747 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f367437a-d53f-4047-9a61-624b0f08eaca-config-volume\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:32.900747 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f367437a-d53f-4047-9a61-624b0f08eaca-tmp-dir\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:32.900747 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwfg\" (UniqueName: \"kubernetes.io/projected/f367437a-d53f-4047-9a61-624b0f08eaca-kube-api-access-ddwfg\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:32.900747 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-installation-pull-secrets\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900747 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-image-registry-private-configuration\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-tls\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4b30182-67b9-400b-9d89-b8b49022fdf1-ca-trust-extracted\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-certificates\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-bound-sa-token\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-trusted-ca\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.900977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.900942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6j5n\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-kube-api-access-z6j5n\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:32.920511 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.920470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85876df6b7-5z8xf"] Jul 30 09:50:32.920511 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.920513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dbbjn"] Jul 30 09:50:32.920701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.920592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:32.920701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.920626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ctlg"] Jul 30 09:50:32.922883 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.922864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s28zx\"" Jul 30 09:50:32.923019 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.922866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 09:50:32.923197 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.923183 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 09:50:32.923197 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.923189 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 09:50:32.967144 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.967070 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s6srk"] Jul 30 09:50:32.994117 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.994079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s6srk"] Jul 30 09:50:32.994278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.994179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:32.998194 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.998169 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vvm58\"" Jul 30 09:50:32.998346 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.998197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 09:50:32.998346 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.998262 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 09:50:32.998346 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.998314 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 09:50:32.998648 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:32.998630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 09:50:33.002189 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t66h\" (UniqueName: \"kubernetes.io/projected/8fd9021c-3527-4001-a647-8cb468b7c1f4-kube-api-access-9t66h\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.002304 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.002304 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2fgt\" (UniqueName: \"kubernetes.io/projected/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-api-access-l2fgt\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.002304 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-data-volume\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.002304 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.002455 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f367437a-d53f-4047-9a61-624b0f08eaca-metrics-tls\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.002455 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f367437a-d53f-4047-9a61-624b0f08eaca-config-volume\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.002455 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fd9021c-3527-4001-a647-8cb468b7c1f4-cert\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.002455 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f367437a-d53f-4047-9a61-624b0f08eaca-tmp-dir\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwfg\" (UniqueName: \"kubernetes.io/projected/f367437a-d53f-4047-9a61-624b0f08eaca-kube-api-access-ddwfg\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-installation-pull-secrets\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-image-registry-private-configuration\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-tls\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4b30182-67b9-400b-9d89-b8b49022fdf1-ca-trust-extracted\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-certificates\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-bound-sa-token\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.002652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-trusted-ca\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.003019 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6j5n\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-kube-api-access-z6j5n\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.003019 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-crio-socket\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.003019 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.002701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f367437a-d53f-4047-9a61-624b0f08eaca-tmp-dir\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.003193 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.003054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f367437a-d53f-4047-9a61-624b0f08eaca-config-volume\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.003429 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.003399 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4b30182-67b9-400b-9d89-b8b49022fdf1-ca-trust-extracted\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.003509 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.003443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-certificates\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.003900 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.003696 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4b30182-67b9-400b-9d89-b8b49022fdf1-trusted-ca\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.006789 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.006765 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-image-registry-private-configuration\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.006868 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.006788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f367437a-d53f-4047-9a61-624b0f08eaca-metrics-tls\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.006919 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.006863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-registry-tls\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.006919 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.006868 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4b30182-67b9-400b-9d89-b8b49022fdf1-installation-pull-secrets\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.017245 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.017211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwfg\" (UniqueName: \"kubernetes.io/projected/f367437a-d53f-4047-9a61-624b0f08eaca-kube-api-access-ddwfg\") pod \"dns-default-4ctlg\" (UID: \"f367437a-d53f-4047-9a61-624b0f08eaca\") " pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.017452 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.017434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-bound-sa-token\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.017516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.017436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6j5n\" (UniqueName: \"kubernetes.io/projected/d4b30182-67b9-400b-9d89-b8b49022fdf1-kube-api-access-z6j5n\") pod \"image-registry-85876df6b7-5z8xf\" (UID: \"d4b30182-67b9-400b-9d89-b8b49022fdf1\") " pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.103651 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-crio-socket\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103651 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t66h\" (UniqueName: \"kubernetes.io/projected/8fd9021c-3527-4001-a647-8cb468b7c1f4-kube-api-access-9t66h\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.103841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2fgt\" (UniqueName: \"kubernetes.io/projected/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-api-access-l2fgt\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-data-volume\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103831 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-crio-socket\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103967 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.103967 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.103931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fd9021c-3527-4001-a647-8cb468b7c1f4-cert\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.104168 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.104152 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-data-volume\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.104431 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.104402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.106003 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.105972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.106251 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.106235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fd9021c-3527-4001-a647-8cb468b7c1f4-cert\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.112432 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.112412 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t66h\" (UniqueName: \"kubernetes.io/projected/8fd9021c-3527-4001-a647-8cb468b7c1f4-kube-api-access-9t66h\") pod \"ingress-canary-dbbjn\" (UID: \"8fd9021c-3527-4001-a647-8cb468b7c1f4\") " pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.112546 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.112415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2fgt\" (UniqueName: \"kubernetes.io/projected/84ed3fd4-b919-494b-a6eb-c80f1bb279d9-kube-api-access-l2fgt\") pod \"insights-runtime-extractor-s6srk\" (UID: \"84ed3fd4-b919-494b-a6eb-c80f1bb279d9\") " pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.170649 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.170616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:33.203473 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.203440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:33.229753 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.229671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dbbjn" Jul 30 09:50:33.306511 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.305478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s6srk" Jul 30 09:50:33.428065 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.428013 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85876df6b7-5z8xf"] Jul 30 09:50:33.434256 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:33.434231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b30182_67b9_400b_9d89_b8b49022fdf1.slice/crio-8e215cf878ce44ac58220faa6a14451faf42984584343a9f21f134bf6ce62726 WatchSource:0}: Error finding container 8e215cf878ce44ac58220faa6a14451faf42984584343a9f21f134bf6ce62726: Status 404 returned error can't find the container with id 8e215cf878ce44ac58220faa6a14451faf42984584343a9f21f134bf6ce62726 Jul 30 09:50:33.449691 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.449655 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dbbjn"] Jul 30 09:50:33.452483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.452459 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ctlg"] Jul 30 09:50:33.453245 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:33.453087 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd9021c_3527_4001_a647_8cb468b7c1f4.slice/crio-fe92e5595eb48d579acbc76225b999307363102e407651ca7ea4bd4a1d9c5f7f WatchSource:0}: Error finding container fe92e5595eb48d579acbc76225b999307363102e407651ca7ea4bd4a1d9c5f7f: Status 404 returned error can't find the container with id fe92e5595eb48d579acbc76225b999307363102e407651ca7ea4bd4a1d9c5f7f Jul 30 09:50:33.456361 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:33.456229 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf367437a_d53f_4047_9a61_624b0f08eaca.slice/crio-4547286c6e5ddcd1c6720c1693a7abe13232577dd426149a8820a70489d06a82 WatchSource:0}: Error finding container 4547286c6e5ddcd1c6720c1693a7abe13232577dd426149a8820a70489d06a82: Status 404 returned error can't find the container with id 4547286c6e5ddcd1c6720c1693a7abe13232577dd426149a8820a70489d06a82 Jul 30 09:50:33.492626 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.492599 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s6srk"] Jul 30 09:50:33.493089 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:33.493065 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ed3fd4_b919_494b_a6eb_c80f1bb279d9.slice/crio-908950e1aca5e3de2701087113b3039f85646325fa81dd4e42f48e2007d2840d WatchSource:0}: Error finding container 908950e1aca5e3de2701087113b3039f85646325fa81dd4e42f48e2007d2840d: Status 404 returned error can't find the container with id 908950e1aca5e3de2701087113b3039f85646325fa81dd4e42f48e2007d2840d Jul 30 09:50:33.924532 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.924498 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:33.924688 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.924500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:33.924728 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.924509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:33.926951 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.926928 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 09:50:33.927149 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.927134 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5pnh\"" Jul 30 09:50:33.927255 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.927168 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 09:50:33.927782 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.927768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxw5q\"" Jul 30 09:50:33.927846 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.927793 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 09:50:33.927884 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:33.927849 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 09:50:34.205546 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.205409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dbbjn" event={"ID":"8fd9021c-3527-4001-a647-8cb468b7c1f4","Type":"ContainerStarted","Data":"fe92e5595eb48d579acbc76225b999307363102e407651ca7ea4bd4a1d9c5f7f"} Jul 30 09:50:34.207703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.207671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ctlg" event={"ID":"f367437a-d53f-4047-9a61-624b0f08eaca","Type":"ContainerStarted","Data":"4547286c6e5ddcd1c6720c1693a7abe13232577dd426149a8820a70489d06a82"} Jul 30 09:50:34.209491 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.209440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6srk" event={"ID":"84ed3fd4-b919-494b-a6eb-c80f1bb279d9","Type":"ContainerStarted","Data":"908950e1aca5e3de2701087113b3039f85646325fa81dd4e42f48e2007d2840d"} Jul 30 09:50:34.210969 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.210943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" event={"ID":"d4b30182-67b9-400b-9d89-b8b49022fdf1","Type":"ContainerStarted","Data":"11590e833944f944b6bc9e378f021358a8790e8ac8d7bac41031a14b647610d7"} Jul 30 09:50:34.211102 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.210987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" event={"ID":"d4b30182-67b9-400b-9d89-b8b49022fdf1","Type":"ContainerStarted","Data":"8e215cf878ce44ac58220faa6a14451faf42984584343a9f21f134bf6ce62726"} Jul 30 09:50:34.212062 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.211703 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:34.237011 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:34.236954 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" podStartSLOduration=2.236933236 podStartE2EDuration="2.236933236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:34.236625816 +0000 UTC m=+49.763053141" watchObservedRunningTime="2026-07-30 09:50:34.236933236 +0000 UTC m=+49.763360586" Jul 30 09:50:40.228923 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.228832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dbbjn" event={"ID":"8fd9021c-3527-4001-a647-8cb468b7c1f4","Type":"ContainerStarted","Data":"fc2184324420bc7a9d6d5ea1343f0548907c35d3a2a8f9331d39678a46fa4241"} Jul 30 09:50:40.230708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.230686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ctlg" event={"ID":"f367437a-d53f-4047-9a61-624b0f08eaca","Type":"ContainerStarted","Data":"f5bc1bed546555a3559c61b2da7d99f4c56862775394e1b1ce5ff980e0bf83d3"} Jul 30 09:50:40.230779 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.230727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ctlg" event={"ID":"f367437a-d53f-4047-9a61-624b0f08eaca","Type":"ContainerStarted","Data":"e32ee58207ea8606e12cb87783dbd74ee9689fef81e89bba735f8ed5c7e3d1f7"} Jul 30 09:50:40.230779 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.230759 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:40.232147 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.232127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6srk" event={"ID":"84ed3fd4-b919-494b-a6eb-c80f1bb279d9","Type":"ContainerStarted","Data":"2f8c4e118054d68a436a4cbf442c5e4dddecc7e20d1f57df762272e7db1005cb"} Jul 30 09:50:40.243746 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.243700 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dbbjn" podStartSLOduration=1.766564687 podStartE2EDuration="8.243687856s" totalImagesPullingTime="6.477123169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:40.242765389 +0000 UTC m=+55.769192717" watchObservedRunningTime="2026-07-30 09:50:40.243687856 +0000 UTC m=+55.770115162" Jul 30 09:50:40.259728 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:40.259662 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4ctlg" podStartSLOduration=1.7862063529999999 podStartE2EDuration="8.259643469s" totalImagesPullingTime="6.473437116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:40.259088104 +0000 UTC m=+55.785515432" watchObservedRunningTime="2026-07-30 09:50:40.259643469 +0000 UTC m=+55.786070794" Jul 30 09:50:44.246741 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:44.246703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6srk" event={"ID":"84ed3fd4-b919-494b-a6eb-c80f1bb279d9","Type":"ContainerStarted","Data":"bacba50d7d3e78eaa0d09e762ce2e54afc80ea356703c0ff1cc8f843d2471505"} Jul 30 09:50:46.170467 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:46.170436 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkqrv" Jul 30 09:50:48.260236 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:48.260194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6srk" event={"ID":"84ed3fd4-b919-494b-a6eb-c80f1bb279d9","Type":"ContainerStarted","Data":"9295b7d35e78ad7cfde9c85fb360c7a670aa4c0ee4b343350bdf0f1344cfb456"} Jul 30 09:50:48.280171 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:48.280109 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s6srk" podStartSLOduration=2.629925721 podStartE2EDuration="16.280090552s" totalImagesPullingTime="13.650164831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:50:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:48.278814558 +0000 UTC m=+63.805241886" watchObservedRunningTime="2026-07-30 09:50:48.280090552 +0000 UTC m=+63.806517880" Jul 30 09:50:50.237451 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.237422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4ctlg" Jul 30 09:50:50.747735 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.747695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:50.747937 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.747759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:50.753617 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.753599 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 09:50:50.754140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.754121 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 09:50:50.760336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.760312 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f4a228ab-95eb-44cc-94e5-e67aa7f761d4-original-pull-secret\") pod \"global-pull-secret-syncer-j24lw\" (UID: \"f4a228ab-95eb-44cc-94e5-e67aa7f761d4\") " pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:50.760336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.760325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d5c78b5-df7c-4073-a4e3-2a690f03a465-metrics-certs\") pod \"network-metrics-daemon-rxqwm\" (UID: \"5d5c78b5-df7c-4073-a4e3-2a690f03a465\") " pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:50.848970 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.848938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:50.851487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.851472 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 09:50:50.861533 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.861515 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 09:50:50.872610 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:50.872585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vp5t\" (UniqueName: \"kubernetes.io/projected/7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0-kube-api-access-6vp5t\") pod \"network-check-target-pmwsw\" (UID: \"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0\") " pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:51.036160 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.036085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l5pnh\"" Jul 30 09:50:51.042104 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.042086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fxw5q\"" Jul 30 09:50:51.044701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.044689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:51.044788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.044773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j24lw" Jul 30 09:50:51.050721 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.050703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxqwm" Jul 30 09:50:51.188580 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.188547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j24lw"] Jul 30 09:50:51.191934 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:51.191904 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a228ab_95eb_44cc_94e5_e67aa7f761d4.slice/crio-b8f9f4920fab825d21b9c847577a9fd88eb20a4cde95be6a8ca808da8206aaf1 WatchSource:0}: Error finding container b8f9f4920fab825d21b9c847577a9fd88eb20a4cde95be6a8ca808da8206aaf1: Status 404 returned error can't find the container with id b8f9f4920fab825d21b9c847577a9fd88eb20a4cde95be6a8ca808da8206aaf1 Jul 30 09:50:51.271579 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.271541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j24lw" event={"ID":"f4a228ab-95eb-44cc-94e5-e67aa7f761d4","Type":"ContainerStarted","Data":"b8f9f4920fab825d21b9c847577a9fd88eb20a4cde95be6a8ca808da8206aaf1"} Jul 30 09:50:51.415338 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.415312 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pmwsw"] Jul 30 09:50:51.417979 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:51.417956 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxqwm"] Jul 30 09:50:51.418432 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:51.418409 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7398c4dd_8e7f_4bad_a1ec_efc255b2f6d0.slice/crio-c2a01eff2590bd511b7ed11d47f54d6048dd297f6ad8076723269ff943ab4d8e WatchSource:0}: Error finding container c2a01eff2590bd511b7ed11d47f54d6048dd297f6ad8076723269ff943ab4d8e: Status 404 returned error can't find the container with id c2a01eff2590bd511b7ed11d47f54d6048dd297f6ad8076723269ff943ab4d8e Jul 30 09:50:51.421224 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:51.421204 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5c78b5_df7c_4073_a4e3_2a690f03a465.slice/crio-32030b822fa1a852db712b8022b96f208e3b9aba1d12625dbe5e085b9c49b064 WatchSource:0}: Error finding container 32030b822fa1a852db712b8022b96f208e3b9aba1d12625dbe5e085b9c49b064: Status 404 returned error can't find the container with id 32030b822fa1a852db712b8022b96f208e3b9aba1d12625dbe5e085b9c49b064 Jul 30 09:50:52.277652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:52.277572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxqwm" event={"ID":"5d5c78b5-df7c-4073-a4e3-2a690f03a465","Type":"ContainerStarted","Data":"32030b822fa1a852db712b8022b96f208e3b9aba1d12625dbe5e085b9c49b064"} Jul 30 09:50:52.279160 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:52.279127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmwsw" event={"ID":"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0","Type":"ContainerStarted","Data":"c2a01eff2590bd511b7ed11d47f54d6048dd297f6ad8076723269ff943ab4d8e"} Jul 30 09:50:53.176720 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:53.176678 2576 patch_prober.go:28] interesting pod/image-registry-85876df6b7-5z8xf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 30 09:50:53.176906 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:53.176743 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" podUID="d4b30182-67b9-400b-9d89-b8b49022fdf1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 09:50:53.285834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:53.285777 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxqwm" event={"ID":"5d5c78b5-df7c-4073-a4e3-2a690f03a465","Type":"ContainerStarted","Data":"8e4cc1ea54d7eb55381e91e928bc50558e89b2ec0c006baf2fad0f977ee5dd81"} Jul 30 09:50:53.286334 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:53.285844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxqwm" event={"ID":"5d5c78b5-df7c-4073-a4e3-2a690f03a465","Type":"ContainerStarted","Data":"bf8a3053983200682e97059700e7e1bd618561d006f91c94cb2863cb91cb4716"} Jul 30 09:50:53.301250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:53.301076 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxqwm" podStartSLOduration=66.117015994 podStartE2EDuration="1m7.301021274s" totalImagesPullingTime="1.18400528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:53.300461786 +0000 UTC m=+68.826889115" watchObservedRunningTime="2026-07-30 09:50:53.301021274 +0000 UTC m=+68.827448600" Jul 30 09:50:55.220637 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:55.220607 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85876df6b7-5z8xf" Jul 30 09:50:56.297680 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:56.297585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pmwsw" event={"ID":"7398c4dd-8e7f-4bad-a1ec-efc255b2f6d0","Type":"ContainerStarted","Data":"1afee7bb1e627ce5c07ea7b90db8a0b82460074e24b0cf743ea2c51c65e3fc0b"} Jul 30 09:50:56.297680 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:56.297670 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:50:56.299150 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:56.299127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j24lw" event={"ID":"f4a228ab-95eb-44cc-94e5-e67aa7f761d4","Type":"ContainerStarted","Data":"d908093dbb106ea57a09a6bcf0ee682f2bfd3b47c4942ef1be3384ba83c7b97b"} Jul 30 09:50:56.313255 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:56.313214 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pmwsw" podStartSLOduration=66.794214262 podStartE2EDuration="1m11.313200078s" totalImagesPullingTime="4.518985816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:56.312710902 +0000 UTC m=+71.839138231" watchObservedRunningTime="2026-07-30 09:50:56.313200078 +0000 UTC m=+71.839627447" Jul 30 09:50:56.327412 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:56.327371 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j24lw" podStartSLOduration=65.577277225 podStartE2EDuration="1m10.327358025s" totalImagesPullingTime="4.7500808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 09:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:56.326452484 +0000 UTC m=+71.852879812" watchObservedRunningTime="2026-07-30 09:50:56.327358025 +0000 UTC m=+71.853785371" Jul 30 09:50:57.317365 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.317331 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx"] Jul 30 09:50:57.320413 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.320393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.324221 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.324165 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 09:50:57.324221 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.324173 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 09:50:57.324517 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.324501 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 09:50:57.324559 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.324542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 30 09:50:57.325246 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.325229 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cgnc4\"" Jul 30 09:50:57.325295 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.325228 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 30 09:50:57.338611 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.338583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx"] Jul 30 09:50:57.363771 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.363739 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6sbxg"] Jul 30 09:50:57.366726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.366705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.368756 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.368725 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 09:50:57.368995 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.368974 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 09:50:57.369459 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.369445 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jfvzg\"" Jul 30 09:50:57.369657 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.369645 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 09:50:57.399664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.399292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ad486-7911-416d-a2ac-55102cdafc26-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.399664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.399384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.399664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.399427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbvts\" (UniqueName: \"kubernetes.io/projected/ac7ad486-7911-416d-a2ac-55102cdafc26-kube-api-access-hbvts\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.399664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.399484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.500788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-tls\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.500788 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-sys\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbvts\" (UniqueName: \"kubernetes.io/projected/ac7ad486-7911-416d-a2ac-55102cdafc26-kube-api-access-hbvts\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.501082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.501082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-root\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.500985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fd4w\" (UniqueName: \"kubernetes.io/projected/63959dfc-fccf-44ac-b88d-fb1980a6dac9-kube-api-access-9fd4w\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-textfile\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ad486-7911-416d-a2ac-55102cdafc26-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-metrics-client-ca\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501300 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-wtmp\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.501833 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.501814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac7ad486-7911-416d-a2ac-55102cdafc26-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.503415 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.503397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.503480 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.503413 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac7ad486-7911-416d-a2ac-55102cdafc26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.509749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.509724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbvts\" (UniqueName: \"kubernetes.io/projected/ac7ad486-7911-416d-a2ac-55102cdafc26-kube-api-access-hbvts\") pod \"openshift-state-metrics-b8f49f5c6-7cxwx\" (UID: \"ac7ad486-7911-416d-a2ac-55102cdafc26\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.602191 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-sys\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-root\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fd4w\" (UniqueName: \"kubernetes.io/projected/63959dfc-fccf-44ac-b88d-fb1980a6dac9-kube-api-access-9fd4w\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-sys\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-textfile\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602345 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-root\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-metrics-client-ca\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-wtmp\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-tls\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602731 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-wtmp\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.602854 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.602823 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-textfile\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.603120 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.603100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.603200 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.603158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63959dfc-fccf-44ac-b88d-fb1980a6dac9-metrics-client-ca\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.604614 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.604595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.604703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.604680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63959dfc-fccf-44ac-b88d-fb1980a6dac9-node-exporter-tls\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.612399 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.612368 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fd4w\" (UniqueName: \"kubernetes.io/projected/63959dfc-fccf-44ac-b88d-fb1980a6dac9-kube-api-access-9fd4w\") pod \"node-exporter-6sbxg\" (UID: \"63959dfc-fccf-44ac-b88d-fb1980a6dac9\") " pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.629308 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.629279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" Jul 30 09:50:57.675288 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.675252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6sbxg" Jul 30 09:50:57.687411 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:57.687382 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63959dfc_fccf_44ac_b88d_fb1980a6dac9.slice/crio-42fab727007e782c9972b533f0ee3f905e5d92382e805b87728ce7c08891ba8e WatchSource:0}: Error finding container 42fab727007e782c9972b533f0ee3f905e5d92382e805b87728ce7c08891ba8e: Status 404 returned error can't find the container with id 42fab727007e782c9972b533f0ee3f905e5d92382e805b87728ce7c08891ba8e Jul 30 09:50:57.771883 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:57.771846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx"] Jul 30 09:50:57.775135 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:57.775108 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7ad486_7911_416d_a2ac_55102cdafc26.slice/crio-3e90ea16ad3a8f999ac5bd9716002b104b4c378d007700bccbdf76de8b20d8d1 WatchSource:0}: Error finding container 3e90ea16ad3a8f999ac5bd9716002b104b4c378d007700bccbdf76de8b20d8d1: Status 404 returned error can't find the container with id 3e90ea16ad3a8f999ac5bd9716002b104b4c378d007700bccbdf76de8b20d8d1 Jul 30 09:50:58.306736 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:58.306642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6sbxg" event={"ID":"63959dfc-fccf-44ac-b88d-fb1980a6dac9","Type":"ContainerStarted","Data":"42fab727007e782c9972b533f0ee3f905e5d92382e805b87728ce7c08891ba8e"} Jul 30 09:50:58.308361 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:58.308334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" event={"ID":"ac7ad486-7911-416d-a2ac-55102cdafc26","Type":"ContainerStarted","Data":"8294c4be1223a0b1b4ba0737b90424a5a55173df54784b48b1a4f27b2557eb81"} Jul 30 09:50:58.308477 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:58.308384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" event={"ID":"ac7ad486-7911-416d-a2ac-55102cdafc26","Type":"ContainerStarted","Data":"994de5154807ebabc4acd0e7b682812836a7a100c8ec326a17781ea495e3cb4a"} Jul 30 09:50:58.308477 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:58.308404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" event={"ID":"ac7ad486-7911-416d-a2ac-55102cdafc26","Type":"ContainerStarted","Data":"3e90ea16ad3a8f999ac5bd9716002b104b4c378d007700bccbdf76de8b20d8d1"} Jul 30 09:50:59.315178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.315143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6sbxg" event={"ID":"63959dfc-fccf-44ac-b88d-fb1980a6dac9","Type":"ContainerStarted","Data":"786c42ea24ab4ab5b053a67dbacac4c4eb061d86b968fcb89d7840e13aae9352"} Jul 30 09:50:59.317679 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.317647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" event={"ID":"ac7ad486-7911-416d-a2ac-55102cdafc26","Type":"ContainerStarted","Data":"fbaf7a300d593e3768c5454b0803d9269351e621aecf1070b15ea7a17840a532"} Jul 30 09:50:59.337175 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.337138 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-688bb6cb8f-tncfm"] Jul 30 09:50:59.340619 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.340585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.343460 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.343240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 30 09:50:59.343651 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.343627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 30 09:50:59.343830 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.343806 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9vzlm\"" Jul 30 09:50:59.343932 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.343855 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9hauqnb4lskbd\"" Jul 30 09:50:59.343932 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.343870 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 30 09:50:59.344137 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.344118 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 30 09:50:59.344223 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.344205 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 30 09:50:59.355109 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.355082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-688bb6cb8f-tncfm"] Jul 30 09:50:59.360600 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.360553 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7cxwx" podStartSLOduration=1.022797225 podStartE2EDuration="2.360535974s" totalImagesPullingTime="1.337738749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:50:59.359931627 +0000 UTC m=+74.886358967" watchObservedRunningTime="2026-07-30 09:50:59.360535974 +0000 UTC m=+74.886963302" Jul 30 09:50:59.413990 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.413954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414211 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414211 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-grpc-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414315 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414315 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414315 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-metrics-client-ca\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414315 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvs6\" (UniqueName: \"kubernetes.io/projected/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-kube-api-access-szvs6\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.414486 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.414393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515311 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-metrics-client-ca\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515311 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvs6\" (UniqueName: \"kubernetes.io/projected/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-kube-api-access-szvs6\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515311 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-grpc-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.515572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.515462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.516162 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.516121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-metrics-client-ca\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518022 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.517987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518022 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.518009 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518364 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.518340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518420 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.518378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518420 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.518378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-grpc-tls\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.518539 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.518521 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.523004 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.522983 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvs6\" (UniqueName: \"kubernetes.io/projected/a20ccf22-8443-49d7-9bf9-0c6f935cd7fc-kube-api-access-szvs6\") pod \"thanos-querier-688bb6cb8f-tncfm\" (UID: \"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc\") " pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.651128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.651100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:50:59.776641 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:50:59.776570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-688bb6cb8f-tncfm"] Jul 30 09:50:59.780283 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:50:59.780259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20ccf22_8443_49d7_9bf9_0c6f935cd7fc.slice/crio-07b808a3e037f7108077f9cead7c5fa6283284578b75275305a8a0d6920242b5 WatchSource:0}: Error finding container 07b808a3e037f7108077f9cead7c5fa6283284578b75275305a8a0d6920242b5: Status 404 returned error can't find the container with id 07b808a3e037f7108077f9cead7c5fa6283284578b75275305a8a0d6920242b5 Jul 30 09:51:00.322707 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:00.322673 2576 generic.go:356] "Generic (PLEG): container finished" podID="63959dfc-fccf-44ac-b88d-fb1980a6dac9" containerID="786c42ea24ab4ab5b053a67dbacac4c4eb061d86b968fcb89d7840e13aae9352" exitCode=0 Jul 30 09:51:00.323148 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:00.322767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6sbxg" event={"ID":"63959dfc-fccf-44ac-b88d-fb1980a6dac9","Type":"ContainerDied","Data":"786c42ea24ab4ab5b053a67dbacac4c4eb061d86b968fcb89d7840e13aae9352"} Jul 30 09:51:00.323982 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:00.323960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"07b808a3e037f7108077f9cead7c5fa6283284578b75275305a8a0d6920242b5"} Jul 30 09:51:01.330668 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.330629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6sbxg" event={"ID":"63959dfc-fccf-44ac-b88d-fb1980a6dac9","Type":"ContainerStarted","Data":"dbe6b81cf089145be577b5445b46266f80d729aede9855ab15b6241e7213bb91"} Jul 30 09:51:01.331093 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.330694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6sbxg" event={"ID":"63959dfc-fccf-44ac-b88d-fb1980a6dac9","Type":"ContainerStarted","Data":"7d19b0a3c42457a87824401e8fc98483f642fb5e78b1810d498e344d11623ceb"} Jul 30 09:51:01.349678 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.349624 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6sbxg" podStartSLOduration=2.743087742 podStartE2EDuration="4.349601878s" totalImagesPullingTime="1.53414962s" totalInitContainerRuntime="72.364516ms" isStatefulPod=true podCreationTimestamp="2026-07-30 09:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:01.348540523 +0000 UTC m=+76.874967852" watchObservedRunningTime="2026-07-30 09:51:01.349601878 +0000 UTC m=+76.876029207" Jul 30 09:51:01.662425 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.662389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dcf96bf5-hkhzf"] Jul 30 09:51:01.665612 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.665575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.668160 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.667901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 30 09:51:01.668160 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.667913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 30 09:51:01.668160 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.668010 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f9bt4i36ncj86\"" Jul 30 09:51:01.669016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.668947 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 30 09:51:01.669016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.668962 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 30 09:51:01.669016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.668967 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v8dlw\"" Jul 30 09:51:01.674523 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.674498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dcf96bf5-hkhzf"] Jul 30 09:51:01.732833 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.732806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-client-certs\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.732963 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.732838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.732963 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.732857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9xn9\" (UniqueName: \"kubernetes.io/projected/b9ab96ae-2bde-4fcf-a96b-69909d53e939-kube-api-access-m9xn9\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.732963 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.732928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-client-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.733128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.732987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-metrics-server-audit-profiles\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.733128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.733072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ab96ae-2bde-4fcf-a96b-69909d53e939-audit-log\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.733128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.733102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-tls\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834042 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.833988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ab96ae-2bde-4fcf-a96b-69909d53e939-audit-log\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-tls\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-client-certs\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9xn9\" (UniqueName: \"kubernetes.io/projected/b9ab96ae-2bde-4fcf-a96b-69909d53e939-kube-api-access-m9xn9\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-client-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-metrics-server-audit-profiles\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.834535 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.834473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ab96ae-2bde-4fcf-a96b-69909d53e939-audit-log\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.835200 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.835149 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.835355 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.835261 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ab96ae-2bde-4fcf-a96b-69909d53e939-metrics-server-audit-profiles\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.837179 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.837151 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-client-ca-bundle\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.837302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.837250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-client-certs\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.837302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.837260 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ab96ae-2bde-4fcf-a96b-69909d53e939-secret-metrics-server-tls\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.842951 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.842932 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9xn9\" (UniqueName: \"kubernetes.io/projected/b9ab96ae-2bde-4fcf-a96b-69909d53e939-kube-api-access-m9xn9\") pod \"metrics-server-5dcf96bf5-hkhzf\" (UID: \"b9ab96ae-2bde-4fcf-a96b-69909d53e939\") " pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:01.977255 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:01.977181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:02.022283 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.022252 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv"] Jul 30 09:51:02.025483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.025466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.028112 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.027933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 30 09:51:02.028112 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.027936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9k4j5\"" Jul 30 09:51:02.036852 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.036822 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv"] Jul 30 09:51:02.136993 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.136949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmpp\" (UniqueName: \"kubernetes.io/projected/79f7f9ad-6c12-43de-94ba-a983670aabbe-kube-api-access-qqmpp\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.137194 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.137075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.238214 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.238124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmpp\" (UniqueName: \"kubernetes.io/projected/79f7f9ad-6c12-43de-94ba-a983670aabbe-kube-api-access-qqmpp\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.238214 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.238171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.238434 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:51:02.238296 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 30 09:51:02.238434 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:51:02.238369 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert podName:79f7f9ad-6c12-43de-94ba-a983670aabbe nodeName:}" failed. No retries permitted until 2026-07-30 09:51:02.738348576 +0000 UTC m=+78.264775881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-r7psv" (UID: "79f7f9ad-6c12-43de-94ba-a983670aabbe") : secret "monitoring-plugin-cert" not found Jul 30 09:51:02.249493 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.249448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmpp\" (UniqueName: \"kubernetes.io/projected/79f7f9ad-6c12-43de-94ba-a983670aabbe-kube-api-access-qqmpp\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.619922 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.619897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dcf96bf5-hkhzf"] Jul 30 09:51:02.622384 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:51:02.622356 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ab96ae_2bde_4fcf_a96b_69909d53e939.slice/crio-00c69dab25f6207095caa753060352f279a1b5b056360e3911627179084cd21d WatchSource:0}: Error finding container 00c69dab25f6207095caa753060352f279a1b5b056360e3911627179084cd21d: Status 404 returned error can't find the container with id 00c69dab25f6207095caa753060352f279a1b5b056360e3911627179084cd21d Jul 30 09:51:02.742799 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.742775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.745012 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.744984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79f7f9ad-6c12-43de-94ba-a983670aabbe-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-r7psv\" (UID: \"79f7f9ad-6c12-43de-94ba-a983670aabbe\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:02.937245 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:02.937203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:03.069474 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.069440 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv"] Jul 30 09:51:03.072677 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:51:03.072644 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f7f9ad_6c12_43de_94ba_a983670aabbe.slice/crio-412de5f7ab75d3cebae5ee4032c633b2e51dcc301d41c6ba2a95c16d7794967d WatchSource:0}: Error finding container 412de5f7ab75d3cebae5ee4032c633b2e51dcc301d41c6ba2a95c16d7794967d: Status 404 returned error can't find the container with id 412de5f7ab75d3cebae5ee4032c633b2e51dcc301d41c6ba2a95c16d7794967d Jul 30 09:51:03.339445 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.339346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" event={"ID":"79f7f9ad-6c12-43de-94ba-a983670aabbe","Type":"ContainerStarted","Data":"412de5f7ab75d3cebae5ee4032c633b2e51dcc301d41c6ba2a95c16d7794967d"} Jul 30 09:51:03.341370 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.341331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"f6fb45fec1f95934e7d44052a6c5e1fd048a9a5c447ce32b1a53fa6730a08521"} Jul 30 09:51:03.341520 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.341402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"85640fdada315691098e6e6ff933f1dee7344b7fcc046c532b01036a8d2cb511"} Jul 30 09:51:03.341520 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.341447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"9ed81dbe639be44e8af5b08c89779b19a9953dc64a5930d9de9d72b084c1a184"} Jul 30 09:51:03.342616 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:03.342589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" event={"ID":"b9ab96ae-2bde-4fcf-a96b-69909d53e939","Type":"ContainerStarted","Data":"00c69dab25f6207095caa753060352f279a1b5b056360e3911627179084cd21d"} Jul 30 09:51:04.350689 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:04.350652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"b504c1aaf9c10d48d65cb0a575317a1360b91261b546a9eb103ea570431a454b"} Jul 30 09:51:04.351181 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:04.350729 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"3a0d334d09c6865e28cb3ce58088471e2d090a4cc51efae983d4fe5475159d03"} Jul 30 09:51:04.351181 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:04.350766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" event={"ID":"a20ccf22-8443-49d7-9bf9-0c6f935cd7fc","Type":"ContainerStarted","Data":"da620831cba043d5dc182194765f351c0d6253561c64de0c7b6353c2016dec7f"} Jul 30 09:51:04.351181 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:04.350854 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:51:04.388876 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:04.388801 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" podStartSLOduration=1.709921823 podStartE2EDuration="5.388778757s" totalImagesPullingTime="3.678856934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:50:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:04.386117217 +0000 UTC m=+79.912544547" watchObservedRunningTime="2026-07-30 09:51:04.388778757 +0000 UTC m=+79.915206085" Jul 30 09:51:05.357540 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.357507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" event={"ID":"b9ab96ae-2bde-4fcf-a96b-69909d53e939","Type":"ContainerStarted","Data":"6a58baef12cad7fee457ed9be03ca831697bf7473acfb315a4545fbde2d52ec1"} Jul 30 09:51:05.373942 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.373914 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:51:05.376874 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.376854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.379345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.379322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4jqs8\"" Jul 30 09:51:05.379461 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.379439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 30 09:51:05.379536 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.379522 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 30 09:51:05.380189 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.380169 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 30 09:51:05.380426 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.380392 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 30 09:51:05.380563 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.380544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 30 09:51:05.380631 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.380596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 30 09:51:05.381684 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.381651 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 30 09:51:05.386208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.386163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" podStartSLOduration=2.405498139 podStartE2EDuration="4.386146584s" totalImagesPullingTime="1.980648445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:05.385959417 +0000 UTC m=+80.912386745" watchObservedRunningTime="2026-07-30 09:51:05.386146584 +0000 UTC m=+80.912573913" Jul 30 09:51:05.387431 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.387408 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 30 09:51:05.396099 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.396079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:51:05.468804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.468505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.468804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.468588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.468804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.468677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.468804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.468695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.468804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.468711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h2p\" (UniqueName: \"kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.469254 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.469108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.469254 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.469159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h2p\" (UniqueName: \"kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569843 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569843 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569843 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569843 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.569843 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.570131 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.569856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.570641 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.570615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.570772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.570620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.570772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.570666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.571092 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.571069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.572293 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.572272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.572453 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.572435 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.578549 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.578527 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h2p\" (UniqueName: \"kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p\") pod \"console-64c4bf887b-mlrdr\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.688456 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.688425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:05.822142 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:05.822117 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:51:05.824353 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:51:05.824329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f28bc73_d0e9_47bc_ba2e_cbcc817f97c3.slice/crio-7a3bcce7d9f7f5ed9fb44ae686e6c2d2fbffea55a4af0d81abd2799392bc2534 WatchSource:0}: Error finding container 7a3bcce7d9f7f5ed9fb44ae686e6c2d2fbffea55a4af0d81abd2799392bc2534: Status 404 returned error can't find the container with id 7a3bcce7d9f7f5ed9fb44ae686e6c2d2fbffea55a4af0d81abd2799392bc2534 Jul 30 09:51:06.364320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:06.364183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" event={"ID":"79f7f9ad-6c12-43de-94ba-a983670aabbe","Type":"ContainerStarted","Data":"beaa08b5196ae0a3a561a372ad5784dcd57012f615364bb5985d3c91737d7da0"} Jul 30 09:51:06.364320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:06.364284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:06.366700 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:06.366648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4bf887b-mlrdr" event={"ID":"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3","Type":"ContainerStarted","Data":"7a3bcce7d9f7f5ed9fb44ae686e6c2d2fbffea55a4af0d81abd2799392bc2534"} Jul 30 09:51:06.371614 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:06.371592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" Jul 30 09:51:06.392331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:06.391705 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-r7psv" podStartSLOduration=1.843810602 podStartE2EDuration="4.391687616s" totalImagesPullingTime="2.547877014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:06.390297408 +0000 UTC m=+81.916724747" watchObservedRunningTime="2026-07-30 09:51:06.391687616 +0000 UTC m=+81.918114946" Jul 30 09:51:09.378685 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:09.378653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4bf887b-mlrdr" event={"ID":"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3","Type":"ContainerStarted","Data":"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f"} Jul 30 09:51:10.364227 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:10.364202 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-688bb6cb8f-tncfm" Jul 30 09:51:10.395400 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:10.395350 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c4bf887b-mlrdr" podStartSLOduration=2.445391467 podStartE2EDuration="5.395334892s" totalImagesPullingTime="2.949943425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:51:09.412850805 +0000 UTC m=+84.939278135" watchObservedRunningTime="2026-07-30 09:51:10.395334892 +0000 UTC m=+85.921762269" Jul 30 09:51:15.689379 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:15.689338 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:15.689943 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:15.689409 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:15.694296 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:15.694274 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:16.407597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:16.407561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:51:21.977696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:21.977656 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:21.978114 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:21.977740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:27.304437 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:27.304407 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pmwsw" Jul 30 09:51:41.982917 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:41.982888 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:51:41.986593 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:51:41.986564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dcf96bf5-hkhzf" Jul 30 09:52:21.581093 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.581056 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-587d9f8479-dtt2k"] Jul 30 09:52:21.584402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.584386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.586830 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.586788 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 30 09:52:21.587709 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.587047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 30 09:52:21.587709 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.587255 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 30 09:52:21.587709 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.587398 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 30 09:52:21.587913 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.587840 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 30 09:52:21.591874 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.588173 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lbxw6\"" Jul 30 09:52:21.595326 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.595306 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 30 09:52:21.599770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.599749 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-587d9f8479-dtt2k"] Jul 30 09:52:21.747911 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.747875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.747921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-federate-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.747943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzqc\" (UniqueName: \"kubernetes.io/projected/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-kube-api-access-jnzqc\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.748053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.748091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748140 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.748130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-serving-certs-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748361 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.748166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.748361 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.748210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-metrics-client-ca\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849492 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-serving-certs-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849492 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849676 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-metrics-client-ca\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849676 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849676 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-federate-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849824 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzqc\" (UniqueName: \"kubernetes.io/projected/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-kube-api-access-jnzqc\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.849824 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.849731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.850083 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.850061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.850352 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.850328 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-serving-certs-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.850433 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.850365 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-metrics-client-ca\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.850732 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.850708 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.851996 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.851978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.852211 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.852189 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-federate-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.852253 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.852232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-secret-telemeter-client\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.852325 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.852309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-telemeter-client-tls\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.856960 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.856940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzqc\" (UniqueName: \"kubernetes.io/projected/131f5fd2-15e6-454b-bf2d-c6f812e29ff2-kube-api-access-jnzqc\") pod \"telemeter-client-587d9f8479-dtt2k\" (UID: \"131f5fd2-15e6-454b-bf2d-c6f812e29ff2\") " pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:21.896017 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:21.895978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" Jul 30 09:52:22.048771 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:22.048733 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-587d9f8479-dtt2k"] Jul 30 09:52:22.055602 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:52:22.055574 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131f5fd2_15e6_454b_bf2d_c6f812e29ff2.slice/crio-2e0965936f6601cea06ea1cde6d0521619fd7dd6e90a6307cb6c8d61b3e7d559 WatchSource:0}: Error finding container 2e0965936f6601cea06ea1cde6d0521619fd7dd6e90a6307cb6c8d61b3e7d559: Status 404 returned error can't find the container with id 2e0965936f6601cea06ea1cde6d0521619fd7dd6e90a6307cb6c8d61b3e7d559 Jul 30 09:52:22.637273 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:22.637232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" event={"ID":"131f5fd2-15e6-454b-bf2d-c6f812e29ff2","Type":"ContainerStarted","Data":"2e0965936f6601cea06ea1cde6d0521619fd7dd6e90a6307cb6c8d61b3e7d559"} Jul 30 09:52:23.641749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:23.641713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" event={"ID":"131f5fd2-15e6-454b-bf2d-c6f812e29ff2","Type":"ContainerStarted","Data":"dd687d352b78214aa6c994069d65622efd4aa367f26659c156dc3fa9633416df"} Jul 30 09:52:25.650764 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:25.650724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" event={"ID":"131f5fd2-15e6-454b-bf2d-c6f812e29ff2","Type":"ContainerStarted","Data":"179c1663e8bd425e08e53546954668e68711ddc16710d6ef26e3daeca91e6419"} Jul 30 09:52:25.651162 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:25.650829 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" event={"ID":"131f5fd2-15e6-454b-bf2d-c6f812e29ff2","Type":"ContainerStarted","Data":"7e626ec58ca9b55b17f3b05cf14f2b6bc9fe084250926ce91b772cf89003346f"} Jul 30 09:52:25.672227 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:25.672184 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-587d9f8479-dtt2k" podStartSLOduration=2.097457454 podStartE2EDuration="4.67216931s" totalImagesPullingTime="2.574711856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:52:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:52:25.671354249 +0000 UTC m=+161.197781577" watchObservedRunningTime="2026-07-30 09:52:25.67216931 +0000 UTC m=+161.198596638" Jul 30 09:52:26.430108 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.430076 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:52:26.433274 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.433259 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.443804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.443783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:52:26.592974 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.592938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.592974 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.592979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.593209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.593001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.593209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.593089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.593209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.593112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z84ml\" (UniqueName: \"kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.593209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.593153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.593209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.593181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.694618 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z84ml\" (UniqueName: \"kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.694618 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.694618 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.694721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695515 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.695495 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695574 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.695526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695574 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.695558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.695649 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.695557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.697221 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.697203 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.697322 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.697306 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.701702 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.701681 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z84ml\" (UniqueName: \"kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml\") pod \"console-5d84955d55-v88zd\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.742185 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.742161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:26.864309 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:26.864282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:52:26.867423 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:52:26.867399 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa3ddb5_d452_4ffe_8b81_9df1ff6bdf64.slice/crio-22a1dc3763aced0c42f293cfe65df9e808bfcc3367403cc5fc1afda852706f15 WatchSource:0}: Error finding container 22a1dc3763aced0c42f293cfe65df9e808bfcc3367403cc5fc1afda852706f15: Status 404 returned error can't find the container with id 22a1dc3763aced0c42f293cfe65df9e808bfcc3367403cc5fc1afda852706f15 Jul 30 09:52:27.659631 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:27.659598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d84955d55-v88zd" event={"ID":"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64","Type":"ContainerStarted","Data":"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c"} Jul 30 09:52:27.659817 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:27.659647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d84955d55-v88zd" event={"ID":"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64","Type":"ContainerStarted","Data":"22a1dc3763aced0c42f293cfe65df9e808bfcc3367403cc5fc1afda852706f15"} Jul 30 09:52:27.676684 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:27.676635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d84955d55-v88zd" podStartSLOduration=1.676615209 podStartE2EDuration="1.676615209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:52:27.67585013 +0000 UTC m=+163.202277461" watchObservedRunningTime="2026-07-30 09:52:27.676615209 +0000 UTC m=+163.203042538" Jul 30 09:52:36.743023 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:36.742985 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:36.743454 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:36.743092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:36.747676 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:36.747653 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:37.700339 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:37.700312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:52:37.747882 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:52:37.747850 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:53:02.767275 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:02.767212 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64c4bf887b-mlrdr" podUID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" containerName="console" containerID="cri-o://5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f" gracePeriod=15 Jul 30 09:53:03.005208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.005182 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:53:03.094208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094098 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094159 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094176 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6h2p\" (UniqueName: \"kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094547 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094547 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094384 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094547 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle\") pod \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\" (UID: \"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3\") " Jul 30 09:53:03.094701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094602 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:53:03.094832 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094800 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config" (OuterVolumeSpecName: "console-config") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:53:03.094832 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094806 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.094994 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094811 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:53:03.094994 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.094954 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:53:03.096510 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.096485 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:53:03.096510 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.096499 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p" (OuterVolumeSpecName: "kube-api-access-g6h2p") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "kube-api-access-g6h2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:53:03.096628 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.096515 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" (UID: "9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:53:03.195316 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195282 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.195316 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195312 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.195316 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195323 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6h2p\" (UniqueName: \"kubernetes.io/projected/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-kube-api-access-g6h2p\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.195553 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195333 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.195553 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195342 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.195553 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.195350 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:53:03.786493 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.786449 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" containerID="5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f" exitCode=0 Jul 30 09:53:03.786972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.786501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4bf887b-mlrdr" event={"ID":"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3","Type":"ContainerDied","Data":"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f"} Jul 30 09:53:03.786972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.786523 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4bf887b-mlrdr" Jul 30 09:53:03.786972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.786604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4bf887b-mlrdr" event={"ID":"9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3","Type":"ContainerDied","Data":"7a3bcce7d9f7f5ed9fb44ae686e6c2d2fbffea55a4af0d81abd2799392bc2534"} Jul 30 09:53:03.786972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.786638 2576 scope.go:117] "RemoveContainer" containerID="5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f" Jul 30 09:53:03.795282 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.795259 2576 scope.go:117] "RemoveContainer" containerID="5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f" Jul 30 09:53:03.795634 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:53:03.795610 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f\": container with ID starting with 5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f not found: ID does not exist" containerID="5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f" Jul 30 09:53:03.795724 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.795647 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f"} err="failed to get container status \"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f\": rpc error: code = NotFound desc = could not find container \"5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f\": container with ID starting with 5c4c167e4733323f5ed50e84f0e62b2aac0b99a97726ff1fab14195c3ccbd76f not found: ID does not exist" Jul 30 09:53:03.811809 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.811774 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:53:03.817849 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:03.817814 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c4bf887b-mlrdr"] Jul 30 09:53:04.928615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:04.928585 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" path="/var/lib/kubelet/pods/9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3/volumes" Jul 30 09:53:46.846753 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.846721 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:53:46.847159 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.847002 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" containerName="console" Jul 30 09:53:46.847159 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.847012 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" containerName="console" Jul 30 09:53:46.847159 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.847081 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f28bc73-d0e9-47bc-ba2e-cbcc817f97c3" containerName="console" Jul 30 09:53:46.850087 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.850062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.861867 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.861844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:53:46.930559 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930713 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930713 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48drz\" (UniqueName: \"kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930713 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930872 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930872 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:46.930872 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:46.930798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.031925 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.031891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.031925 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.031928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032185 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.031964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032185 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032185 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48drz\" (UniqueName: \"kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032400 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032745 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.032896 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.032746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.033328 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.033307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.033795 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.033776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.034530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.034507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.034608 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.034518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.044519 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.044496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48drz\" (UniqueName: \"kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz\") pod \"console-869cb57674-gcjsj\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.158899 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.158863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:47.281985 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.281947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:53:47.287992 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:53:47.287964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22181105_d1ca_4f92_a755_c14699c0c336.slice/crio-eeab8079dd088d33b16a0d2ed8c0057f5ae29844316e47ace8b58f688140e47b WatchSource:0}: Error finding container eeab8079dd088d33b16a0d2ed8c0057f5ae29844316e47ace8b58f688140e47b: Status 404 returned error can't find the container with id eeab8079dd088d33b16a0d2ed8c0057f5ae29844316e47ace8b58f688140e47b Jul 30 09:53:47.942308 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.942268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869cb57674-gcjsj" event={"ID":"22181105-d1ca-4f92-a755-c14699c0c336","Type":"ContainerStarted","Data":"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae"} Jul 30 09:53:47.942739 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.942319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869cb57674-gcjsj" event={"ID":"22181105-d1ca-4f92-a755-c14699c0c336","Type":"ContainerStarted","Data":"eeab8079dd088d33b16a0d2ed8c0057f5ae29844316e47ace8b58f688140e47b"} Jul 30 09:53:47.973956 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:47.973914 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869cb57674-gcjsj" podStartSLOduration=1.97389927 podStartE2EDuration="1.97389927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:53:47.973401117 +0000 UTC m=+243.499828447" watchObservedRunningTime="2026-07-30 09:53:47.97389927 +0000 UTC m=+243.500326647" Jul 30 09:53:57.159251 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:57.159200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:57.159251 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:57.159270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:57.163826 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:57.163801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:57.986395 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:57.986364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:53:58.033917 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:53:58.033886 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:54:23.054706 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.054607 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d84955d55-v88zd" podUID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" containerName="console" containerID="cri-o://86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c" gracePeriod=15 Jul 30 09:54:23.296712 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.296689 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:54:23.424278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424248 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424476 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424307 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424476 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424476 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424431 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424489 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z84ml\" (UniqueName: \"kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424539 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert\") pod \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\" (UID: \"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64\") " Jul 30 09:54:23.424703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424683 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:54:23.424895 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424841 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config" (OuterVolumeSpecName: "console-config") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:54:23.424948 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424916 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.424948 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424935 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.425016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424978 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:54:23.425016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.424990 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:54:23.426567 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.426546 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:54:23.426648 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.426562 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:54:23.426648 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.426595 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml" (OuterVolumeSpecName: "kube-api-access-z84ml") pod "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" (UID: "ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64"). InnerVolumeSpecName "kube-api-access-z84ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:54:23.525750 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.525713 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.525750 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.525743 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z84ml\" (UniqueName: \"kubernetes.io/projected/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-kube-api-access-z84ml\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.525750 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.525757 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.526015 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.525769 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:23.526015 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:23.525780 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:54:24.068910 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.068874 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" containerID="86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c" exitCode=0 Jul 30 09:54:24.069390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.068916 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d84955d55-v88zd" Jul 30 09:54:24.069390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.068955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d84955d55-v88zd" event={"ID":"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64","Type":"ContainerDied","Data":"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c"} Jul 30 09:54:24.069390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.069005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d84955d55-v88zd" event={"ID":"ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64","Type":"ContainerDied","Data":"22a1dc3763aced0c42f293cfe65df9e808bfcc3367403cc5fc1afda852706f15"} Jul 30 09:54:24.069390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.069044 2576 scope.go:117] "RemoveContainer" containerID="86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c" Jul 30 09:54:24.078977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.078960 2576 scope.go:117] "RemoveContainer" containerID="86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c" Jul 30 09:54:24.079262 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:54:24.079245 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c\": container with ID starting with 86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c not found: ID does not exist" containerID="86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c" Jul 30 09:54:24.079326 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.079272 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c"} err="failed to get container status \"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c\": rpc error: code = NotFound desc = could not find container \"86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c\": container with ID starting with 86d0cc826d3c0a443266b07e74396151616215de834f3e5f245a2baeddfe9d4c not found: ID does not exist" Jul 30 09:54:24.091854 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.091823 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:54:24.095525 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.095495 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d84955d55-v88zd"] Jul 30 09:54:24.932456 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:24.932422 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" path="/var/lib/kubelet/pods/ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64/volumes" Jul 30 09:54:44.839667 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:44.839626 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 09:54:53.709708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.709672 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg"] Jul 30 09:54:53.712336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.709944 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" containerName="console" Jul 30 09:54:53.712336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.709954 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" containerName="console" Jul 30 09:54:53.712336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.710003 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa3ddb5-d452-4ffe-8b81-9df1ff6bdf64" containerName="console" Jul 30 09:54:53.715935 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.715908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.718707 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.718683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 09:54:53.718811 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.718720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 09:54:53.719183 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.719170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6pz7\"" Jul 30 09:54:53.723839 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.723644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg"] Jul 30 09:54:53.748541 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.748505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmzr\" (UniqueName: \"kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.748738 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.748550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.748738 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.748577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.848971 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.848918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmzr\" (UniqueName: \"kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.849129 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.848985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.849129 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.849012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.849351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.849333 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.849407 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.849368 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:53.857313 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:53.857274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmzr\" (UniqueName: \"kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:54.025745 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:54.025647 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:54:54.157291 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:54.157256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg"] Jul 30 09:54:54.160436 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:54:54.160403 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc7b78a_9d4b_4af7_b05e_3a63796c5612.slice/crio-aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a WatchSource:0}: Error finding container aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a: Status 404 returned error can't find the container with id aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a Jul 30 09:54:54.162517 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:54.162502 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 09:54:54.170514 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:54:54.170484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" event={"ID":"7fc7b78a-9d4b-4af7-b05e-3a63796c5612","Type":"ContainerStarted","Data":"aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a"} Jul 30 09:55:00.195569 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:00.195528 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerID="7976c0c72c1027613384305e4a99d5697b78db65bab0a459f7c7290aa09e2143" exitCode=0 Jul 30 09:55:00.195946 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:00.195587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" event={"ID":"7fc7b78a-9d4b-4af7-b05e-3a63796c5612","Type":"ContainerDied","Data":"7976c0c72c1027613384305e4a99d5697b78db65bab0a459f7c7290aa09e2143"} Jul 30 09:55:03.208823 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:03.208793 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerID="82bc93eaec95be5ae8cbc44f55e5d0075bcc7ca49018cb22c0fff8d1113662f2" exitCode=0 Jul 30 09:55:03.209219 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:03.208853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" event={"ID":"7fc7b78a-9d4b-4af7-b05e-3a63796c5612","Type":"ContainerDied","Data":"82bc93eaec95be5ae8cbc44f55e5d0075bcc7ca49018cb22c0fff8d1113662f2"} Jul 30 09:55:10.241899 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:10.241862 2576 generic.go:356] "Generic (PLEG): container finished" podID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerID="eec33bdbbb234465a2c196fa322289607b62a06f51a171ff049e336e06a081e7" exitCode=0 Jul 30 09:55:10.242335 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:10.241922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" event={"ID":"7fc7b78a-9d4b-4af7-b05e-3a63796c5612","Type":"ContainerDied","Data":"eec33bdbbb234465a2c196fa322289607b62a06f51a171ff049e336e06a081e7"} Jul 30 09:55:11.365102 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.365078 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:55:11.493513 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.493472 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fmzr\" (UniqueName: \"kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr\") pod \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " Jul 30 09:55:11.493716 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.493538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle\") pod \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " Jul 30 09:55:11.493716 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.493560 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util\") pod \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\" (UID: \"7fc7b78a-9d4b-4af7-b05e-3a63796c5612\") " Jul 30 09:55:11.494347 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.494315 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle" (OuterVolumeSpecName: "bundle") pod "7fc7b78a-9d4b-4af7-b05e-3a63796c5612" (UID: "7fc7b78a-9d4b-4af7-b05e-3a63796c5612"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:11.495730 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.495666 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr" (OuterVolumeSpecName: "kube-api-access-8fmzr") pod "7fc7b78a-9d4b-4af7-b05e-3a63796c5612" (UID: "7fc7b78a-9d4b-4af7-b05e-3a63796c5612"). InnerVolumeSpecName "kube-api-access-8fmzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:55:11.498597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.498576 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util" (OuterVolumeSpecName: "util") pod "7fc7b78a-9d4b-4af7-b05e-3a63796c5612" (UID: "7fc7b78a-9d4b-4af7-b05e-3a63796c5612"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:11.594419 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.594381 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fmzr\" (UniqueName: \"kubernetes.io/projected/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-kube-api-access-8fmzr\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:11.594419 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.594414 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:11.594419 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:11.594424 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7fc7b78a-9d4b-4af7-b05e-3a63796c5612-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:12.254862 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:12.254827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" event={"ID":"7fc7b78a-9d4b-4af7-b05e-3a63796c5612","Type":"ContainerDied","Data":"aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a"} Jul 30 09:55:12.254862 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:12.254850 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540m75bg" Jul 30 09:55:12.255082 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:12.254899 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa9e03f6a1487d065ba7d45424f3fbb742c663180501b0d3e72207b04507e06a" Jul 30 09:55:16.914012 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.913980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2"] Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="util" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914267 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="util" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914277 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="extract" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914282 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="extract" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914299 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="pull" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914304 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="pull" Jul 30 09:55:16.914376 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.914343 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fc7b78a-9d4b-4af7-b05e-3a63796c5612" containerName="extract" Jul 30 09:55:16.949577 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.949546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:16.952339 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.952319 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dj72v\"" Jul 30 09:55:16.952565 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.952548 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 30 09:55:16.952710 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.952567 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 30 09:55:16.954406 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:16.954363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2"] Jul 30 09:55:17.038107 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.038086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a39377f-157d-4a36-980f-b444b881a05c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.038234 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.038146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtvjq\" (UniqueName: \"kubernetes.io/projected/8a39377f-157d-4a36-980f-b444b881a05c-kube-api-access-rtvjq\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.138574 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.138540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtvjq\" (UniqueName: \"kubernetes.io/projected/8a39377f-157d-4a36-980f-b444b881a05c-kube-api-access-rtvjq\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.138719 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.138599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a39377f-157d-4a36-980f-b444b881a05c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.138944 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.138924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a39377f-157d-4a36-980f-b444b881a05c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.149360 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.149330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtvjq\" (UniqueName: \"kubernetes.io/projected/8a39377f-157d-4a36-980f-b444b881a05c-kube-api-access-rtvjq\") pod \"cert-manager-operator-controller-manager-55c444bf86-8xdc2\" (UID: \"8a39377f-157d-4a36-980f-b444b881a05c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.258715 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.258656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" Jul 30 09:55:17.412351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:17.412326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2"] Jul 30 09:55:17.415300 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:17.415265 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a39377f_157d_4a36_980f_b444b881a05c.slice/crio-22c222701b06c9ac0e2d4a0acdf3d43a85afa1820d9a22daa4f315e2a3ce58d6 WatchSource:0}: Error finding container 22c222701b06c9ac0e2d4a0acdf3d43a85afa1820d9a22daa4f315e2a3ce58d6: Status 404 returned error can't find the container with id 22c222701b06c9ac0e2d4a0acdf3d43a85afa1820d9a22daa4f315e2a3ce58d6 Jul 30 09:55:18.278776 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:18.278739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" event={"ID":"8a39377f-157d-4a36-980f-b444b881a05c","Type":"ContainerStarted","Data":"22c222701b06c9ac0e2d4a0acdf3d43a85afa1820d9a22daa4f315e2a3ce58d6"} Jul 30 09:55:20.289564 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:20.289524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" event={"ID":"8a39377f-157d-4a36-980f-b444b881a05c","Type":"ContainerStarted","Data":"952f63ff1c14b1a625787c2d61bd5711ffbf57501c14743a81859ca31538e2c0"} Jul 30 09:55:20.312893 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:20.312844 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8xdc2" podStartSLOduration=2.037182204 podStartE2EDuration="4.312822726s" totalImagesPullingTime="2.275640522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:55:20.311699271 +0000 UTC m=+335.838126590" watchObservedRunningTime="2026-07-30 09:55:20.312822726 +0000 UTC m=+335.839250053" Jul 30 09:55:21.995861 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:21.995831 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58"] Jul 30 09:55:22.015749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.015722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58"] Jul 30 09:55:22.015901 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.015839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.018199 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.018180 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 09:55:22.018367 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.018351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6pz7\"" Jul 30 09:55:22.018813 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.018795 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 09:55:22.079403 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.079371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.079548 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.079405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgwk\" (UniqueName: \"kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.079548 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.079430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.180652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.180619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.180652 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.180652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgwk\" (UniqueName: \"kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.180920 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.180672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.181067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.181013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.181067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.181051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.189005 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.188983 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgwk\" (UniqueName: \"kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.325191 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.325108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:22.496052 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:22.496007 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58"] Jul 30 09:55:22.498775 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:22.498740 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c78f75d_68f4_4521_bfbc_d56b5031c545.slice/crio-6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa WatchSource:0}: Error finding container 6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa: Status 404 returned error can't find the container with id 6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa Jul 30 09:55:23.302594 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.302560 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerID="3534ae199671720a11118efaf9d9e9025e1e34e57de69b165c5b824165da9c9e" exitCode=0 Jul 30 09:55:23.302958 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.302616 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" event={"ID":"4c78f75d-68f4-4521-bfbc-d56b5031c545","Type":"ContainerDied","Data":"3534ae199671720a11118efaf9d9e9025e1e34e57de69b165c5b824165da9c9e"} Jul 30 09:55:23.302958 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.302664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" event={"ID":"4c78f75d-68f4-4521-bfbc-d56b5031c545","Type":"ContainerStarted","Data":"6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa"} Jul 30 09:55:23.497211 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.497131 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2"] Jul 30 09:55:23.499210 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.499193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.501368 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.501346 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 30 09:55:23.501484 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.501346 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 30 09:55:23.501484 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.501458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4pb9w\"" Jul 30 09:55:23.507825 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.507795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2"] Jul 30 09:55:23.591104 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.591071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.591276 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.591132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgmr6\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-kube-api-access-hgmr6\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.692404 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.692376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.692592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.692424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgmr6\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-kube-api-access-hgmr6\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.700591 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.700560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.700725 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.700714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgmr6\" (UniqueName: \"kubernetes.io/projected/d93b4224-d63b-4704-9b2d-582dc18f6ad5-kube-api-access-hgmr6\") pod \"cert-manager-cainjector-559cdd8c87-2c4x2\" (UID: \"d93b4224-d63b-4704-9b2d-582dc18f6ad5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.819128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.819024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" Jul 30 09:55:23.944612 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:23.944571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2"] Jul 30 09:55:23.947332 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:23.947308 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd93b4224_d63b_4704_9b2d_582dc18f6ad5.slice/crio-083282eaa1eaffd962a0699ca7536277f0584deb3cb0edd7fa4cdc3cb8a8af19 WatchSource:0}: Error finding container 083282eaa1eaffd962a0699ca7536277f0584deb3cb0edd7fa4cdc3cb8a8af19: Status 404 returned error can't find the container with id 083282eaa1eaffd962a0699ca7536277f0584deb3cb0edd7fa4cdc3cb8a8af19 Jul 30 09:55:24.309933 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:24.309894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" event={"ID":"d93b4224-d63b-4704-9b2d-582dc18f6ad5","Type":"ContainerStarted","Data":"083282eaa1eaffd962a0699ca7536277f0584deb3cb0edd7fa4cdc3cb8a8af19"} Jul 30 09:55:26.323133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:26.323102 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerID="6d3beee02debae31cc354c2e9f8d0c708735da379869dca3dd7531dfa95c7671" exitCode=0 Jul 30 09:55:26.323550 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:26.323189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" event={"ID":"4c78f75d-68f4-4521-bfbc-d56b5031c545","Type":"ContainerDied","Data":"6d3beee02debae31cc354c2e9f8d0c708735da379869dca3dd7531dfa95c7671"} Jul 30 09:55:27.215046 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.215001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mmbht"] Jul 30 09:55:27.217151 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.217134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.219066 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.219046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hxqbj\"" Jul 30 09:55:27.227851 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.227826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mmbht"] Jul 30 09:55:27.322088 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.322059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t59x\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-kube-api-access-2t59x\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.322088 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.322090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.329782 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.329760 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerID="62c7b661a2ed4eed2e416b0f0ff22df13e688076931ca1372467651a02f29f17" exitCode=0 Jul 30 09:55:27.330132 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.329846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" event={"ID":"4c78f75d-68f4-4521-bfbc-d56b5031c545","Type":"ContainerDied","Data":"62c7b661a2ed4eed2e416b0f0ff22df13e688076931ca1372467651a02f29f17"} Jul 30 09:55:27.331137 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.331115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" event={"ID":"d93b4224-d63b-4704-9b2d-582dc18f6ad5","Type":"ContainerStarted","Data":"7fb1e6ac9e09e8d0c2477f5d2c6367a593358109ffa9780644c7a329ee4fddcd"} Jul 30 09:55:27.359292 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.359244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2c4x2" podStartSLOduration=1.588816507 podStartE2EDuration="4.359227793s" totalImagesPullingTime="2.770411286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:55:27.358848386 +0000 UTC m=+342.885275705" watchObservedRunningTime="2026-07-30 09:55:27.359227793 +0000 UTC m=+342.885655121" Jul 30 09:55:27.423278 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.423246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t59x\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-kube-api-access-2t59x\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.423426 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.423289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.431281 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.431252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.431356 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.431325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t59x\" (UniqueName: \"kubernetes.io/projected/616a8d61-a2c7-4523-9076-6ec3ccb4682c-kube-api-access-2t59x\") pod \"cert-manager-webhook-6486ffd997-mmbht\" (UID: \"616a8d61-a2c7-4523-9076-6ec3ccb4682c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.525505 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.525427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:27.645252 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:27.645227 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mmbht"] Jul 30 09:55:27.647703 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:27.647674 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod616a8d61_a2c7_4523_9076_6ec3ccb4682c.slice/crio-597230b656d0056ab5cd5236a79f96fea5ff53834f1d82552aa0c9ddc3a2e427 WatchSource:0}: Error finding container 597230b656d0056ab5cd5236a79f96fea5ff53834f1d82552aa0c9ddc3a2e427: Status 404 returned error can't find the container with id 597230b656d0056ab5cd5236a79f96fea5ff53834f1d82552aa0c9ddc3a2e427 Jul 30 09:55:28.336867 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.336831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" event={"ID":"616a8d61-a2c7-4523-9076-6ec3ccb4682c","Type":"ContainerStarted","Data":"1de565e86bf47c0ecfad6175e3d0742457bad2662f3f82871e5732a3b40fa544"} Jul 30 09:55:28.336867 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.336870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" event={"ID":"616a8d61-a2c7-4523-9076-6ec3ccb4682c","Type":"ContainerStarted","Data":"597230b656d0056ab5cd5236a79f96fea5ff53834f1d82552aa0c9ddc3a2e427"} Jul 30 09:55:28.337371 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.337216 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:28.359814 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.359764 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" podStartSLOduration=1.359748046 podStartE2EDuration="1.359748046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:55:28.359430314 +0000 UTC m=+343.885857624" watchObservedRunningTime="2026-07-30 09:55:28.359748046 +0000 UTC m=+343.886175373" Jul 30 09:55:28.459198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.459176 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:28.533223 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.533190 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czgwk\" (UniqueName: \"kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk\") pod \"4c78f75d-68f4-4521-bfbc-d56b5031c545\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " Jul 30 09:55:28.533351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.533272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle\") pod \"4c78f75d-68f4-4521-bfbc-d56b5031c545\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " Jul 30 09:55:28.533351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.533323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util\") pod \"4c78f75d-68f4-4521-bfbc-d56b5031c545\" (UID: \"4c78f75d-68f4-4521-bfbc-d56b5031c545\") " Jul 30 09:55:28.533686 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.533663 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle" (OuterVolumeSpecName: "bundle") pod "4c78f75d-68f4-4521-bfbc-d56b5031c545" (UID: "4c78f75d-68f4-4521-bfbc-d56b5031c545"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:28.535190 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.535170 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk" (OuterVolumeSpecName: "kube-api-access-czgwk") pod "4c78f75d-68f4-4521-bfbc-d56b5031c545" (UID: "4c78f75d-68f4-4521-bfbc-d56b5031c545"). InnerVolumeSpecName "kube-api-access-czgwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:55:28.537812 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.537791 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util" (OuterVolumeSpecName: "util") pod "4c78f75d-68f4-4521-bfbc-d56b5031c545" (UID: "4c78f75d-68f4-4521-bfbc-d56b5031c545"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:28.634227 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.634200 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czgwk\" (UniqueName: \"kubernetes.io/projected/4c78f75d-68f4-4521-bfbc-d56b5031c545-kube-api-access-czgwk\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:28.634227 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.634227 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:28.634400 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:28.634236 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c78f75d-68f4-4521-bfbc-d56b5031c545-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:29.343063 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:29.342963 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" Jul 30 09:55:29.343063 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:29.342996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fs9h58" event={"ID":"4c78f75d-68f4-4521-bfbc-d56b5031c545","Type":"ContainerDied","Data":"6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa"} Jul 30 09:55:29.343063 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:29.343062 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b3ed285812175bf8e4719ac34c60c69d9dcdd870f98e64e11508c97c7c60baa" Jul 30 09:55:34.345544 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:34.345508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mmbht" Jul 30 09:55:41.054792 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.054710 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h8g6c"] Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.054975 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="util" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.054985 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="util" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.054994 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="pull" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.054999 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="pull" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.055006 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="extract" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.055011 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="extract" Jul 30 09:55:41.055182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.055089 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c78f75d-68f4-4521-bfbc-d56b5031c545" containerName="extract" Jul 30 09:55:41.057875 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.057859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.060075 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.060054 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lpbhw\"" Jul 30 09:55:41.068267 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.068231 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h8g6c"] Jul 30 09:55:41.237980 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.237945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-bound-sa-token\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.238240 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.238010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcq7x\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-kube-api-access-rcq7x\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.339319 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.339234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcq7x\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-kube-api-access-rcq7x\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.339319 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.339299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-bound-sa-token\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.349480 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.349441 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-bound-sa-token\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.349601 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.349519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcq7x\" (UniqueName: \"kubernetes.io/projected/16219ee4-aca6-4d1b-bc66-5792794b971b-kube-api-access-rcq7x\") pod \"cert-manager-55b4d954d5-h8g6c\" (UID: \"16219ee4-aca6-4d1b-bc66-5792794b971b\") " pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.367123 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.367082 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h8g6c" Jul 30 09:55:41.452667 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.452630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp"] Jul 30 09:55:41.456888 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.456868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.459117 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.459096 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6pz7\"" Jul 30 09:55:41.460001 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.459898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 09:55:41.460675 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.460240 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 09:55:41.462419 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.462391 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp"] Jul 30 09:55:41.497450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.497330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h8g6c"] Jul 30 09:55:41.499989 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:41.499958 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16219ee4_aca6_4d1b_bc66_5792794b971b.slice/crio-8ec19f5816e2259c0114b18c2410d4f09d0b077ab7f156c9faa2fd7368cfe20d WatchSource:0}: Error finding container 8ec19f5816e2259c0114b18c2410d4f09d0b077ab7f156c9faa2fd7368cfe20d: Status 404 returned error can't find the container with id 8ec19f5816e2259c0114b18c2410d4f09d0b077ab7f156c9faa2fd7368cfe20d Jul 30 09:55:41.642742 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.642708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.642914 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.642752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.642914 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.642851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz7dk\" (UniqueName: \"kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.743806 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.743773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.743984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.743832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz7dk\" (UniqueName: \"kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.743984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.743877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.744225 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.744205 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.744291 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.744270 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.752504 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.752477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz7dk\" (UniqueName: \"kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.769596 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.769563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:41.897189 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:41.897166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp"] Jul 30 09:55:41.899152 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:41.899128 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478b5fd5_8189_4ff0_b981_53fb4cf28a70.slice/crio-eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a WatchSource:0}: Error finding container eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a: Status 404 returned error can't find the container with id eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a Jul 30 09:55:42.399960 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.399928 2576 generic.go:356] "Generic (PLEG): container finished" podID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerID="b0b331b4ea5bf082dca44c7b2d236da4a749d95d8bbea3c295c3b7ea055ea20d" exitCode=0 Jul 30 09:55:42.400394 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.400017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" event={"ID":"478b5fd5-8189-4ff0-b981-53fb4cf28a70","Type":"ContainerDied","Data":"b0b331b4ea5bf082dca44c7b2d236da4a749d95d8bbea3c295c3b7ea055ea20d"} Jul 30 09:55:42.400394 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.400088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" event={"ID":"478b5fd5-8189-4ff0-b981-53fb4cf28a70","Type":"ContainerStarted","Data":"eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a"} Jul 30 09:55:42.401832 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.401812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h8g6c" event={"ID":"16219ee4-aca6-4d1b-bc66-5792794b971b","Type":"ContainerStarted","Data":"ac98e7b44d9bd35e64a4b593035f818c25cb730ffc72f4e05a16be63f7300224"} Jul 30 09:55:42.401911 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.401841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h8g6c" event={"ID":"16219ee4-aca6-4d1b-bc66-5792794b971b","Type":"ContainerStarted","Data":"8ec19f5816e2259c0114b18c2410d4f09d0b077ab7f156c9faa2fd7368cfe20d"} Jul 30 09:55:42.460292 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:42.460255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-h8g6c" podStartSLOduration=1.460243466 podStartE2EDuration="1.460243466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:55:42.459769589 +0000 UTC m=+357.986196918" watchObservedRunningTime="2026-07-30 09:55:42.460243466 +0000 UTC m=+357.986670793" Jul 30 09:55:43.407523 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:43.407493 2576 generic.go:356] "Generic (PLEG): container finished" podID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerID="ecaa7ab9b0428e397834506fe0fc81f03c040ce9df8bc63b98137996b862918f" exitCode=0 Jul 30 09:55:43.407867 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:43.407546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" event={"ID":"478b5fd5-8189-4ff0-b981-53fb4cf28a70","Type":"ContainerDied","Data":"ecaa7ab9b0428e397834506fe0fc81f03c040ce9df8bc63b98137996b862918f"} Jul 30 09:55:44.416841 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:44.416810 2576 generic.go:356] "Generic (PLEG): container finished" podID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerID="197da8bce9adeb31db0d70f7f5dfc5564e4c201d8cf2b6c6ccc88d09919a2fe8" exitCode=0 Jul 30 09:55:44.417225 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:44.416859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" event={"ID":"478b5fd5-8189-4ff0-b981-53fb4cf28a70","Type":"ContainerDied","Data":"197da8bce9adeb31db0d70f7f5dfc5564e4c201d8cf2b6c6ccc88d09919a2fe8"} Jul 30 09:55:45.544040 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.544001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:45.579138 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.579101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle\") pod \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " Jul 30 09:55:45.579327 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.579182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz7dk\" (UniqueName: \"kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk\") pod \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " Jul 30 09:55:45.579327 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.579236 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util\") pod \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\" (UID: \"478b5fd5-8189-4ff0-b981-53fb4cf28a70\") " Jul 30 09:55:45.579829 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.579801 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle" (OuterVolumeSpecName: "bundle") pod "478b5fd5-8189-4ff0-b981-53fb4cf28a70" (UID: "478b5fd5-8189-4ff0-b981-53fb4cf28a70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:45.581302 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.581269 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk" (OuterVolumeSpecName: "kube-api-access-lz7dk") pod "478b5fd5-8189-4ff0-b981-53fb4cf28a70" (UID: "478b5fd5-8189-4ff0-b981-53fb4cf28a70"). InnerVolumeSpecName "kube-api-access-lz7dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:55:45.585105 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.585069 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util" (OuterVolumeSpecName: "util") pod "478b5fd5-8189-4ff0-b981-53fb4cf28a70" (UID: "478b5fd5-8189-4ff0-b981-53fb4cf28a70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:55:45.679827 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.679720 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz7dk\" (UniqueName: \"kubernetes.io/projected/478b5fd5-8189-4ff0-b981-53fb4cf28a70-kube-api-access-lz7dk\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:45.679827 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.679769 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:45.679827 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:45.679779 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/478b5fd5-8189-4ff0-b981-53fb4cf28a70-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:55:46.427506 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:46.427476 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" Jul 30 09:55:46.427506 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:46.427482 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxg9xp" event={"ID":"478b5fd5-8189-4ff0-b981-53fb4cf28a70","Type":"ContainerDied","Data":"eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a"} Jul 30 09:55:46.427730 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:46.427527 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eca3a3c972da5b1ad972824745f86de3cc64915412c42dd6f604be6c85f4a23a" Jul 30 09:55:58.499374 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499339 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx"] Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499629 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="extract" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499640 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="extract" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499654 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="pull" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499659 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="pull" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499667 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="util" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499672 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="util" Jul 30 09:55:58.499760 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.499724 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="478b5fd5-8189-4ff0-b981-53fb4cf28a70" containerName="extract" Jul 30 09:55:58.505267 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.505248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.507695 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.507677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 30 09:55:58.507819 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.507796 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzz9n\"" Jul 30 09:55:58.508138 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.508120 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 30 09:55:58.508324 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.508310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 30 09:55:58.508438 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.508421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 30 09:55:58.529828 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.529804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx"] Jul 30 09:55:58.570410 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.570377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.570560 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.570446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.570560 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.570488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77fhk\" (UniqueName: \"kubernetes.io/projected/fa4ccb44-020c-441d-a0a3-03efdada283c-kube-api-access-77fhk\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.570560 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.570545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.570711 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.570587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671349 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77fhk\" (UniqueName: \"kubernetes.io/projected/fa4ccb44-020c-441d-a0a3-03efdada283c-kube-api-access-77fhk\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671349 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.671773 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.671752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-manifests\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.673820 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.673794 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4ccb44-020c-441d-a0a3-03efdada283c-tmp\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.673929 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.673856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.673988 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.673934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa4ccb44-020c-441d-a0a3-03efdada283c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.683389 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.683365 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77fhk\" (UniqueName: \"kubernetes.io/projected/fa4ccb44-020c-441d-a0a3-03efdada283c-kube-api-access-77fhk\") pod \"opendatahub-operator-controller-manager-5d74749788-ps7fx\" (UID: \"fa4ccb44-020c-441d-a0a3-03efdada283c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.815103 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.814998 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:55:58.943075 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:58.943042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx"] Jul 30 09:55:58.946000 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:55:58.945978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4ccb44_020c_441d_a0a3_03efdada283c.slice/crio-48bb1fc255322a417810362e83a873205ef1cf6682233ce823d1dcb2f4f2e8c8 WatchSource:0}: Error finding container 48bb1fc255322a417810362e83a873205ef1cf6682233ce823d1dcb2f4f2e8c8: Status 404 returned error can't find the container with id 48bb1fc255322a417810362e83a873205ef1cf6682233ce823d1dcb2f4f2e8c8 Jul 30 09:55:59.482693 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:55:59.482652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" event={"ID":"fa4ccb44-020c-441d-a0a3-03efdada283c","Type":"ContainerStarted","Data":"48bb1fc255322a417810362e83a873205ef1cf6682233ce823d1dcb2f4f2e8c8"} Jul 30 09:56:03.504731 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:03.504688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" event={"ID":"fa4ccb44-020c-441d-a0a3-03efdada283c","Type":"ContainerStarted","Data":"c4d3fced4535bdd62001757a01cd619f70b348b019389766557f1968ee12fd09"} Jul 30 09:56:04.510329 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:04.510288 2576 generic.go:356] "Generic (PLEG): container finished" podID="fa4ccb44-020c-441d-a0a3-03efdada283c" containerID="c4d3fced4535bdd62001757a01cd619f70b348b019389766557f1968ee12fd09" exitCode=0 Jul 30 09:56:04.510809 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:04.510355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" event={"ID":"fa4ccb44-020c-441d-a0a3-03efdada283c","Type":"ContainerDied","Data":"c4d3fced4535bdd62001757a01cd619f70b348b019389766557f1968ee12fd09"} Jul 30 09:56:06.522232 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:06.522190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" event={"ID":"fa4ccb44-020c-441d-a0a3-03efdada283c","Type":"ContainerStarted","Data":"4c6431455656584713f91083a242fa928f09a4e3e6eba8bd32a4ba84c2634667"} Jul 30 09:56:06.522626 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:06.522309 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:56:06.545251 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:06.545202 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" podStartSLOduration=3.032454598 podStartE2EDuration="8.545187686s" totalImagesPullingTime="4.484169404s" totalInitContainerRuntime="1.028563684s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:55:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:06.542854497 +0000 UTC m=+382.069281825" watchObservedRunningTime="2026-07-30 09:56:06.545187686 +0000 UTC m=+382.071615014" Jul 30 09:56:17.528527 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:17.528489 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d74749788-ps7fx" Jul 30 09:56:20.051458 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.051416 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn"] Jul 30 09:56:20.058413 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.058389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.060743 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.060722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 30 09:56:20.061670 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.061652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 30 09:56:20.062428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.062410 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 30 09:56:20.062428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.062419 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-87nl9\"" Jul 30 09:56:20.063308 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.063289 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 30 09:56:20.079430 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.079393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn"] Jul 30 09:56:20.150576 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.150540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.150955 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.150922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.151105 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.150973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbh89\" (UniqueName: \"kubernetes.io/projected/5ef80a82-be8c-40c0-9b15-da2e6ac976db-kube-api-access-xbh89\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.220828 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.220788 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bmft4"] Jul 30 09:56:20.224143 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.224123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.227052 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.227016 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m8kgq\"" Jul 30 09:56:20.228186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.228169 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 30 09:56:20.244801 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.244770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bmft4"] Jul 30 09:56:20.251928 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.251896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.252123 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.251940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.252123 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.251962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbh89\" (UniqueName: \"kubernetes.io/projected/5ef80a82-be8c-40c0-9b15-da2e6ac976db-kube-api-access-xbh89\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.254233 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.254210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tmp\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.254558 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.254536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ef80a82-be8c-40c0-9b15-da2e6ac976db-tls-certs\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.263363 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.263338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbh89\" (UniqueName: \"kubernetes.io/projected/5ef80a82-be8c-40c0-9b15-da2e6ac976db-kube-api-access-xbh89\") pod \"kube-auth-proxy-7d4fcfdb4d-sd6jn\" (UID: \"5ef80a82-be8c-40c0-9b15-da2e6ac976db\") " pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.352990 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.352954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92s6r\" (UniqueName: \"kubernetes.io/projected/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-kube-api-access-92s6r\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.353184 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.353015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.367798 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.367761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" Jul 30 09:56:20.454580 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.454549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92s6r\" (UniqueName: \"kubernetes.io/projected/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-kube-api-access-92s6r\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.454729 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.454615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.454792 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:56:20.454770 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 30 09:56:20.454860 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:56:20.454840 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert podName:fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae nodeName:}" failed. No retries permitted until 2026-07-30 09:56:20.954815452 +0000 UTC m=+396.481242778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert") pod "odh-model-controller-7998c67dc4-bmft4" (UID: "fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae") : secret "odh-model-controller-webhook-cert" not found Jul 30 09:56:20.468974 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.468938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92s6r\" (UniqueName: \"kubernetes.io/projected/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-kube-api-access-92s6r\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.511216 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.511188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn"] Jul 30 09:56:20.512902 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:56:20.512878 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef80a82_be8c_40c0_9b15_da2e6ac976db.slice/crio-659c55ba2cfc661fdb28e3c5da839e618436762eec7c7c984f955c67a834aafd WatchSource:0}: Error finding container 659c55ba2cfc661fdb28e3c5da839e618436762eec7c7c984f955c67a834aafd: Status 404 returned error can't find the container with id 659c55ba2cfc661fdb28e3c5da839e618436762eec7c7c984f955c67a834aafd Jul 30 09:56:20.584910 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.584870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" event={"ID":"5ef80a82-be8c-40c0-9b15-da2e6ac976db","Type":"ContainerStarted","Data":"659c55ba2cfc661fdb28e3c5da839e618436762eec7c7c984f955c67a834aafd"} Jul 30 09:56:20.958878 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.958838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:20.961271 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:20.961245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae-cert\") pod \"odh-model-controller-7998c67dc4-bmft4\" (UID: \"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae\") " pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:21.134483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.134441 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:21.291290 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.291253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bmft4"] Jul 30 09:56:21.295080 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:56:21.295050 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabfeda4_f2f2_4e27_84c3_b6ed3592e9ae.slice/crio-4aa6bc7b8def66ae583ebcd01c5be590f328bb0ae57af06e90770c62efa5244b WatchSource:0}: Error finding container 4aa6bc7b8def66ae583ebcd01c5be590f328bb0ae57af06e90770c62efa5244b: Status 404 returned error can't find the container with id 4aa6bc7b8def66ae583ebcd01c5be590f328bb0ae57af06e90770c62efa5244b Jul 30 09:56:21.375571 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.375538 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:21.378973 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.378955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.381255 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.381232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 30 09:56:21.381490 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.381473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 30 09:56:21.381794 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.381777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c56bm\"" Jul 30 09:56:21.381967 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.381953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 30 09:56:21.382412 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.382398 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 30 09:56:21.401905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.401873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:21.464162 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464162 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kbz\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.464383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.464348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565659 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565659 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kbz\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.565904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.566142 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.565968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.566698 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.566675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.568020 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.567999 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.568213 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.568194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.568438 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.568424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.568555 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.568537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.573276 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.573257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kbz\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.573377 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.573356 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-th7xh\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.590047 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.590002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" event={"ID":"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae","Type":"ContainerStarted","Data":"4aa6bc7b8def66ae583ebcd01c5be590f328bb0ae57af06e90770c62efa5244b"} Jul 30 09:56:21.688225 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.688193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:21.828980 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:21.828947 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:21.831931 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:56:21.831897 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc5a3a2_751c_41e8_82e8_f8d755731b99.slice/crio-182210b26829e76b31c49fa510939a83ed3f4316aea2d58547490b10ed74736f WatchSource:0}: Error finding container 182210b26829e76b31c49fa510939a83ed3f4316aea2d58547490b10ed74736f: Status 404 returned error can't find the container with id 182210b26829e76b31c49fa510939a83ed3f4316aea2d58547490b10ed74736f Jul 30 09:56:22.606209 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:22.606169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" event={"ID":"dbc5a3a2-751c-41e8-82e8-f8d755731b99","Type":"ContainerStarted","Data":"182210b26829e76b31c49fa510939a83ed3f4316aea2d58547490b10ed74736f"} Jul 30 09:56:25.625427 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:25.625385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" event={"ID":"fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae","Type":"ContainerStarted","Data":"cf3e92b22b3e5b5ba1c19ae7f6b357c55149c8a0b85ab96755566e6cc57e0c53"} Jul 30 09:56:25.625940 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:25.625569 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:25.627358 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:25.627328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" event={"ID":"5ef80a82-be8c-40c0-9b15-da2e6ac976db","Type":"ContainerStarted","Data":"ca57ee5c1f9b81c98022e585618ebc42f12d18956b2ce16868e6e7a5675561c4"} Jul 30 09:56:25.642440 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:25.642378 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" podStartSLOduration=2.248758038 podStartE2EDuration="5.642361773s" totalImagesPullingTime="3.393603735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:25.639691011 +0000 UTC m=+401.166118341" watchObservedRunningTime="2026-07-30 09:56:25.642361773 +0000 UTC m=+401.168789102" Jul 30 09:56:25.656280 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:25.656228 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d4fcfdb4d-sd6jn" podStartSLOduration=1.485186674 podStartE2EDuration="5.656210942s" totalImagesPullingTime="4.171024268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:25.654080798 +0000 UTC m=+401.180508135" watchObservedRunningTime="2026-07-30 09:56:25.656210942 +0000 UTC m=+401.182638498" Jul 30 09:56:26.011044 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:26.010990 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:26.011172 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:26.011086 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:26.632717 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:26.632668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" event={"ID":"dbc5a3a2-751c-41e8-82e8-f8d755731b99","Type":"ContainerStarted","Data":"6c6e2c9787f366da8f68c81eba5821c4ff703881f5c59b146dbbfb8c67c57581"} Jul 30 09:56:26.658417 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:26.658370 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" podStartSLOduration=1.481576272 podStartE2EDuration="5.65835427s" totalImagesPullingTime="4.176777998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:26.657087852 +0000 UTC m=+402.183515194" watchObservedRunningTime="2026-07-30 09:56:26.65835427 +0000 UTC m=+402.184781589" Jul 30 09:56:27.637106 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:27.637080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:27.638799 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:27.638771 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-th7xh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 09:56:27.638908 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:27.638820 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 09:56:28.211836 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.211796 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm"] Jul 30 09:56:28.215229 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.215206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.218018 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.217993 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xm4f9\"" Jul 30 09:56:28.232265 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.232240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9"] Jul 30 09:56:28.235499 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.235479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm"] Jul 30 09:56:28.235604 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.235579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.251358 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.251335 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9"] Jul 30 09:56:28.329312 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gz4g\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-kube-api-access-2gz4g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8tt\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-kube-api-access-kk8tt\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329598 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.329770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4814d9fe-ca93-4e23-b370-fddd3a9036de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.329770 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.329742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430393 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4814d9fe-ca93-4e23-b370-fddd3a9036de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gz4g\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-kube-api-access-2gz4g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8tt\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-kube-api-access-kk8tt\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.430772 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.431178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.431178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.431178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.430867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.431817 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.431776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.431949 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.431814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.431949 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.431842 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.432440 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.432391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4814d9fe-ca93-4e23-b370-fddd3a9036de-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.432440 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.432430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.432623 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.432600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.433416 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.433390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.433538 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.433417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.433538 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.433402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.433657 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.433536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.434007 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.433984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.434521 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.434503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.441926 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.441902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gz4g\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-kube-api-access-2gz4g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.442098 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.441984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.442267 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.442250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4814d9fe-ca93-4e23-b370-fddd3a9036de-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm\" (UID: \"4814d9fe-ca93-4e23-b370-fddd3a9036de\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.442792 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.442771 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8tt\" (UniqueName: \"kubernetes.io/projected/68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba-kube-api-access-kk8tt\") pod \"istiod-openshift-gateway-5677ccb49b-qfnr9\" (UID: \"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.527341 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.527266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:28.544242 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.544219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:28.644472 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.644445 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:28.702405 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.702372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm"] Jul 30 09:56:28.717214 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:56:28.717188 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4814d9fe_ca93_4e23_b370_fddd3a9036de.slice/crio-1c7268ee2ec83b1700c1ba1dc0f11b22bc818e542ce35942dda826a6f726dda1 WatchSource:0}: Error finding container 1c7268ee2ec83b1700c1ba1dc0f11b22bc818e542ce35942dda826a6f726dda1: Status 404 returned error can't find the container with id 1c7268ee2ec83b1700c1ba1dc0f11b22bc818e542ce35942dda826a6f726dda1 Jul 30 09:56:28.745941 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.745921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9"] Jul 30 09:56:28.747471 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:56:28.747449 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fcdf9e_5cf3_4c6f_a1fd_a2e4340b39ba.slice/crio-0bad26dd17e4b33daea90ee23fad3b3974d1952e46bfeb2e1a83d7b9de8d72f2 WatchSource:0}: Error finding container 0bad26dd17e4b33daea90ee23fad3b3974d1952e46bfeb2e1a83d7b9de8d72f2: Status 404 returned error can't find the container with id 0bad26dd17e4b33daea90ee23fad3b3974d1952e46bfeb2e1a83d7b9de8d72f2 Jul 30 09:56:28.750257 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.750229 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:28.750352 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:28.750285 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:29.648587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.648548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" event={"ID":"4814d9fe-ca93-4e23-b370-fddd3a9036de","Type":"ContainerStarted","Data":"1c7268ee2ec83b1700c1ba1dc0f11b22bc818e542ce35942dda826a6f726dda1"} Jul 30 09:56:29.650017 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.649986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" event={"ID":"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba","Type":"ContainerStarted","Data":"558f5134c56a1d2ce365ff4bf30514552e7387e268e03424c438210e94bacb95"} Jul 30 09:56:29.650149 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.650046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" event={"ID":"68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba","Type":"ContainerStarted","Data":"0bad26dd17e4b33daea90ee23fad3b3974d1952e46bfeb2e1a83d7b9de8d72f2"} Jul 30 09:56:29.650205 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.650191 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:29.651874 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.651857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" Jul 30 09:56:29.674244 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.674193 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qfnr9" podStartSLOduration=1.674176383 podStartE2EDuration="1.674176383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:29.67194127 +0000 UTC m=+405.198368610" watchObservedRunningTime="2026-07-30 09:56:29.674176383 +0000 UTC m=+405.200603710" Jul 30 09:56:29.747730 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:29.747693 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:30.656422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:30.656382 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" containerID="cri-o://6c6e2c9787f366da8f68c81eba5821c4ff703881f5c59b146dbbfb8c67c57581" gracePeriod=30 Jul 30 09:56:31.664270 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.664224 2576 generic.go:356] "Generic (PLEG): container finished" podID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerID="6c6e2c9787f366da8f68c81eba5821c4ff703881f5c59b146dbbfb8c67c57581" exitCode=0 Jul 30 09:56:31.664637 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.664283 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" event={"ID":"dbc5a3a2-751c-41e8-82e8-f8d755731b99","Type":"ContainerDied","Data":"6c6e2c9787f366da8f68c81eba5821c4ff703881f5c59b146dbbfb8c67c57581"} Jul 30 09:56:31.841593 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.841564 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:31.890592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.890557 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:31.890696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.890626 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:31.890696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.890655 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:56:31.965677 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965646 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.965837 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965692 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.965837 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965737 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.965837 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.966010 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965919 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.966010 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.966010 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.965986 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9kbz\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz\") pod \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\" (UID: \"dbc5a3a2-751c-41e8-82e8-f8d755731b99\") " Jul 30 09:56:31.966224 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.966196 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:56:31.968545 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968514 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:56:31.968690 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968659 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:56:31.968750 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968710 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz" (OuterVolumeSpecName: "kube-api-access-c9kbz") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "kube-api-access-c9kbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:56:31.968882 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968856 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts" (OuterVolumeSpecName: "cacerts") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:56:31.968984 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968945 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:56:31.969062 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:31.968980 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs" (OuterVolumeSpecName: "local-certs") pod "dbc5a3a2-751c-41e8-82e8-f8d755731b99" (UID: "dbc5a3a2-751c-41e8-82e8-f8d755731b99"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067852 2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-cacerts\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067887 2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc5a3a2-751c-41e8-82e8-f8d755731b99-local-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067901 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9kbz\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-kube-api-access-c9kbz\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067917 2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-kubeconfig\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067932 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-ca-configmap\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067947 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-csr-dns-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.068126 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.067961 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc5a3a2-751c-41e8-82e8-f8d755731b99-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:56:32.670169 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.670131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" event={"ID":"4814d9fe-ca93-4e23-b370-fddd3a9036de","Type":"ContainerStarted","Data":"c2b525ae5ed26aa1736059ff7546a5ac397a637e0c7f421dd150b649532ebb79"} Jul 30 09:56:32.671397 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.671375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" event={"ID":"dbc5a3a2-751c-41e8-82e8-f8d755731b99","Type":"ContainerDied","Data":"182210b26829e76b31c49fa510939a83ed3f4316aea2d58547490b10ed74736f"} Jul 30 09:56:32.671397 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.671395 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" Jul 30 09:56:32.671545 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.671425 2576 scope.go:117] "RemoveContainer" containerID="6c6e2c9787f366da8f68c81eba5821c4ff703881f5c59b146dbbfb8c67c57581" Jul 30 09:56:32.708873 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.708811 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" podStartSLOduration=1.537925903 podStartE2EDuration="4.708795996s" totalImagesPullingTime="3.170870093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:56:32.707110446 +0000 UTC m=+408.233537774" watchObservedRunningTime="2026-07-30 09:56:32.708795996 +0000 UTC m=+408.235223335" Jul 30 09:56:32.721279 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.721248 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:32.725567 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.725539 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh"] Jul 30 09:56:32.929289 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:32.929209 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" path="/var/lib/kubelet/pods/dbc5a3a2-751c-41e8-82e8-f8d755731b99/volumes" Jul 30 09:56:33.527978 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:33.527943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:33.532616 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:33.532591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:33.677121 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:33.677095 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:33.678128 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:33.678112 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm" Jul 30 09:56:36.635417 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:36.635379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bmft4" Jul 30 09:56:36.644674 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:36.644648 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-th7xh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 30 09:56:36.644794 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:56:36.644701 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-th7xh" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.28:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 30 09:57:21.096468 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.096379 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:21.097824 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.097802 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" Jul 30 09:57:21.097972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.097962 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" Jul 30 09:57:21.098213 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.098201 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc5a3a2-751c-41e8-82e8-f8d755731b99" containerName="discovery" Jul 30 09:57:21.100537 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.100519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:21.104608 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.104584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 09:57:21.104869 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.104584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 09:57:21.109315 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.109294 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-g49nr\"" Jul 30 09:57:21.112811 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.112774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:21.189331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.189289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjpw5\" (UniqueName: \"kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5\") pod \"kuadrant-operator-catalog-qzght\" (UID: \"da6d878e-ddb6-4031-aa7c-dadd3340bd34\") " pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:21.290043 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.289999 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjpw5\" (UniqueName: \"kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5\") pod \"kuadrant-operator-catalog-qzght\" (UID: \"da6d878e-ddb6-4031-aa7c-dadd3340bd34\") " pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:21.303655 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.303625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjpw5\" (UniqueName: \"kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5\") pod \"kuadrant-operator-catalog-qzght\" (UID: \"da6d878e-ddb6-4031-aa7c-dadd3340bd34\") " pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:21.420736 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.420696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:21.451808 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.451773 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:21.555369 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.555342 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:21.557848 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:21.557822 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6d878e_ddb6_4031_aa7c_dadd3340bd34.slice/crio-c6ed1358470cf9e1296670129d65081cb0667637ad9514b36693eefd79195cd1 WatchSource:0}: Error finding container c6ed1358470cf9e1296670129d65081cb0667637ad9514b36693eefd79195cd1: Status 404 returned error can't find the container with id c6ed1358470cf9e1296670129d65081cb0667637ad9514b36693eefd79195cd1 Jul 30 09:57:21.661804 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.661769 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d7h9q"] Jul 30 09:57:21.664582 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.664567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:21.672208 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.672165 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d7h9q"] Jul 30 09:57:21.793439 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.793398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dplw\" (UniqueName: \"kubernetes.io/projected/5898e86e-a1ef-409e-8075-a733b9ce3873-kube-api-access-9dplw\") pod \"kuadrant-operator-catalog-d7h9q\" (UID: \"5898e86e-a1ef-409e-8075-a733b9ce3873\") " pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:21.894277 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.894245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dplw\" (UniqueName: \"kubernetes.io/projected/5898e86e-a1ef-409e-8075-a733b9ce3873-kube-api-access-9dplw\") pod \"kuadrant-operator-catalog-d7h9q\" (UID: \"5898e86e-a1ef-409e-8075-a733b9ce3873\") " pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:21.895241 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.895214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qzght" event={"ID":"da6d878e-ddb6-4031-aa7c-dadd3340bd34","Type":"ContainerStarted","Data":"c6ed1358470cf9e1296670129d65081cb0667637ad9514b36693eefd79195cd1"} Jul 30 09:57:21.902615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.902594 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dplw\" (UniqueName: \"kubernetes.io/projected/5898e86e-a1ef-409e-8075-a733b9ce3873-kube-api-access-9dplw\") pod \"kuadrant-operator-catalog-d7h9q\" (UID: \"5898e86e-a1ef-409e-8075-a733b9ce3873\") " pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:21.975918 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:21.975826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:22.106932 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:22.106903 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d7h9q"] Jul 30 09:57:22.135213 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:22.135177 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5898e86e_a1ef_409e_8075_a733b9ce3873.slice/crio-476fb16bd3b3afc96cfd73897b0599e484502db61eedc6c616a1274c50aa64c7 WatchSource:0}: Error finding container 476fb16bd3b3afc96cfd73897b0599e484502db61eedc6c616a1274c50aa64c7: Status 404 returned error can't find the container with id 476fb16bd3b3afc96cfd73897b0599e484502db61eedc6c616a1274c50aa64c7 Jul 30 09:57:22.902663 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:22.902622 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" event={"ID":"5898e86e-a1ef-409e-8075-a733b9ce3873","Type":"ContainerStarted","Data":"476fb16bd3b3afc96cfd73897b0599e484502db61eedc6c616a1274c50aa64c7"} Jul 30 09:57:23.908929 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:23.908885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qzght" event={"ID":"da6d878e-ddb6-4031-aa7c-dadd3340bd34","Type":"ContainerStarted","Data":"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6"} Jul 30 09:57:23.909352 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:23.908904 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qzght" podUID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" containerName="registry-server" containerID="cri-o://2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6" gracePeriod=2 Jul 30 09:57:23.923884 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:23.923829 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qzght" podStartSLOduration=0.89541574 podStartE2EDuration="2.923809444s" totalImagesPullingTime="2.028393704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:57:23.923802761 +0000 UTC m=+459.450230093" watchObservedRunningTime="2026-07-30 09:57:23.923809444 +0000 UTC m=+459.450236773" Jul 30 09:57:24.158815 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.158794 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:24.319498 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.319455 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjpw5\" (UniqueName: \"kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5\") pod \"da6d878e-ddb6-4031-aa7c-dadd3340bd34\" (UID: \"da6d878e-ddb6-4031-aa7c-dadd3340bd34\") " Jul 30 09:57:24.321393 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.321368 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5" (OuterVolumeSpecName: "kube-api-access-sjpw5") pod "da6d878e-ddb6-4031-aa7c-dadd3340bd34" (UID: "da6d878e-ddb6-4031-aa7c-dadd3340bd34"). InnerVolumeSpecName "kube-api-access-sjpw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:57:24.421024 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.420990 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjpw5\" (UniqueName: \"kubernetes.io/projected/da6d878e-ddb6-4031-aa7c-dadd3340bd34-kube-api-access-sjpw5\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:24.915250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.915152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" event={"ID":"5898e86e-a1ef-409e-8075-a733b9ce3873","Type":"ContainerStarted","Data":"c67af7b57fd57be9bba8259ac046ae34e4036509d3d6eb8e1f5cc0ed9d698f39"} Jul 30 09:57:24.916313 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.916286 2576 generic.go:356] "Generic (PLEG): container finished" podID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" containerID="2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6" exitCode=0 Jul 30 09:57:24.916422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.916317 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qzght" Jul 30 09:57:24.916422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.916364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qzght" event={"ID":"da6d878e-ddb6-4031-aa7c-dadd3340bd34","Type":"ContainerDied","Data":"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6"} Jul 30 09:57:24.916422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.916409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qzght" event={"ID":"da6d878e-ddb6-4031-aa7c-dadd3340bd34","Type":"ContainerDied","Data":"c6ed1358470cf9e1296670129d65081cb0667637ad9514b36693eefd79195cd1"} Jul 30 09:57:24.916525 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.916432 2576 scope.go:117] "RemoveContainer" containerID="2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6" Jul 30 09:57:24.931516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.931432 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" podStartSLOduration=1.80937142 podStartE2EDuration="3.931414686s" totalImagesPullingTime="2.122043266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:57:24.929707249 +0000 UTC m=+460.456134599" watchObservedRunningTime="2026-07-30 09:57:24.931414686 +0000 UTC m=+460.457842015" Jul 30 09:57:24.932500 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.932480 2576 scope.go:117] "RemoveContainer" containerID="2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6" Jul 30 09:57:24.932788 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:57:24.932764 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6\": container with ID starting with 2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6 not found: ID does not exist" containerID="2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6" Jul 30 09:57:24.932880 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.932795 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6"} err="failed to get container status \"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6\": rpc error: code = NotFound desc = could not find container \"2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6\": container with ID starting with 2021e4f8e9078b70ad53433798f195e2018fdaa0f87564139de1385a53cd1eb6 not found: ID does not exist" Jul 30 09:57:24.945331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.945299 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:24.949973 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:24.949943 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qzght"] Jul 30 09:57:26.929072 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:26.929022 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" path="/var/lib/kubelet/pods/da6d878e-ddb6-4031-aa7c-dadd3340bd34/volumes" Jul 30 09:57:31.976220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:31.976176 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:31.976664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:31.976247 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:31.998474 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:31.998447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:32.974835 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:32.974809 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-d7h9q" Jul 30 09:57:36.871246 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.871206 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq"] Jul 30 09:57:36.871653 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.871604 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" containerName="registry-server" Jul 30 09:57:36.871653 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.871621 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" containerName="registry-server" Jul 30 09:57:36.871726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.871696 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6d878e-ddb6-4031-aa7c-dadd3340bd34" containerName="registry-server" Jul 30 09:57:36.876411 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.876392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:36.878533 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.878514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgwcl\"" Jul 30 09:57:36.882570 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.882520 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq"] Jul 30 09:57:36.929306 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.929269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bx2w\" (UniqueName: \"kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:36.929509 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.929320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:36.929509 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:36.929448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.030587 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.030546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.030764 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.030616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.030764 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.030656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bx2w\" (UniqueName: \"kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.030962 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.030938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.031003 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.030972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.038509 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.038482 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bx2w\" (UniqueName: \"kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.187109 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.187017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:37.319186 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.318984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq"] Jul 30 09:57:37.321948 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:37.321923 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589dc390_65fe_4175_9fca_7ebc4ee654d1.slice/crio-2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843 WatchSource:0}: Error finding container 2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843: Status 404 returned error can't find the container with id 2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843 Jul 30 09:57:37.470826 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.470752 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q"] Jul 30 09:57:37.474252 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.474236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.482567 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.482542 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q"] Jul 30 09:57:37.534348 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.534304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.534508 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.534356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc6sj\" (UniqueName: \"kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.534508 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.534444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.635575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.635539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.635575 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.635578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc6sj\" (UniqueName: \"kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.635790 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.635647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.636002 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.635981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.636076 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.635996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.642844 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.642824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc6sj\" (UniqueName: \"kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.804968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.804894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:37.869488 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.869453 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft"] Jul 30 09:57:37.873968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.873951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:37.879548 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.879521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft"] Jul 30 09:57:37.937318 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.937294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q"] Jul 30 09:57:37.938940 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.938912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:37.939116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.938953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24jxd\" (UniqueName: \"kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:37.939116 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.939023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:37.941839 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:37.941756 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf12fb7_badf_40d3_a1eb_a4feacbf7f8c.slice/crio-3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5 WatchSource:0}: Error finding container 3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5: Status 404 returned error can't find the container with id 3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5 Jul 30 09:57:37.979370 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.979341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" event={"ID":"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c","Type":"ContainerStarted","Data":"3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5"} Jul 30 09:57:37.981059 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.981021 2576 generic.go:356] "Generic (PLEG): container finished" podID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerID="605455a4120fff2d7d46b65833cd93c1017ba2aba8183d201ad2699f754cc96e" exitCode=0 Jul 30 09:57:37.981182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.981070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" event={"ID":"589dc390-65fe-4175-9fca-7ebc4ee654d1","Type":"ContainerDied","Data":"605455a4120fff2d7d46b65833cd93c1017ba2aba8183d201ad2699f754cc96e"} Jul 30 09:57:37.981182 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:37.981138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" event={"ID":"589dc390-65fe-4175-9fca-7ebc4ee654d1","Type":"ContainerStarted","Data":"2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843"} Jul 30 09:57:38.040243 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.040218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.040465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.040249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24jxd\" (UniqueName: \"kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.040465 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.040269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.040646 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.040627 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.040698 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.040648 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.047593 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.047571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24jxd\" (UniqueName: \"kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.186200 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.186166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:38.277902 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.277873 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh"] Jul 30 09:57:38.281596 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.281578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.289588 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.289546 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh"] Jul 30 09:57:38.318178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.318156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft"] Jul 30 09:57:38.320209 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:38.320183 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f1e662_07bd_4ebc_9e51_40f299103af9.slice/crio-de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f WatchSource:0}: Error finding container de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f: Status 404 returned error can't find the container with id de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f Jul 30 09:57:38.343880 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.343852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45cr\" (UniqueName: \"kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.343969 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.343903 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.344009 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.343970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.444996 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.444963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45cr\" (UniqueName: \"kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.445133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.445045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.445133 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.445096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.445428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.445407 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.445473 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.445449 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.452815 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.452796 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45cr\" (UniqueName: \"kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.594254 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.594217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:38.725900 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.725865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh"] Jul 30 09:57:38.759616 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:38.759577 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102b57e3_c586_4198_b4cf_5fc41d6b13b4.slice/crio-d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849 WatchSource:0}: Error finding container d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849: Status 404 returned error can't find the container with id d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849 Jul 30 09:57:38.987627 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.987598 2576 generic.go:356] "Generic (PLEG): container finished" podID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerID="1326d455fa32ba09e5135ab75ed5b018e52d2f26efc0ce42ea7c8f938c3cd0d2" exitCode=0 Jul 30 09:57:38.988013 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.987680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" event={"ID":"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c","Type":"ContainerDied","Data":"1326d455fa32ba09e5135ab75ed5b018e52d2f26efc0ce42ea7c8f938c3cd0d2"} Jul 30 09:57:38.989565 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.989540 2576 generic.go:356] "Generic (PLEG): container finished" podID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerID="31e2cb4d9effd433f80ffd0578929ae81c65180a7fedd733cbdf60f42643bb56" exitCode=0 Jul 30 09:57:38.989643 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.989608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" event={"ID":"589dc390-65fe-4175-9fca-7ebc4ee654d1","Type":"ContainerDied","Data":"31e2cb4d9effd433f80ffd0578929ae81c65180a7fedd733cbdf60f42643bb56"} Jul 30 09:57:38.991500 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.991481 2576 generic.go:356] "Generic (PLEG): container finished" podID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerID="8ebece82872e463dd8ef2278b2b8cec3fc4bd299ba20ca3a7b4700682660733c" exitCode=0 Jul 30 09:57:38.991586 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.991568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" event={"ID":"09f1e662-07bd-4ebc-9e51-40f299103af9","Type":"ContainerDied","Data":"8ebece82872e463dd8ef2278b2b8cec3fc4bd299ba20ca3a7b4700682660733c"} Jul 30 09:57:38.991639 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.991607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" event={"ID":"09f1e662-07bd-4ebc-9e51-40f299103af9","Type":"ContainerStarted","Data":"de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f"} Jul 30 09:57:38.993109 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.993088 2576 generic.go:356] "Generic (PLEG): container finished" podID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerID="6797d87cf30b2b503fd1e286ace89bd038b8ffd4935dd40554514736a45307f7" exitCode=0 Jul 30 09:57:38.993202 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.993142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" event={"ID":"102b57e3-c586-4198-b4cf-5fc41d6b13b4","Type":"ContainerDied","Data":"6797d87cf30b2b503fd1e286ace89bd038b8ffd4935dd40554514736a45307f7"} Jul 30 09:57:38.993202 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:38.993191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" event={"ID":"102b57e3-c586-4198-b4cf-5fc41d6b13b4","Type":"ContainerStarted","Data":"d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849"} Jul 30 09:57:40.000983 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.000945 2576 generic.go:356] "Generic (PLEG): container finished" podID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerID="bcf312e38f3c4089152e5f059fb09563915a246aeb3c369b1f1a56e73afc5f0d" exitCode=0 Jul 30 09:57:40.001538 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.001054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" event={"ID":"09f1e662-07bd-4ebc-9e51-40f299103af9","Type":"ContainerDied","Data":"bcf312e38f3c4089152e5f059fb09563915a246aeb3c369b1f1a56e73afc5f0d"} Jul 30 09:57:40.003066 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.002993 2576 generic.go:356] "Generic (PLEG): container finished" podID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerID="8a435dc881524ab1215f67d0c36232ee30919c16ce0fa96b782b441fbea40bd6" exitCode=0 Jul 30 09:57:40.003201 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.003066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" event={"ID":"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c","Type":"ContainerDied","Data":"8a435dc881524ab1215f67d0c36232ee30919c16ce0fa96b782b441fbea40bd6"} Jul 30 09:57:40.005592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.005569 2576 generic.go:356] "Generic (PLEG): container finished" podID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerID="c112a9d4260678124080b2cd9f627e40050df1754560df35edcfbe83ba137419" exitCode=0 Jul 30 09:57:40.005687 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:40.005604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" event={"ID":"589dc390-65fe-4175-9fca-7ebc4ee654d1","Type":"ContainerDied","Data":"c112a9d4260678124080b2cd9f627e40050df1754560df35edcfbe83ba137419"} Jul 30 09:57:41.012625 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.012586 2576 generic.go:356] "Generic (PLEG): container finished" podID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerID="e25133b57f0763f2d3e35510606611dde6e44c00236a4618f48b9c14dd6dfbe3" exitCode=0 Jul 30 09:57:41.013075 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.012671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" event={"ID":"09f1e662-07bd-4ebc-9e51-40f299103af9","Type":"ContainerDied","Data":"e25133b57f0763f2d3e35510606611dde6e44c00236a4618f48b9c14dd6dfbe3"} Jul 30 09:57:41.014765 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.014741 2576 generic.go:356] "Generic (PLEG): container finished" podID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerID="1a41220227fbe9ea86166765b166e2dd8f15503d9530a1a07b3c3bf269ebd855" exitCode=0 Jul 30 09:57:41.014862 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.014821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" event={"ID":"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c","Type":"ContainerDied","Data":"1a41220227fbe9ea86166765b166e2dd8f15503d9530a1a07b3c3bf269ebd855"} Jul 30 09:57:41.153835 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.153802 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:41.172181 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.172153 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle\") pod \"589dc390-65fe-4175-9fca-7ebc4ee654d1\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " Jul 30 09:57:41.172373 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.172291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bx2w\" (UniqueName: \"kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w\") pod \"589dc390-65fe-4175-9fca-7ebc4ee654d1\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " Jul 30 09:57:41.172373 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.172327 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util\") pod \"589dc390-65fe-4175-9fca-7ebc4ee654d1\" (UID: \"589dc390-65fe-4175-9fca-7ebc4ee654d1\") " Jul 30 09:57:41.172850 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.172804 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle" (OuterVolumeSpecName: "bundle") pod "589dc390-65fe-4175-9fca-7ebc4ee654d1" (UID: "589dc390-65fe-4175-9fca-7ebc4ee654d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:41.175022 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.174990 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w" (OuterVolumeSpecName: "kube-api-access-6bx2w") pod "589dc390-65fe-4175-9fca-7ebc4ee654d1" (UID: "589dc390-65fe-4175-9fca-7ebc4ee654d1"). InnerVolumeSpecName "kube-api-access-6bx2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:57:41.178953 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.178924 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util" (OuterVolumeSpecName: "util") pod "589dc390-65fe-4175-9fca-7ebc4ee654d1" (UID: "589dc390-65fe-4175-9fca-7ebc4ee654d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:41.273669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.273576 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bx2w\" (UniqueName: \"kubernetes.io/projected/589dc390-65fe-4175-9fca-7ebc4ee654d1-kube-api-access-6bx2w\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:41.273669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.273607 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:41.273669 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:41.273618 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dc390-65fe-4175-9fca-7ebc4ee654d1-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.026711 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.026677 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" Jul 30 09:57:42.026711 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.026688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq" event={"ID":"589dc390-65fe-4175-9fca-7ebc4ee654d1","Type":"ContainerDied","Data":"2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843"} Jul 30 09:57:42.027212 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.026756 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2259fff91cb6908848e4427bf18ddf4b6db1ef530bef21d76a485b4d470a7843" Jul 30 09:57:42.156554 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.156533 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:42.179225 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.179200 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:42.181629 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.181605 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle\") pod \"09f1e662-07bd-4ebc-9e51-40f299103af9\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " Jul 30 09:57:42.181749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.181687 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24jxd\" (UniqueName: \"kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd\") pod \"09f1e662-07bd-4ebc-9e51-40f299103af9\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " Jul 30 09:57:42.181749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.181718 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util\") pod \"09f1e662-07bd-4ebc-9e51-40f299103af9\" (UID: \"09f1e662-07bd-4ebc-9e51-40f299103af9\") " Jul 30 09:57:42.182221 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.182188 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle" (OuterVolumeSpecName: "bundle") pod "09f1e662-07bd-4ebc-9e51-40f299103af9" (UID: "09f1e662-07bd-4ebc-9e51-40f299103af9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:42.183902 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.183870 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd" (OuterVolumeSpecName: "kube-api-access-24jxd") pod "09f1e662-07bd-4ebc-9e51-40f299103af9" (UID: "09f1e662-07bd-4ebc-9e51-40f299103af9"). InnerVolumeSpecName "kube-api-access-24jxd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:57:42.187105 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.187073 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util" (OuterVolumeSpecName: "util") pod "09f1e662-07bd-4ebc-9e51-40f299103af9" (UID: "09f1e662-07bd-4ebc-9e51-40f299103af9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:42.282269 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282189 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle\") pod \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " Jul 30 09:57:42.282269 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282229 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util\") pod \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " Jul 30 09:57:42.282466 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282288 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc6sj\" (UniqueName: \"kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj\") pod \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\" (UID: \"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c\") " Jul 30 09:57:42.282573 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282556 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.282628 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282578 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09f1e662-07bd-4ebc-9e51-40f299103af9-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.282628 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282592 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24jxd\" (UniqueName: \"kubernetes.io/projected/09f1e662-07bd-4ebc-9e51-40f299103af9-kube-api-access-24jxd\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.282816 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.282791 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle" (OuterVolumeSpecName: "bundle") pod "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" (UID: "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:42.284383 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.284360 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj" (OuterVolumeSpecName: "kube-api-access-zc6sj") pod "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" (UID: "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c"). InnerVolumeSpecName "kube-api-access-zc6sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:57:42.287428 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.287407 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util" (OuterVolumeSpecName: "util") pod "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" (UID: "3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:42.383009 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.382978 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.383009 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.383004 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:42.383009 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:42.383013 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc6sj\" (UniqueName: \"kubernetes.io/projected/3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c-kube-api-access-zc6sj\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:43.033711 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.033620 2576 generic.go:356] "Generic (PLEG): container finished" podID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerID="bde61c09845417a33de327162c204a96faa3329a9908853058a3c469e642009b" exitCode=0 Jul 30 09:57:43.034137 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.033714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" event={"ID":"102b57e3-c586-4198-b4cf-5fc41d6b13b4","Type":"ContainerDied","Data":"bde61c09845417a33de327162c204a96faa3329a9908853058a3c469e642009b"} Jul 30 09:57:43.035735 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.035709 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" Jul 30 09:57:43.035821 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.035724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q" event={"ID":"3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c","Type":"ContainerDied","Data":"3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5"} Jul 30 09:57:43.035821 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.035769 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fc0118e72553092c935717b778dbfb89c594d96cd8ac4eeb2c78c49d259a4f5" Jul 30 09:57:43.037828 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.037771 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" Jul 30 09:57:43.037934 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.037775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft" event={"ID":"09f1e662-07bd-4ebc-9e51-40f299103af9","Type":"ContainerDied","Data":"de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f"} Jul 30 09:57:43.037934 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:43.037909 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de56be63fc74dc94c658bf1bb9ab0ac0f487f30f3583a44deb1b57701e015f4f" Jul 30 09:57:44.044143 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:44.044104 2576 generic.go:356] "Generic (PLEG): container finished" podID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerID="725250d4563ad47796269f3d1aa042f584d19a760e0f351ab4add22cbfcd4edf" exitCode=0 Jul 30 09:57:44.044530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:44.044190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" event={"ID":"102b57e3-c586-4198-b4cf-5fc41d6b13b4","Type":"ContainerDied","Data":"725250d4563ad47796269f3d1aa042f584d19a760e0f351ab4add22cbfcd4edf"} Jul 30 09:57:45.186801 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.186774 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:45.309016 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.308981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h45cr\" (UniqueName: \"kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr\") pod \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " Jul 30 09:57:45.309212 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.309085 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util\") pod \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " Jul 30 09:57:45.309212 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.309154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle\") pod \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\" (UID: \"102b57e3-c586-4198-b4cf-5fc41d6b13b4\") " Jul 30 09:57:45.309620 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.309583 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle" (OuterVolumeSpecName: "bundle") pod "102b57e3-c586-4198-b4cf-5fc41d6b13b4" (UID: "102b57e3-c586-4198-b4cf-5fc41d6b13b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:45.311179 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.311153 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr" (OuterVolumeSpecName: "kube-api-access-h45cr") pod "102b57e3-c586-4198-b4cf-5fc41d6b13b4" (UID: "102b57e3-c586-4198-b4cf-5fc41d6b13b4"). InnerVolumeSpecName "kube-api-access-h45cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:57:45.313978 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.313954 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util" (OuterVolumeSpecName: "util") pod "102b57e3-c586-4198-b4cf-5fc41d6b13b4" (UID: "102b57e3-c586-4198-b4cf-5fc41d6b13b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:57:45.410708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.410665 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:45.410708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.410700 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h45cr\" (UniqueName: \"kubernetes.io/projected/102b57e3-c586-4198-b4cf-5fc41d6b13b4-kube-api-access-h45cr\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:45.410708 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.410711 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102b57e3-c586-4198-b4cf-5fc41d6b13b4-util\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:57:45.893915 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.893878 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848467f974-747pk"] Jul 30 09:57:45.894280 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894266 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="util" Jul 30 09:57:45.894320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894284 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="util" Jul 30 09:57:45.894320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894297 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="pull" Jul 30 09:57:45.894320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894302 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="pull" Jul 30 09:57:45.894320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894311 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="util" Jul 30 09:57:45.894320 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894317 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="util" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894324 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894329 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894337 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894342 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894348 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894353 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894362 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="util" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894370 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="util" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894378 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894383 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894391 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894396 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894403 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="util" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="util" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894413 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894419 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="extract" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894425 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894430 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="pull" Jul 30 09:57:45.894487 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894488 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f1e662-07bd-4ebc-9e51-40f299103af9" containerName="extract" Jul 30 09:57:45.894972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894496 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="102b57e3-c586-4198-b4cf-5fc41d6b13b4" containerName="extract" Jul 30 09:57:45.894972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894502 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="589dc390-65fe-4175-9fca-7ebc4ee654d1" containerName="extract" Jul 30 09:57:45.894972 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.894507 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c" containerName="extract" Jul 30 09:57:45.898091 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.898073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:45.910793 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:45.910765 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848467f974-747pk"] Jul 30 09:57:46.016450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-trusted-ca-bundle\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016450 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016685 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-console-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016738 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhn7j\" (UniqueName: \"kubernetes.io/projected/1202475c-e344-467f-9a40-050d97ca1819-kube-api-access-nhn7j\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016786 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-oauth-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016786 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-service-ca\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.016899 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.016819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-oauth-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.055727 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.055699 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" Jul 30 09:57:46.055897 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.055724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh" event={"ID":"102b57e3-c586-4198-b4cf-5fc41d6b13b4","Type":"ContainerDied","Data":"d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849"} Jul 30 09:57:46.055897 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.055772 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5df44eac4af546b208741422e2c313adcd5b5224a7c40183bc2dfc27f195849" Jul 30 09:57:46.117390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-trusted-ca-bundle\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117390 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-console-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhn7j\" (UniqueName: \"kubernetes.io/projected/1202475c-e344-467f-9a40-050d97ca1819-kube-api-access-nhn7j\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-oauth-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-service-ca\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.117615 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.117572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-oauth-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.118355 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.118325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-console-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.118480 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.118392 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-oauth-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.118480 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.118419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-trusted-ca-bundle\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.118594 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.118558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1202475c-e344-467f-9a40-050d97ca1819-service-ca\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.119932 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.119911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-oauth-config\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.120175 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.120160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1202475c-e344-467f-9a40-050d97ca1819-console-serving-cert\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.125502 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.125477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhn7j\" (UniqueName: \"kubernetes.io/projected/1202475c-e344-467f-9a40-050d97ca1819-kube-api-access-nhn7j\") pod \"console-848467f974-747pk\" (UID: \"1202475c-e344-467f-9a40-050d97ca1819\") " pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.206950 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.206857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:46.340541 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:46.340513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848467f974-747pk"] Jul 30 09:57:46.342381 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:46.342354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1202475c_e344_467f_9a40_050d97ca1819.slice/crio-bfcd067d316cd1536e37f7f71c2d0f68f892bf6770e9e1d7bd5891b8fe67b07a WatchSource:0}: Error finding container bfcd067d316cd1536e37f7f71c2d0f68f892bf6770e9e1d7bd5891b8fe67b07a: Status 404 returned error can't find the container with id bfcd067d316cd1536e37f7f71c2d0f68f892bf6770e9e1d7bd5891b8fe67b07a Jul 30 09:57:47.062469 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:47.062428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848467f974-747pk" event={"ID":"1202475c-e344-467f-9a40-050d97ca1819","Type":"ContainerStarted","Data":"9805dbd65452aad898f3d9a34ae1ad7531e4bebf3cbdb3de30ac86310e97a7f2"} Jul 30 09:57:47.062622 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:47.062484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848467f974-747pk" event={"ID":"1202475c-e344-467f-9a40-050d97ca1819","Type":"ContainerStarted","Data":"bfcd067d316cd1536e37f7f71c2d0f68f892bf6770e9e1d7bd5891b8fe67b07a"} Jul 30 09:57:47.101433 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:47.101370 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848467f974-747pk" podStartSLOduration=2.101355749 podStartE2EDuration="2.101355749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:57:47.099003528 +0000 UTC m=+482.625430872" watchObservedRunningTime="2026-07-30 09:57:47.101355749 +0000 UTC m=+482.627783076" Jul 30 09:57:53.106865 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.106830 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks"] Jul 30 09:57:53.114668 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.114649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:53.116897 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.116878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 30 09:57:53.116999 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.116880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z588z\"" Jul 30 09:57:53.121811 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.121623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks"] Jul 30 09:57:53.185099 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.185063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw44t\" (UniqueName: \"kubernetes.io/projected/1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad-kube-api-access-kw44t\") pod \"dns-operator-controller-manager-864dd78c4c-48zks\" (UID: \"1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:53.286077 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.286023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw44t\" (UniqueName: \"kubernetes.io/projected/1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad-kube-api-access-kw44t\") pod \"dns-operator-controller-manager-864dd78c4c-48zks\" (UID: \"1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:53.310050 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.310006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw44t\" (UniqueName: \"kubernetes.io/projected/1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad-kube-api-access-kw44t\") pod \"dns-operator-controller-manager-864dd78c4c-48zks\" (UID: \"1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:53.425888 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.425785 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:53.556968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:53.556938 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks"] Jul 30 09:57:53.559155 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:53.559130 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3b4eb8_8752_4d42_b4c3_20dbae4f7aad.slice/crio-efc0d9aaba0a3f858173ef16a401b35210bc835a069135c36ac13fa7b1b10f99 WatchSource:0}: Error finding container efc0d9aaba0a3f858173ef16a401b35210bc835a069135c36ac13fa7b1b10f99: Status 404 returned error can't find the container with id efc0d9aaba0a3f858173ef16a401b35210bc835a069135c36ac13fa7b1b10f99 Jul 30 09:57:54.096688 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:54.096652 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" event={"ID":"1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad","Type":"ContainerStarted","Data":"efc0d9aaba0a3f858173ef16a401b35210bc835a069135c36ac13fa7b1b10f99"} Jul 30 09:57:56.207706 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:56.207665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:56.208142 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:56.207745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:56.212938 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:56.212913 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:57.114530 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:57.114493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" event={"ID":"1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad","Type":"ContainerStarted","Data":"9d48ef4a5702a90025dc2e8301f3281bd90b7aee4798aa756777417a77b652c8"} Jul 30 09:57:57.118345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:57.118326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-848467f974-747pk" Jul 30 09:57:57.132778 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:57.132735 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" podStartSLOduration=0.860549567 podStartE2EDuration="4.132721511s" totalImagesPullingTime="3.272171944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:57:57.130324202 +0000 UTC m=+492.656751543" watchObservedRunningTime="2026-07-30 09:57:57.132721511 +0000 UTC m=+492.659148839" Jul 30 09:57:57.188378 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:57.188347 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:57:58.119142 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.119108 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:57:58.383591 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.383511 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb"] Jul 30 09:57:58.386914 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.386899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.389094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.389069 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2cjd\"" Jul 30 09:57:58.399911 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.399886 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb"] Jul 30 09:57:58.534531 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.534496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wclxg\" (UniqueName: \"kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.534703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.534549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.635345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.635261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wclxg\" (UniqueName: \"kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.635345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.635317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.635678 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.635660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.648664 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.648637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wclxg\" (UniqueName: \"kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.696656 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.696631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:57:58.832619 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:58.832590 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb"] Jul 30 09:57:58.834123 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:57:58.834095 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125f00db_181a_44fd_bcba_b0f83d24979b.slice/crio-f21732810804276a127bdf3dc94a5fd91b42d4555b09bb9e988387fb642d8687 WatchSource:0}: Error finding container f21732810804276a127bdf3dc94a5fd91b42d4555b09bb9e988387fb642d8687: Status 404 returned error can't find the container with id f21732810804276a127bdf3dc94a5fd91b42d4555b09bb9e988387fb642d8687 Jul 30 09:57:59.125387 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:57:59.125358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" event={"ID":"125f00db-181a-44fd-bcba-b0f83d24979b","Type":"ContainerStarted","Data":"f21732810804276a127bdf3dc94a5fd91b42d4555b09bb9e988387fb642d8687"} Jul 30 09:58:02.042926 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.042891 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qw96q"] Jul 30 09:58:02.046601 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.046571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:02.054922 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.054883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jpbjj\"" Jul 30 09:58:02.075819 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.074236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qw96q"] Jul 30 09:58:02.167020 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.166986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk2r6\" (UniqueName: \"kubernetes.io/projected/52f03e01-deda-4308-b136-a09b0a5dc239-kube-api-access-qk2r6\") pod \"authorino-operator-75cc8d5cb7-qw96q\" (UID: \"52f03e01-deda-4308-b136-a09b0a5dc239\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:02.268212 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.268179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk2r6\" (UniqueName: \"kubernetes.io/projected/52f03e01-deda-4308-b136-a09b0a5dc239-kube-api-access-qk2r6\") pod \"authorino-operator-75cc8d5cb7-qw96q\" (UID: \"52f03e01-deda-4308-b136-a09b0a5dc239\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:02.280486 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.280447 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk2r6\" (UniqueName: \"kubernetes.io/projected/52f03e01-deda-4308-b136-a09b0a5dc239-kube-api-access-qk2r6\") pod \"authorino-operator-75cc8d5cb7-qw96q\" (UID: \"52f03e01-deda-4308-b136-a09b0a5dc239\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:02.359927 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:02.359894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:03.582538 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:03.582512 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qw96q"] Jul 30 09:58:03.582823 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:03.582520 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f03e01_deda_4308_b136_a09b0a5dc239.slice/crio-6ba9791309f0359e300997b5af53113caf319de14ed8f9eed916419cac53b23a WatchSource:0}: Error finding container 6ba9791309f0359e300997b5af53113caf319de14ed8f9eed916419cac53b23a: Status 404 returned error can't find the container with id 6ba9791309f0359e300997b5af53113caf319de14ed8f9eed916419cac53b23a Jul 30 09:58:04.155293 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:04.155261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" event={"ID":"52f03e01-deda-4308-b136-a09b0a5dc239","Type":"ContainerStarted","Data":"6ba9791309f0359e300997b5af53113caf319de14ed8f9eed916419cac53b23a"} Jul 30 09:58:04.157021 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:04.156994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" event={"ID":"125f00db-181a-44fd-bcba-b0f83d24979b","Type":"ContainerStarted","Data":"16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51"} Jul 30 09:58:04.157166 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:04.157142 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:04.181114 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:04.181071 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" podStartSLOduration=1.508840895 podStartE2EDuration="6.181055902s" totalImagesPullingTime="4.672215007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:04.179505961 +0000 UTC m=+499.705933290" watchObservedRunningTime="2026-07-30 09:58:04.181055902 +0000 UTC m=+499.707483230" Jul 30 09:58:06.170349 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:06.170309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" event={"ID":"52f03e01-deda-4308-b136-a09b0a5dc239","Type":"ContainerStarted","Data":"2053615b74fdbe23631f49d67b884e58b87bd21179751dc6b8c349a22f4ffb89"} Jul 30 09:58:06.170749 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:06.170413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:06.187714 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:06.187661 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" podStartSLOduration=1.7575998560000001 podStartE2EDuration="4.187645089s" totalImagesPullingTime="2.430045233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:06.18612985 +0000 UTC m=+501.712557179" watchObservedRunningTime="2026-07-30 09:58:06.187645089 +0000 UTC m=+501.714072416" Jul 30 09:58:09.128159 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:09.128129 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-48zks" Jul 30 09:58:15.166141 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:15.166109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:16.553592 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.553550 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm"] Jul 30 09:58:16.557061 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.557041 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.575171 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.575136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm"] Jul 30 09:58:16.608169 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.608128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxn48\" (UniqueName: \"kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.608345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.608178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.709345 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.709304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxn48\" (UniqueName: \"kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.709497 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.709357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.709805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.709785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.717191 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.717160 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxn48\" (UniqueName: \"kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48\") pod \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:16.867693 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:16.867657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:17.012521 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.012494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm"] Jul 30 09:58:17.014513 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:17.014488 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634dd4f4_a6a4_4d00_a250_9bfd03e28c10.slice/crio-204a65f68220056ef04908d8cc8775d9f8c2c91571e6dca0013d5acf41b4c935 WatchSource:0}: Error finding container 204a65f68220056ef04908d8cc8775d9f8c2c91571e6dca0013d5acf41b4c935: Status 404 returned error can't find the container with id 204a65f68220056ef04908d8cc8775d9f8c2c91571e6dca0013d5acf41b4c935 Jul 30 09:58:17.142576 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.142495 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm"] Jul 30 09:58:17.156781 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.156755 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm"] Jul 30 09:58:17.172792 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.172767 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb"] Jul 30 09:58:17.173009 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.172986 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" containerName="manager" containerID="cri-o://16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51" gracePeriod=2 Jul 30 09:58:17.177483 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.177458 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qw96q" Jul 30 09:58:17.178250 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.178231 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:17.178580 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.178569 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" containerName="manager" Jul 30 09:58:17.178630 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.178582 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" containerName="manager" Jul 30 09:58:17.178667 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.178638 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" containerName="manager" Jul 30 09:58:17.182178 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.182160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.189240 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.189186 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb"] Jul 30 09:58:17.208517 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.208487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:17.210492 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.210451 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"125f00db-181a-44fd-bcba-b0f83d24979b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-drjjb\": pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:17.213012 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.212983 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:17.214301 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214277 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:17.214473 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.214628 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zc8r\" (UniqueName: \"kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.214795 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" containerName="manager" Jul 30 09:58:17.214830 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214800 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" containerName="manager" Jul 30 09:58:17.214918 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.214907 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" containerName="manager" Jul 30 09:58:17.218351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.218329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.232492 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.232472 2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" container="manager" Jul 30 09:58:17.245752 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.245725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:17.287987 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.287958 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:17.315497 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.315449 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:17.315497 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.315334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.315696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.315534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.315696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.315602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfsbp\" (UniqueName: \"kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.315696 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.315690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zc8r\" (UniqueName: \"kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.315905 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.315885 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.325521 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.325490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zc8r\" (UniqueName: \"kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r\") pod \"kuadrant-operator-controller-manager-55467d9f7-kw68x\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.416331 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.416304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.416475 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.416369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfsbp\" (UniqueName: \"kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.416682 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.416661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.419580 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.419563 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:17.421653 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.421627 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:17.423539 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:17.423512 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:17.425724 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.425703 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfsbp\" (UniqueName: \"kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkx8x\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.516831 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.516795 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wclxg\" (UniqueName: \"kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg\") pod \"125f00db-181a-44fd-bcba-b0f83d24979b\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " Jul 30 09:58:17.517004 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.516937 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume\") pod \"125f00db-181a-44fd-bcba-b0f83d24979b\" (UID: \"125f00db-181a-44fd-bcba-b0f83d24979b\") " Jul 30 09:58:17.517411 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.517388 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "125f00db-181a-44fd-bcba-b0f83d24979b" (UID: "125f00db-181a-44fd-bcba-b0f83d24979b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:58:17.518730 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.518709 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg" (OuterVolumeSpecName: "kube-api-access-wclxg") pod "125f00db-181a-44fd-bcba-b0f83d24979b" (UID: "125f00db-181a-44fd-bcba-b0f83d24979b"). InnerVolumeSpecName "kube-api-access-wclxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:58:17.543857 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.543832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:17.552661 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.552646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:17.618611 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.618576 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/125f00db-181a-44fd-bcba-b0f83d24979b-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:17.618904 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.618616 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wclxg\" (UniqueName: \"kubernetes.io/projected/125f00db-181a-44fd-bcba-b0f83d24979b-kube-api-access-wclxg\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:17.694163 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.694133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:17.696895 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:17.696866 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d09ede0_b1d6_44cf_ac95_ec6ecba5e85b.slice/crio-6d57e74bf0ca9afdc95d198d6f1a7ee23b695bfdcc6bcf287e8c603c9aa3378b WatchSource:0}: Error finding container 6d57e74bf0ca9afdc95d198d6f1a7ee23b695bfdcc6bcf287e8c603c9aa3378b: Status 404 returned error can't find the container with id 6d57e74bf0ca9afdc95d198d6f1a7ee23b695bfdcc6bcf287e8c603c9aa3378b Jul 30 09:58:17.715285 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:17.715262 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:17.717121 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:17.717092 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba73d54_e5e5_4ae8_97c0_4dc012f55235.slice/crio-5350ec2c4d8458e0d3d6ebb3f2b478b7dcd7c6f66d9952fcc8f40bd56705b531 WatchSource:0}: Error finding container 5350ec2c4d8458e0d3d6ebb3f2b478b7dcd7c6f66d9952fcc8f40bd56705b531: Status 404 returned error can't find the container with id 5350ec2c4d8458e0d3d6ebb3f2b478b7dcd7c6f66d9952fcc8f40bd56705b531 Jul 30 09:58:18.239924 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.239519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" event={"ID":"9ba73d54-e5e5-4ae8-97c0-4dc012f55235","Type":"ContainerStarted","Data":"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4"} Jul 30 09:58:18.239924 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.239585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" event={"ID":"9ba73d54-e5e5-4ae8-97c0-4dc012f55235","Type":"ContainerStarted","Data":"5350ec2c4d8458e0d3d6ebb3f2b478b7dcd7c6f66d9952fcc8f40bd56705b531"} Jul 30 09:58:18.239924 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.239635 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:18.241753 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.241712 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:18.241956 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.241939 2576 scope.go:117] "RemoveContainer" containerID="16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51" Jul 30 09:58:18.242174 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.242135 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:18.242282 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.241907 2576 generic.go:356] "Generic (PLEG): container finished" podID="125f00db-181a-44fd-bcba-b0f83d24979b" containerID="16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51" exitCode=0 Jul 30 09:58:18.245303 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.245265 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:18.246411 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.246381 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" containerName="manager" containerID="cri-o://8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa" gracePeriod=2 Jul 30 09:58:18.248268 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.248245 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" event={"ID":"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b","Type":"ContainerStarted","Data":"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2"} Jul 30 09:58:18.248372 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.248288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" event={"ID":"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b","Type":"ContainerStarted","Data":"6d57e74bf0ca9afdc95d198d6f1a7ee23b695bfdcc6bcf287e8c603c9aa3378b"} Jul 30 09:58:18.248372 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.248356 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:18.254139 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.254117 2576 scope.go:117] "RemoveContainer" containerID="16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51" Jul 30 09:58:18.254449 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.254429 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51\": container with ID starting with 16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51 not found: ID does not exist" containerID="16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51" Jul 30 09:58:18.254545 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.254457 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51"} err="failed to get container status \"16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51\": rpc error: code = NotFound desc = could not find container \"16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51\": container with ID starting with 16d7e3a6aa4861665857bd743b816ad7b68ccc7e7583f9cb14002a809134ca51 not found: ID does not exist" Jul 30 09:58:18.267501 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.267452 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" podStartSLOduration=1.267436821 podStartE2EDuration="1.267436821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:18.26511557 +0000 UTC m=+513.791542898" watchObservedRunningTime="2026-07-30 09:58:18.267436821 +0000 UTC m=+513.793864148" Jul 30 09:58:18.268134 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.268108 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:18.269692 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.269668 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:18.292744 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.292686 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" podStartSLOduration=1.2926688020000001 podStartE2EDuration="1.292668802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:18.291449783 +0000 UTC m=+513.817877146" watchObservedRunningTime="2026-07-30 09:58:18.292668802 +0000 UTC m=+513.819096129" Jul 30 09:58:18.489979 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.489916 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:18.492159 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.492128 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:18.493760 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:18.493738 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-drjjb\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjjb" Jul 30 09:58:18.525219 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.525189 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxn48\" (UniqueName: \"kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48\") pod \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " Jul 30 09:58:18.525416 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.525401 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume\") pod \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\" (UID: \"634dd4f4-a6a4-4d00-a250-9bfd03e28c10\") " Jul 30 09:58:18.525662 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.525642 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "634dd4f4-a6a4-4d00-a250-9bfd03e28c10" (UID: "634dd4f4-a6a4-4d00-a250-9bfd03e28c10"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:58:18.527247 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.527223 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48" (OuterVolumeSpecName: "kube-api-access-vxn48") pod "634dd4f4-a6a4-4d00-a250-9bfd03e28c10" (UID: "634dd4f4-a6a4-4d00-a250-9bfd03e28c10"). InnerVolumeSpecName "kube-api-access-vxn48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:58:18.626230 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.626191 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:18.626230 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.626223 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxn48\" (UniqueName: \"kubernetes.io/projected/634dd4f4-a6a4-4d00-a250-9bfd03e28c10-kube-api-access-vxn48\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:18.929792 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.929759 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125f00db-181a-44fd-bcba-b0f83d24979b" path="/var/lib/kubelet/pods/125f00db-181a-44fd-bcba-b0f83d24979b/volumes" Jul 30 09:58:18.930153 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:18.930138 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" path="/var/lib/kubelet/pods/634dd4f4-a6a4-4d00-a250-9bfd03e28c10/volumes" Jul 30 09:58:19.254607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:19.254519 2576 generic.go:356] "Generic (PLEG): container finished" podID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" containerID="8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa" exitCode=2 Jul 30 09:58:19.254607 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:19.254560 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:19.254810 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:19.254621 2576 scope.go:117] "RemoveContainer" containerID="8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa" Jul 30 09:58:19.258949 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:19.258924 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fvmtm\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="634dd4f4-a6a4-4d00-a250-9bfd03e28c10" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fvmtm" Jul 30 09:58:19.263577 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:19.263561 2576 scope.go:117] "RemoveContainer" containerID="8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa" Jul 30 09:58:19.263838 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:19.263819 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa\": container with ID starting with 8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa not found: ID does not exist" containerID="8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa" Jul 30 09:58:19.263936 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:19.263845 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa"} err="failed to get container status \"8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa\": rpc error: code = NotFound desc = could not find container \"8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa\": container with ID starting with 8ef8b7aa47158ad6164d858140cf9fceb0f31aaea585fcb271d8bb49c539ecfa not found: ID does not exist" Jul 30 09:58:22.214303 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.214264 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-869cb57674-gcjsj" podUID="22181105-d1ca-4f92-a755-c14699c0c336" containerName="console" containerID="cri-o://bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae" gracePeriod=15 Jul 30 09:58:22.460385 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.460359 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:58:22.562203 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562203 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48drz\" (UniqueName: \"kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562418 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562224 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562418 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562259 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562418 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562418 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562418 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert\") pod \"22181105-d1ca-4f92-a755-c14699c0c336\" (UID: \"22181105-d1ca-4f92-a755-c14699c0c336\") " Jul 30 09:58:22.562713 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562681 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca" (OuterVolumeSpecName: "service-ca") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:58:22.562813 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562769 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config" (OuterVolumeSpecName: "console-config") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:58:22.562813 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562783 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:58:22.562910 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.562827 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 09:58:22.564453 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.564428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz" (OuterVolumeSpecName: "kube-api-access-48drz") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "kube-api-access-48drz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:58:22.564556 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.564453 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:58:22.564556 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.564529 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22181105-d1ca-4f92-a755-c14699c0c336" (UID: "22181105-d1ca-4f92-a755-c14699c0c336"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 09:58:22.663492 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663455 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48drz\" (UniqueName: \"kubernetes.io/projected/22181105-d1ca-4f92-a755-c14699c0c336-kube-api-access-48drz\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663492 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663488 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663492 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663498 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-console-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663507 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-trusted-ca-bundle\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663516 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22181105-d1ca-4f92-a755-c14699c0c336-console-oauth-config\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663526 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-oauth-serving-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:22.663694 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:22.663536 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22181105-d1ca-4f92-a755-c14699c0c336-service-ca\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:23.278441 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.278350 2576 generic.go:356] "Generic (PLEG): container finished" podID="22181105-d1ca-4f92-a755-c14699c0c336" containerID="bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae" exitCode=0 Jul 30 09:58:23.278441 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.278398 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869cb57674-gcjsj" Jul 30 09:58:23.278923 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.278442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869cb57674-gcjsj" event={"ID":"22181105-d1ca-4f92-a755-c14699c0c336","Type":"ContainerDied","Data":"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae"} Jul 30 09:58:23.278923 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.278504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869cb57674-gcjsj" event={"ID":"22181105-d1ca-4f92-a755-c14699c0c336","Type":"ContainerDied","Data":"eeab8079dd088d33b16a0d2ed8c0057f5ae29844316e47ace8b58f688140e47b"} Jul 30 09:58:23.278923 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.278537 2576 scope.go:117] "RemoveContainer" containerID="bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae" Jul 30 09:58:23.287364 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.287347 2576 scope.go:117] "RemoveContainer" containerID="bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae" Jul 30 09:58:23.287645 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:23.287626 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae\": container with ID starting with bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae not found: ID does not exist" containerID="bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae" Jul 30 09:58:23.287687 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.287654 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae"} err="failed to get container status \"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae\": rpc error: code = NotFound desc = could not find container \"bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae\": container with ID starting with bc6d90ba1e3256cefe96f37ce900eca26af8bb0ab467210884aa869598e55bae not found: ID does not exist" Jul 30 09:58:23.294887 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.294862 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:58:23.298726 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:23.298704 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869cb57674-gcjsj"] Jul 30 09:58:24.930161 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:24.930127 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22181105-d1ca-4f92-a755-c14699c0c336" path="/var/lib/kubelet/pods/22181105-d1ca-4f92-a755-c14699c0c336/volumes" Jul 30 09:58:29.257549 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.257519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:29.257957 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.257598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:29.356422 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.356388 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:29.356646 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.356593 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" podUID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" containerName="manager" containerID="cri-o://6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4" gracePeriod=10 Jul 30 09:58:29.596336 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.596309 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:29.623976 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.623946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfsbp\" (UniqueName: \"kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp\") pod \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " Jul 30 09:58:29.624147 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.624129 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume\") pod \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\" (UID: \"9ba73d54-e5e5-4ae8-97c0-4dc012f55235\") " Jul 30 09:58:29.624484 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.624459 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9ba73d54-e5e5-4ae8-97c0-4dc012f55235" (UID: "9ba73d54-e5e5-4ae8-97c0-4dc012f55235"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:58:29.624555 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.624535 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:29.626004 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.625977 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp" (OuterVolumeSpecName: "kube-api-access-kfsbp") pod "9ba73d54-e5e5-4ae8-97c0-4dc012f55235" (UID: "9ba73d54-e5e5-4ae8-97c0-4dc012f55235"). InnerVolumeSpecName "kube-api-access-kfsbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:58:29.664333 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664303 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 09:58:29.664707 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664685 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22181105-d1ca-4f92-a755-c14699c0c336" containerName="console" Jul 30 09:58:29.664707 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664706 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22181105-d1ca-4f92-a755-c14699c0c336" containerName="console" Jul 30 09:58:29.664968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664735 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" containerName="manager" Jul 30 09:58:29.664968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664745 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" containerName="manager" Jul 30 09:58:29.664968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664834 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22181105-d1ca-4f92-a755-c14699c0c336" containerName="console" Jul 30 09:58:29.664968 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.664847 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" containerName="manager" Jul 30 09:58:29.670007 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.669988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.684771 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.684740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 09:58:29.725438 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.725400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.725593 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.725503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9mp\" (UniqueName: \"kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.725639 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.725622 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfsbp\" (UniqueName: \"kubernetes.io/projected/9ba73d54-e5e5-4ae8-97c0-4dc012f55235-kube-api-access-kfsbp\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:29.826357 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.826287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.826511 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.826425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9mp\" (UniqueName: \"kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.826648 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.826629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.837197 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.837166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9mp\" (UniqueName: \"kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp\") pod \"kuadrant-operator-controller-manager-86878c769f-qmq8z\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:29.980069 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:29.980011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:30.116773 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.116747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 09:58:30.118796 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:30.118771 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ef259f_ac6a_439a_84be_128e1929a0fc.slice/crio-237d4fc414f34894e1df6aecc8141f60ec4a04b5c1892eea6c1dc9df1d7c824e WatchSource:0}: Error finding container 237d4fc414f34894e1df6aecc8141f60ec4a04b5c1892eea6c1dc9df1d7c824e: Status 404 returned error can't find the container with id 237d4fc414f34894e1df6aecc8141f60ec4a04b5c1892eea6c1dc9df1d7c824e Jul 30 09:58:30.318459 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.318422 2576 generic.go:356] "Generic (PLEG): container finished" podID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" containerID="6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4" exitCode=0 Jul 30 09:58:30.318890 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.318472 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" Jul 30 09:58:30.318890 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.318504 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" event={"ID":"9ba73d54-e5e5-4ae8-97c0-4dc012f55235","Type":"ContainerDied","Data":"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4"} Jul 30 09:58:30.318890 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.318565 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x" event={"ID":"9ba73d54-e5e5-4ae8-97c0-4dc012f55235","Type":"ContainerDied","Data":"5350ec2c4d8458e0d3d6ebb3f2b478b7dcd7c6f66d9952fcc8f40bd56705b531"} Jul 30 09:58:30.318890 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.318588 2576 scope.go:117] "RemoveContainer" containerID="6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4" Jul 30 09:58:30.320419 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.320385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" event={"ID":"73ef259f-ac6a-439a-84be-128e1929a0fc","Type":"ContainerStarted","Data":"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc"} Jul 30 09:58:30.320517 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.320438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" event={"ID":"73ef259f-ac6a-439a-84be-128e1929a0fc","Type":"ContainerStarted","Data":"237d4fc414f34894e1df6aecc8141f60ec4a04b5c1892eea6c1dc9df1d7c824e"} Jul 30 09:58:30.320574 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.320548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:30.328572 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.328550 2576 scope.go:117] "RemoveContainer" containerID="6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4" Jul 30 09:58:30.328879 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:30.328858 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4\": container with ID starting with 6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4 not found: ID does not exist" containerID="6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4" Jul 30 09:58:30.328933 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.328890 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4"} err="failed to get container status \"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4\": rpc error: code = NotFound desc = could not find container \"6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4\": container with ID starting with 6d6b7ebc0fc29efb85773948755f092ba965c8a4840c0f2827d77975ab8510d4 not found: ID does not exist" Jul 30 09:58:30.358897 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.358847 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" podStartSLOduration=1.358825929 podStartE2EDuration="1.358825929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:30.342151457 +0000 UTC m=+525.868578787" watchObservedRunningTime="2026-07-30 09:58:30.358825929 +0000 UTC m=+525.885253261" Jul 30 09:58:30.359707 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.359663 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:30.364093 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.364061 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkx8x"] Jul 30 09:58:30.929697 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:30.929665 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ba73d54-e5e5-4ae8-97c0-4dc012f55235" path="/var/lib/kubelet/pods/9ba73d54-e5e5-4ae8-97c0-4dc012f55235/volumes" Jul 30 09:58:41.329855 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.329772 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 09:58:41.414794 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.414755 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:41.414990 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.414964 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" podUID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" containerName="manager" containerID="cri-o://90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2" gracePeriod=10 Jul 30 09:58:41.665803 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.665777 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:41.738003 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.737964 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zc8r\" (UniqueName: \"kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r\") pod \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " Jul 30 09:58:41.738220 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.738138 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume\") pod \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\" (UID: \"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b\") " Jul 30 09:58:41.738513 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.738490 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" (UID: "0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 09:58:41.740067 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.740017 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r" (OuterVolumeSpecName: "kube-api-access-5zc8r") pod "0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" (UID: "0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b"). InnerVolumeSpecName "kube-api-access-5zc8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:58:41.839834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.839742 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:41.839834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:41.839777 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zc8r\" (UniqueName: \"kubernetes.io/projected/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b-kube-api-access-5zc8r\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:58:42.390078 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.390021 2576 generic.go:356] "Generic (PLEG): container finished" podID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" containerID="90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2" exitCode=0 Jul 30 09:58:42.390516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.390093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" Jul 30 09:58:42.390516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.390124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" event={"ID":"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b","Type":"ContainerDied","Data":"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2"} Jul 30 09:58:42.390516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.390180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x" event={"ID":"0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b","Type":"ContainerDied","Data":"6d57e74bf0ca9afdc95d198d6f1a7ee23b695bfdcc6bcf287e8c603c9aa3378b"} Jul 30 09:58:42.390516 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.390205 2576 scope.go:117] "RemoveContainer" containerID="90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2" Jul 30 09:58:42.399313 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.399294 2576 scope.go:117] "RemoveContainer" containerID="90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2" Jul 30 09:58:42.399558 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:58:42.399542 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2\": container with ID starting with 90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2 not found: ID does not exist" containerID="90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2" Jul 30 09:58:42.399617 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.399566 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2"} err="failed to get container status \"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2\": rpc error: code = NotFound desc = could not find container \"90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2\": container with ID starting with 90115de01a9f4865f4d7b34d4d83916c2928900b003bc915ad294f91ac11dcc2 not found: ID does not exist" Jul 30 09:58:42.415793 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.415768 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:42.418248 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.418227 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kw68x"] Jul 30 09:58:42.930120 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:42.930089 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" path="/var/lib/kubelet/pods/0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b/volumes" Jul 30 09:58:45.860249 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.860200 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6"] Jul 30 09:58:45.860834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.860811 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" containerName="manager" Jul 30 09:58:45.860834 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.860833 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" containerName="manager" Jul 30 09:58:45.860988 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.860915 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d09ede0-b1d6-44cf-ac95-ec6ecba5e85b" containerName="manager" Jul 30 09:58:45.866008 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.865981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.868701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.868679 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vzcjh\"" Jul 30 09:58:45.876651 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.876624 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6"] Jul 30 09:58:45.977400 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce966a0-7957-4e2b-b324-88027e3f9115-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977597 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxdx\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-kube-api-access-9dxdx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:45.977805 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:45.977662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.078840 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.078800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079071 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.078852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce966a0-7957-4e2b-b324-88027e3f9115-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079155 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079155 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079262 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079262 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079262 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079415 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079415 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxdx\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-kube-api-access-9dxdx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079415 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079564 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079631 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079857 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce966a0-7957-4e2b-b324-88027e3f9115-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.079857 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.079817 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.081784 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.081758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.082330 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.082309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.087870 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.087840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.087955 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.087854 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxdx\" (UniqueName: \"kubernetes.io/projected/5ce966a0-7957-4e2b-b324-88027e3f9115-kube-api-access-9dxdx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-54zf6\" (UID: \"5ce966a0-7957-4e2b-b324-88027e3f9115\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.178847 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.178749 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:46.323378 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.323352 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6"] Jul 30 09:58:46.325039 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:58:46.324999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce966a0_7957_4e2b_b324_88027e3f9115.slice/crio-6ad4c89988cff9da6eeb1b48ae5fa1a681443de5cb05804da03057d7c28147f9 WatchSource:0}: Error finding container 6ad4c89988cff9da6eeb1b48ae5fa1a681443de5cb05804da03057d7c28147f9: Status 404 returned error can't find the container with id 6ad4c89988cff9da6eeb1b48ae5fa1a681443de5cb05804da03057d7c28147f9 Jul 30 09:58:46.327113 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.327020 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:58:46.327204 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.327149 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:58:46.327204 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.327185 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 09:58:46.413693 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.413626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" event={"ID":"5ce966a0-7957-4e2b-b324-88027e3f9115","Type":"ContainerStarted","Data":"68de5bf50e4115488b954497a6d39472f2ee538b9ac9547294c5e46c08afe17a"} Jul 30 09:58:46.413952 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.413719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" event={"ID":"5ce966a0-7957-4e2b-b324-88027e3f9115","Type":"ContainerStarted","Data":"6ad4c89988cff9da6eeb1b48ae5fa1a681443de5cb05804da03057d7c28147f9"} Jul 30 09:58:46.435653 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:46.435540 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" podStartSLOduration=1.435518333 podStartE2EDuration="1.435518333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:58:46.434192566 +0000 UTC m=+541.960619896" watchObservedRunningTime="2026-07-30 09:58:46.435518333 +0000 UTC m=+541.961945662" Jul 30 09:58:47.179474 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:47.179438 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:47.184131 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:47.184104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:47.418891 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:47.418852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:58:47.419703 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:58:47.419686 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 09:59:00.835701 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:00.835661 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:00.839444 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:00.839422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:00.844284 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:00.844263 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j697b\"" Jul 30 09:59:00.855949 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:00.855922 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:01.011316 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.011280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2cq4\" (UniqueName: \"kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4\") pod \"authorino-75d556bd77-s6z8s\" (UID: \"64fa7057-8f92-4b5d-9bbc-05c66f4019f8\") " pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:01.112796 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.112763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2cq4\" (UniqueName: \"kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4\") pod \"authorino-75d556bd77-s6z8s\" (UID: \"64fa7057-8f92-4b5d-9bbc-05c66f4019f8\") " pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:01.128055 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.128004 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2cq4\" (UniqueName: \"kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4\") pod \"authorino-75d556bd77-s6z8s\" (UID: \"64fa7057-8f92-4b5d-9bbc-05c66f4019f8\") " pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:01.148433 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.148390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:01.303377 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.303343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:01.305573 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:59:01.305544 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64fa7057_8f92_4b5d_9bbc_05c66f4019f8.slice/crio-148dcb8a40d84681996e2897c66301a025120586690b65e8bcea82f3864e3aa0 WatchSource:0}: Error finding container 148dcb8a40d84681996e2897c66301a025120586690b65e8bcea82f3864e3aa0: Status 404 returned error can't find the container with id 148dcb8a40d84681996e2897c66301a025120586690b65e8bcea82f3864e3aa0 Jul 30 09:59:01.491198 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:01.491110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6z8s" event={"ID":"64fa7057-8f92-4b5d-9bbc-05c66f4019f8","Type":"ContainerStarted","Data":"148dcb8a40d84681996e2897c66301a025120586690b65e8bcea82f3864e3aa0"} Jul 30 09:59:05.519192 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:05.519151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6z8s" event={"ID":"64fa7057-8f92-4b5d-9bbc-05c66f4019f8","Type":"ContainerStarted","Data":"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec"} Jul 30 09:59:05.533298 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:05.533242 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-s6z8s" podStartSLOduration=2.3596382719999998 podStartE2EDuration="5.533225795s" totalImagesPullingTime="3.173587523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:05.532243044 +0000 UTC m=+561.058670373" watchObservedRunningTime="2026-07-30 09:59:05.533225795 +0000 UTC m=+561.059653173" Jul 30 09:59:34.047438 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.047402 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:34.047958 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.047585 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-s6z8s" podUID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" containerName="authorino" containerID="cri-o://67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec" gracePeriod=30 Jul 30 09:59:34.297848 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.297784 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:34.404548 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.404511 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2cq4\" (UniqueName: \"kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4\") pod \"64fa7057-8f92-4b5d-9bbc-05c66f4019f8\" (UID: \"64fa7057-8f92-4b5d-9bbc-05c66f4019f8\") " Jul 30 09:59:34.406499 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.406473 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4" (OuterVolumeSpecName: "kube-api-access-b2cq4") pod "64fa7057-8f92-4b5d-9bbc-05c66f4019f8" (UID: "64fa7057-8f92-4b5d-9bbc-05c66f4019f8"). InnerVolumeSpecName "kube-api-access-b2cq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 09:59:34.506150 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.506112 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2cq4\" (UniqueName: \"kubernetes.io/projected/64fa7057-8f92-4b5d-9bbc-05c66f4019f8-kube-api-access-b2cq4\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 09:59:34.672351 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.672320 2576 generic.go:356] "Generic (PLEG): container finished" podID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" containerID="67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec" exitCode=0 Jul 30 09:59:34.672512 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.672359 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-s6z8s" Jul 30 09:59:34.672512 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.672367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6z8s" event={"ID":"64fa7057-8f92-4b5d-9bbc-05c66f4019f8","Type":"ContainerDied","Data":"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec"} Jul 30 09:59:34.672512 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.672398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-s6z8s" event={"ID":"64fa7057-8f92-4b5d-9bbc-05c66f4019f8","Type":"ContainerDied","Data":"148dcb8a40d84681996e2897c66301a025120586690b65e8bcea82f3864e3aa0"} Jul 30 09:59:34.672512 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.672414 2576 scope.go:117] "RemoveContainer" containerID="67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec" Jul 30 09:59:34.681684 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.681663 2576 scope.go:117] "RemoveContainer" containerID="67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec" Jul 30 09:59:34.681927 ip-10-0-130-75 kubenswrapper[2576]: E0730 09:59:34.681908 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec\": container with ID starting with 67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec not found: ID does not exist" containerID="67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec" Jul 30 09:59:34.681975 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.681936 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec"} err="failed to get container status \"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec\": rpc error: code = NotFound desc = could not find container \"67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec\": container with ID starting with 67f536ab76dc4825c81bbc2270f8d15feaa2c3b1542e989eff218d9214c196ec not found: ID does not exist" Jul 30 09:59:34.692540 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.692519 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:34.696099 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.696078 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-s6z8s"] Jul 30 09:59:34.930004 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:34.929907 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" path="/var/lib/kubelet/pods/64fa7057-8f92-4b5d-9bbc-05c66f4019f8/volumes" Jul 30 09:59:39.156475 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.156415 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 09:59:39.156892 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.156880 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" containerName="authorino" Jul 30 09:59:39.156947 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.156895 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" containerName="authorino" Jul 30 09:59:39.156983 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.156959 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="64fa7057-8f92-4b5d-9bbc-05c66f4019f8" containerName="authorino" Jul 30 09:59:39.159094 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.159079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.162266 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.162246 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pzbsj\"" Jul 30 09:59:39.162402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.162252 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 30 09:59:39.162402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.162304 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 30 09:59:39.169200 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.169173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 09:59:39.249353 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.249319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9vcn\" (UniqueName: \"kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.249526 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.249375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.350233 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.350198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.350402 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.350287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9vcn\" (UniqueName: \"kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.352784 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.352749 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.358799 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.358775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9vcn\" (UniqueName: \"kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn\") pod \"maas-controller-54646dcfcb-6msjh\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.470438 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.470351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:39.601567 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.601540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 09:59:39.603635 ip-10-0-130-75 kubenswrapper[2576]: W0730 09:59:39.603608 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2918f975_d7ca_4a6b_a373_0338d3c61b56.slice/crio-e076a785f8433c4df828802ce099fe2af38818852feb3263442f17b01535b51a WatchSource:0}: Error finding container e076a785f8433c4df828802ce099fe2af38818852feb3263442f17b01535b51a: Status 404 returned error can't find the container with id e076a785f8433c4df828802ce099fe2af38818852feb3263442f17b01535b51a Jul 30 09:59:39.707713 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:39.707674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-6msjh" event={"ID":"2918f975-d7ca-4a6b-a373-0338d3c61b56","Type":"ContainerStarted","Data":"e076a785f8433c4df828802ce099fe2af38818852feb3263442f17b01535b51a"} Jul 30 09:59:42.726977 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:42.726938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-6msjh" event={"ID":"2918f975-d7ca-4a6b-a373-0338d3c61b56","Type":"ContainerStarted","Data":"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca"} Jul 30 09:59:42.727370 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:42.727055 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 09:59:42.753929 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:42.753874 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54646dcfcb-6msjh" podStartSLOduration=1.334019744 podStartE2EDuration="3.753859787s" totalImagesPullingTime="2.419840043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 09:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 09:59:42.752040159 +0000 UTC m=+598.278467485" watchObservedRunningTime="2026-07-30 09:59:42.753859787 +0000 UTC m=+598.280287114" Jul 30 09:59:53.734953 ip-10-0-130-75 kubenswrapper[2576]: I0730 09:59:53.734829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 10:00:15.122858 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.122777 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn"] Jul 30 10:00:15.131627 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.131606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.134585 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.134561 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 30 10:00:15.135516 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.135493 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn"] Jul 30 10:00:15.149347 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.149322 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-fswzf"] Jul 30 10:00:15.153583 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.153566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.156538 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.156521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m8pg7\"" Jul 30 10:00:15.165142 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.165119 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-fswzf"] Jul 30 10:00:15.278572 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.278540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6n28\" (UniqueName: \"kubernetes.io/projected/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-kube-api-access-h6n28\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.278759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.278586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5lck\" (UniqueName: \"kubernetes.io/projected/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-kube-api-access-d5lck\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.278759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.278672 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.278759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.278737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.379851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.379758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5lck\" (UniqueName: \"kubernetes.io/projected/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-kube-api-access-d5lck\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.379851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.379815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.380134 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.379884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.380134 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.379973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n28\" (UniqueName: \"kubernetes.io/projected/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-kube-api-access-h6n28\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.380623 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.380601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.380673 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.380603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.387973 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.387945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5lck\" (UniqueName: \"kubernetes.io/projected/d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e-kube-api-access-d5lck\") pod \"payload-pre-processing-687dbb6cf6-twjpn\" (UID: \"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.388094 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.387947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6n28\" (UniqueName: \"kubernetes.io/projected/b50d7de9-4e61-451d-ac8f-4a7587efa3c8-kube-api-access-h6n28\") pod \"payload-processing-5cc6cd444b-fswzf\" (UID: \"b50d7de9-4e61-451d-ac8f-4a7587efa3c8\") " pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.443437 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.443394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:15.464175 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.464145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:15.602407 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.602370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn"] Jul 30 10:00:15.603270 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:00:15.603240 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ebcb7c_2f9a_4aff_8bd3_3946e15b5c5e.slice/crio-08d223b6643476bdfd59c107debace525effd7877bccdb02d9ef3e0028e96b3e WatchSource:0}: Error finding container 08d223b6643476bdfd59c107debace525effd7877bccdb02d9ef3e0028e96b3e: Status 404 returned error can't find the container with id 08d223b6643476bdfd59c107debace525effd7877bccdb02d9ef3e0028e96b3e Jul 30 10:00:15.605170 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.605150 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 10:00:15.824245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.824217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-fswzf"] Jul 30 10:00:15.825958 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:00:15.825926 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50d7de9_4e61_451d_ac8f_4a7587efa3c8.slice/crio-b7f64c453720dc1447449c592bc758b1dcce84518641141a8ddeae2281596ca2 WatchSource:0}: Error finding container b7f64c453720dc1447449c592bc758b1dcce84518641141a8ddeae2281596ca2: Status 404 returned error can't find the container with id b7f64c453720dc1447449c592bc758b1dcce84518641141a8ddeae2281596ca2 Jul 30 10:00:15.902514 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.902473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" event={"ID":"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e","Type":"ContainerStarted","Data":"08d223b6643476bdfd59c107debace525effd7877bccdb02d9ef3e0028e96b3e"} Jul 30 10:00:15.903633 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:15.903605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" event={"ID":"b50d7de9-4e61-451d-ac8f-4a7587efa3c8","Type":"ContainerStarted","Data":"b7f64c453720dc1447449c592bc758b1dcce84518641141a8ddeae2281596ca2"} Jul 30 10:00:18.930100 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.930071 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:18.930486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.930114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" event={"ID":"d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e","Type":"ContainerStarted","Data":"6d695ea8c739faacf784549fe084a01641c95b94b3a881c2a5695cf9e165a203"} Jul 30 10:00:18.930486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.930134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" event={"ID":"b50d7de9-4e61-451d-ac8f-4a7587efa3c8","Type":"ContainerStarted","Data":"e54cc506618f16f36dc2d543f530180935645b5637ace27b8cedb1c5d33ce315"} Jul 30 10:00:18.930486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.930159 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:18.960944 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.960871 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" podStartSLOduration=1.499763805 podStartE2EDuration="3.960850781s" totalImagesPullingTime="2.461086976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:00:18.946780556 +0000 UTC m=+634.473207887" watchObservedRunningTime="2026-07-30 10:00:18.960850781 +0000 UTC m=+634.487278114" Jul 30 10:00:18.961955 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:18.961909 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" podStartSLOduration=1.719896067 podStartE2EDuration="3.961893449s" totalImagesPullingTime="2.241997382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:00:18.960278369 +0000 UTC m=+634.486705690" watchObservedRunningTime="2026-07-30 10:00:18.961893449 +0000 UTC m=+634.488320774" Jul 30 10:00:22.954283 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.954190 2576 generic.go:356] "Generic (PLEG): container finished" podID="5ce966a0-7957-4e2b-b324-88027e3f9115" containerID="68de5bf50e4115488b954497a6d39472f2ee538b9ac9547294c5e46c08afe17a" exitCode=0 Jul 30 10:00:22.954283 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.954257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" event={"ID":"5ce966a0-7957-4e2b-b324-88027e3f9115","Type":"ContainerDied","Data":"68de5bf50e4115488b954497a6d39472f2ee538b9ac9547294c5e46c08afe17a"} Jul 30 10:00:22.954858 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.954767 2576 scope.go:117] "RemoveContainer" containerID="68de5bf50e4115488b954497a6d39472f2ee538b9ac9547294c5e46c08afe17a" Jul 30 10:00:22.955728 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.955703 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:00:22.955798 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.955772 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:00:22.955839 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:22.955806 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:00:23.969183 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:23.969145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" event={"ID":"5ce966a0-7957-4e2b-b324-88027e3f9115","Type":"ContainerStarted","Data":"dd0c6f019854fac5016a936d33300b0388da4098d1bfd9a77a402702ae3cfe1b"} Jul 30 10:00:24.179916 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:24.179890 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 10:00:24.180127 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:24.180106 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-54zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 30 10:00:24.180187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:24.180152 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" podUID="5ce966a0-7957-4e2b-b324-88027e3f9115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 30 10:00:25.180111 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:25.180072 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-54zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 30 10:00:25.180582 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:25.180152 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" podUID="5ce966a0-7957-4e2b-b324-88027e3f9115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 30 10:00:26.179238 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:26.179197 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-54zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 30 10:00:26.179391 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:26.179256 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" podUID="5ce966a0-7957-4e2b-b324-88027e3f9115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 30 10:00:27.179598 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:27.179557 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-54zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 30 10:00:27.179983 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:27.179613 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" podUID="5ce966a0-7957-4e2b-b324-88027e3f9115" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 30 10:00:28.183676 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:28.183644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 10:00:28.184144 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:28.183938 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 10:00:28.184729 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:28.184710 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-54zf6" Jul 30 10:00:29.938120 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:29.938090 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-fswzf" Jul 30 10:00:30.944203 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:30.944176 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-twjpn" Jul 30 10:00:50.195280 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.195241 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff"] Jul 30 10:00:50.200071 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.200039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.202577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.202554 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 30 10:00:50.202710 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.202614 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mcpsp\"" Jul 30 10:00:50.202962 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.202944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 30 10:00:50.203179 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.203164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 30 10:00:50.211689 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.211661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff"] Jul 30 10:00:50.303071 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.303250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.303250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.303250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.303250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4a42aba-2354-4b15-b949-6f27db9cfae9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.303399 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.303308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd79g\" (UniqueName: \"kubernetes.io/projected/b4a42aba-2354-4b15-b949-6f27db9cfae9-kube-api-access-dd79g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404073 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404276 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404276 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404276 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4a42aba-2354-4b15-b949-6f27db9cfae9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404276 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd79g\" (UniqueName: \"kubernetes.io/projected/b4a42aba-2354-4b15-b949-6f27db9cfae9-kube-api-access-dd79g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404276 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404482 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404528 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.404628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.404571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.406339 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.406315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4a42aba-2354-4b15-b949-6f27db9cfae9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.406490 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.406472 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4a42aba-2354-4b15-b949-6f27db9cfae9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.412048 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.412011 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd79g\" (UniqueName: \"kubernetes.io/projected/b4a42aba-2354-4b15-b949-6f27db9cfae9-kube-api-access-dd79g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fjqff\" (UID: \"b4a42aba-2354-4b15-b949-6f27db9cfae9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.511375 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.511290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:00:50.650607 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:50.650579 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff"] Jul 30 10:00:50.652169 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:00:50.652143 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a42aba_2354_4b15_b949_6f27db9cfae9.slice/crio-b2fd60e0ce1112a063d571d71f3f18310386e20878efd763c3018c6de2234573 WatchSource:0}: Error finding container b2fd60e0ce1112a063d571d71f3f18310386e20878efd763c3018c6de2234573: Status 404 returned error can't find the container with id b2fd60e0ce1112a063d571d71f3f18310386e20878efd763c3018c6de2234573 Jul 30 10:00:51.116218 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:51.116179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" event={"ID":"b4a42aba-2354-4b15-b949-6f27db9cfae9","Type":"ContainerStarted","Data":"b2fd60e0ce1112a063d571d71f3f18310386e20878efd763c3018c6de2234573"} Jul 30 10:00:56.146838 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:56.146802 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" event={"ID":"b4a42aba-2354-4b15-b949-6f27db9cfae9","Type":"ContainerStarted","Data":"1b937154610a203797af0dfc6e5984f8dee402c90ecbdb2b404c9ba5a2395850"} Jul 30 10:00:56.163802 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:00:56.163751 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" podStartSLOduration=1.112527417 podStartE2EDuration="6.163735553s" totalImagesPullingTime="5.051208136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:00:56.16234787 +0000 UTC m=+671.688775198" watchObservedRunningTime="2026-07-30 10:00:56.163735553 +0000 UTC m=+671.690162946" Jul 30 10:01:00.512188 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:00.512145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:01:00.512554 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:00.512220 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:01:00.524455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:00.524427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:01:01.185375 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:01.185338 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fjqff" Jul 30 10:01:41.926626 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:41.926554 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p"] Jul 30 10:01:41.928907 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:41.928889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:41.931117 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:01:41.931042 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" podUID="9607f53c-647e-4314-8de0-c0d234ca74d7" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:41.931391 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:01:41.931357 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"premium-simulated-simulated-premium-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-130-75.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-75.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" Jul 30 10:01:41.955019 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:41.954987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p"] Jul 30 10:01:42.083077 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.083077 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.083300 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.083300 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.083300 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.083436 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.083324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzzz\" (UniqueName: \"kubernetes.io/projected/9607f53c-647e-4314-8de0-c0d234ca74d7-kube-api-access-lwzzz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184404 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184404 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzzz\" (UniqueName: \"kubernetes.io/projected/9607f53c-647e-4314-8de0-c0d234ca74d7-kube-api-access-lwzzz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184860 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184909 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184875 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.184944 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.184927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.186791 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.186765 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9607f53c-647e-4314-8de0-c0d234ca74d7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:42.197381 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:42.197351 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzzz\" (UniqueName: \"kubernetes.io/projected/9607f53c-647e-4314-8de0-c0d234ca74d7-kube-api-access-lwzzz\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:43.185113 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:01:43.185077 2576 secret.go:189] Couldn't get secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition Jul 30 10:01:43.185531 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:01:43.185166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs podName:9607f53c-647e-4314-8de0-c0d234ca74d7 nodeName:}" failed. No retries permitted until 2026-07-30 10:01:43.685147894 +0000 UTC m=+719.211575199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs") pod "premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" (UID: "9607f53c-647e-4314-8de0-c0d234ca74d7") : failed to sync secret cache: timed out waiting for the condition Jul 30 10:01:43.281523 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:43.281487 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 30 10:01:43.700399 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:43.700355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:43.702795 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:43.702760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9607f53c-647e-4314-8de0-c0d234ca74d7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p\" (UID: \"9607f53c-647e-4314-8de0-c0d234ca74d7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:43.738608 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:43.738569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:43.877931 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:43.877905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p"] Jul 30 10:01:43.880021 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:01:43.879997 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9607f53c_647e_4314_8de0_c0d234ca74d7.slice/crio-949946b4724041e4777a9fd7d6890dadb0101ed1ae190b792be51ae4725a2c75 WatchSource:0}: Error finding container 949946b4724041e4777a9fd7d6890dadb0101ed1ae190b792be51ae4725a2c75: Status 404 returned error can't find the container with id 949946b4724041e4777a9fd7d6890dadb0101ed1ae190b792be51ae4725a2c75 Jul 30 10:01:44.410380 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:44.410346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" event={"ID":"9607f53c-647e-4314-8de0-c0d234ca74d7","Type":"ContainerStarted","Data":"949946b4724041e4777a9fd7d6890dadb0101ed1ae190b792be51ae4725a2c75"} Jul 30 10:01:49.439713 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:49.439667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" event={"ID":"9607f53c-647e-4314-8de0-c0d234ca74d7","Type":"ContainerStarted","Data":"123e0f4c7191558d5e98a1e60809129d9233e8ebf9b2a70d187d0e052af5fea6"} Jul 30 10:01:49.459678 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:49.459630 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" podStartSLOduration=3.420673929 podStartE2EDuration="8.459616434s" totalImagesPullingTime="5.038942505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:01:49.457778801 +0000 UTC m=+724.984206130" watchObservedRunningTime="2026-07-30 10:01:49.459616434 +0000 UTC m=+724.986043761" Jul 30 10:01:53.739372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:53.739336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:53.739372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:53.739382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:53.751962 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:53.751931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:01:54.479232 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:01:54.479206 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p" Jul 30 10:02:44.524168 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.524128 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66c7d786c6-nbzg2"] Jul 30 10:02:44.527760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.527740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.530547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.530528 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j697b\"" Jul 30 10:02:44.531149 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.531135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 30 10:02:44.537413 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.537392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c7d786c6-nbzg2"] Jul 30 10:02:44.575546 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.575516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwbzz\" (UniqueName: \"kubernetes.io/projected/1c715ed6-ba5d-4665-a113-e1562538bee0-kube-api-access-bwbzz\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.575546 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.575547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c715ed6-ba5d-4665-a113-e1562538bee0-tls-cert\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.676282 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.676248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwbzz\" (UniqueName: \"kubernetes.io/projected/1c715ed6-ba5d-4665-a113-e1562538bee0-kube-api-access-bwbzz\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.676451 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.676284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c715ed6-ba5d-4665-a113-e1562538bee0-tls-cert\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.678627 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.678599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c715ed6-ba5d-4665-a113-e1562538bee0-tls-cert\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.686366 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.686344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwbzz\" (UniqueName: \"kubernetes.io/projected/1c715ed6-ba5d-4665-a113-e1562538bee0-kube-api-access-bwbzz\") pod \"authorino-66c7d786c6-nbzg2\" (UID: \"1c715ed6-ba5d-4665-a113-e1562538bee0\") " pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.840181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.840091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j697b\"" Jul 30 10:02:44.847748 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.847720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66c7d786c6-nbzg2" Jul 30 10:02:44.997712 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:44.997686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66c7d786c6-nbzg2"] Jul 30 10:02:44.999918 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:02:44.999890 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c715ed6_ba5d_4665_a113_e1562538bee0.slice/crio-fc647d5c1db8177964c9804779ba8336d1efcd5a92d2cc4e726d852f06586b82 WatchSource:0}: Error finding container fc647d5c1db8177964c9804779ba8336d1efcd5a92d2cc4e726d852f06586b82: Status 404 returned error can't find the container with id fc647d5c1db8177964c9804779ba8336d1efcd5a92d2cc4e726d852f06586b82 Jul 30 10:02:45.747214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:45.747131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c7d786c6-nbzg2" event={"ID":"1c715ed6-ba5d-4665-a113-e1562538bee0","Type":"ContainerStarted","Data":"0d1f5526c1f54a0ec3c2b22ef39e091fc9f5f5fb901dfe73a1a136db2d9c9e52"} Jul 30 10:02:45.747214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:45.747178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66c7d786c6-nbzg2" event={"ID":"1c715ed6-ba5d-4665-a113-e1562538bee0","Type":"ContainerStarted","Data":"fc647d5c1db8177964c9804779ba8336d1efcd5a92d2cc4e726d852f06586b82"} Jul 30 10:02:45.764927 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:02:45.764875 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66c7d786c6-nbzg2" podStartSLOduration=1.3363783630000001 podStartE2EDuration="1.764859548s" totalImagesPullingTime="428.481185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:02:45.761790361 +0000 UTC m=+781.288217690" watchObservedRunningTime="2026-07-30 10:02:45.764859548 +0000 UTC m=+781.291286931" Jul 30 10:03:35.501341 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.501295 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 10:03:35.501894 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.501541 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54646dcfcb-6msjh" podUID="2918f975-d7ca-4a6b-a373-0338d3c61b56" containerName="manager" containerID="cri-o://604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca" gracePeriod=30 Jul 30 10:03:35.757754 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.757694 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 10:03:35.861778 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.861744 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert\") pod \"2918f975-d7ca-4a6b-a373-0338d3c61b56\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " Jul 30 10:03:35.861946 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.861815 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9vcn\" (UniqueName: \"kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn\") pod \"2918f975-d7ca-4a6b-a373-0338d3c61b56\" (UID: \"2918f975-d7ca-4a6b-a373-0338d3c61b56\") " Jul 30 10:03:35.863951 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.863920 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2918f975-d7ca-4a6b-a373-0338d3c61b56" (UID: "2918f975-d7ca-4a6b-a373-0338d3c61b56"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 10:03:35.864084 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.863996 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn" (OuterVolumeSpecName: "kube-api-access-v9vcn") pod "2918f975-d7ca-4a6b-a373-0338d3c61b56" (UID: "2918f975-d7ca-4a6b-a373-0338d3c61b56"). InnerVolumeSpecName "kube-api-access-v9vcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:03:35.962855 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.962816 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2918f975-d7ca-4a6b-a373-0338d3c61b56-webhook-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:03:35.962855 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:35.962850 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9vcn\" (UniqueName: \"kubernetes.io/projected/2918f975-d7ca-4a6b-a373-0338d3c61b56-kube-api-access-v9vcn\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:03:36.022614 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.022530 2576 generic.go:356] "Generic (PLEG): container finished" podID="2918f975-d7ca-4a6b-a373-0338d3c61b56" containerID="604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca" exitCode=0 Jul 30 10:03:36.022614 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.022584 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54646dcfcb-6msjh" Jul 30 10:03:36.022760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.022620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-6msjh" event={"ID":"2918f975-d7ca-4a6b-a373-0338d3c61b56","Type":"ContainerDied","Data":"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca"} Jul 30 10:03:36.022760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.022673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54646dcfcb-6msjh" event={"ID":"2918f975-d7ca-4a6b-a373-0338d3c61b56","Type":"ContainerDied","Data":"e076a785f8433c4df828802ce099fe2af38818852feb3263442f17b01535b51a"} Jul 30 10:03:36.022760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.022696 2576 scope.go:117] "RemoveContainer" containerID="604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca" Jul 30 10:03:36.032197 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.032179 2576 scope.go:117] "RemoveContainer" containerID="604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca" Jul 30 10:03:36.032434 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:03:36.032412 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca\": container with ID starting with 604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca not found: ID does not exist" containerID="604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca" Jul 30 10:03:36.032526 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.032440 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca"} err="failed to get container status \"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca\": rpc error: code = NotFound desc = could not find container \"604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca\": container with ID starting with 604f5a55370456dc9e4ef0d3ac3fc99214571f2c9707984e61a2c70e762fc6ca not found: ID does not exist" Jul 30 10:03:36.044947 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.044924 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 10:03:36.048735 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.048714 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54646dcfcb-6msjh"] Jul 30 10:03:36.930610 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:03:36.930578 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2918f975-d7ca-4a6b-a373-0338d3c61b56" path="/var/lib/kubelet/pods/2918f975-d7ca-4a6b-a373-0338d3c61b56/volumes" Jul 30 10:12:14.857117 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:14.857042 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 10:12:14.859613 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:14.857282 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" podUID="73ef259f-ac6a-439a-84be-128e1929a0fc" containerName="manager" containerID="cri-o://5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc" gracePeriod=10 Jul 30 10:12:15.114785 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.114722 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 10:12:15.136314 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.136283 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw9mp\" (UniqueName: \"kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp\") pod \"73ef259f-ac6a-439a-84be-128e1929a0fc\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " Jul 30 10:12:15.136483 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.136435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume\") pod \"73ef259f-ac6a-439a-84be-128e1929a0fc\" (UID: \"73ef259f-ac6a-439a-84be-128e1929a0fc\") " Jul 30 10:12:15.136800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.136778 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73ef259f-ac6a-439a-84be-128e1929a0fc" (UID: "73ef259f-ac6a-439a-84be-128e1929a0fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:12:15.138510 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.138483 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp" (OuterVolumeSpecName: "kube-api-access-bw9mp") pod "73ef259f-ac6a-439a-84be-128e1929a0fc" (UID: "73ef259f-ac6a-439a-84be-128e1929a0fc"). InnerVolumeSpecName "kube-api-access-bw9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:12:15.237814 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.237781 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw9mp\" (UniqueName: \"kubernetes.io/projected/73ef259f-ac6a-439a-84be-128e1929a0fc-kube-api-access-bw9mp\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:12:15.237814 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.237810 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73ef259f-ac6a-439a-84be-128e1929a0fc-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:12:15.932233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.932202 2576 generic.go:356] "Generic (PLEG): container finished" podID="73ef259f-ac6a-439a-84be-128e1929a0fc" containerID="5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc" exitCode=0 Jul 30 10:12:15.932709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.932249 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" Jul 30 10:12:15.932709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.932278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" event={"ID":"73ef259f-ac6a-439a-84be-128e1929a0fc","Type":"ContainerDied","Data":"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc"} Jul 30 10:12:15.932709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.932347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z" event={"ID":"73ef259f-ac6a-439a-84be-128e1929a0fc","Type":"ContainerDied","Data":"237d4fc414f34894e1df6aecc8141f60ec4a04b5c1892eea6c1dc9df1d7c824e"} Jul 30 10:12:15.932709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.932375 2576 scope.go:117] "RemoveContainer" containerID="5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc" Jul 30 10:12:15.945553 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.945530 2576 scope.go:117] "RemoveContainer" containerID="5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc" Jul 30 10:12:15.945892 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:12:15.945869 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc\": container with ID starting with 5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc not found: ID does not exist" containerID="5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc" Jul 30 10:12:15.945978 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.945904 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc"} err="failed to get container status \"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc\": rpc error: code = NotFound desc = could not find container \"5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc\": container with ID starting with 5d3a6bce2ab08318508e62e52fd6fc4705d7ef6353ff8f2e813c09ea67bd44dc not found: ID does not exist" Jul 30 10:12:15.956754 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.956719 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 10:12:15.963062 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:15.963013 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qmq8z"] Jul 30 10:12:16.930708 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:12:16.930677 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ef259f-ac6a-439a-84be-128e1929a0fc" path="/var/lib/kubelet/pods/73ef259f-ac6a-439a-84be-128e1929a0fc/volumes" Jul 30 10:13:15.592850 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.592811 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593197 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2918f975-d7ca-4a6b-a373-0338d3c61b56" containerName="manager" Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593209 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2918f975-d7ca-4a6b-a373-0338d3c61b56" containerName="manager" Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593228 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ef259f-ac6a-439a-84be-128e1929a0fc" containerName="manager" Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593234 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ef259f-ac6a-439a-84be-128e1929a0fc" containerName="manager" Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593294 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ef259f-ac6a-439a-84be-128e1929a0fc" containerName="manager" Jul 30 10:13:15.593345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.593303 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2918f975-d7ca-4a6b-a373-0338d3c61b56" containerName="manager" Jul 30 10:13:15.596339 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.596323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.598509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.598483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2cjd\"" Jul 30 10:13:15.611403 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.611379 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:13:15.682387 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.682353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.682387 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.682389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4kv\" (UniqueName: \"kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.783305 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.783266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.783305 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.783304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4kv\" (UniqueName: \"kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.783717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.783694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.794230 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.794204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4kv\" (UniqueName: \"kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv\") pod \"kuadrant-operator-controller-manager-86878c769f-ncblc\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:15.906962 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:15.906929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:16.055088 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:16.055059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:13:16.057292 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:13:16.057259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ef1079_7e48_495c_8947_268793cc3bc2.slice/crio-c69f173db021200800622ee325b73e3ae28ad79875941413ee70238206ab9ed6 WatchSource:0}: Error finding container c69f173db021200800622ee325b73e3ae28ad79875941413ee70238206ab9ed6: Status 404 returned error can't find the container with id c69f173db021200800622ee325b73e3ae28ad79875941413ee70238206ab9ed6 Jul 30 10:13:16.258935 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:16.258822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" event={"ID":"a4ef1079-7e48-495c-8947-268793cc3bc2","Type":"ContainerStarted","Data":"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19"} Jul 30 10:13:16.258935 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:16.258898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:13:16.258935 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:16.258923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" event={"ID":"a4ef1079-7e48-495c-8947-268793cc3bc2","Type":"ContainerStarted","Data":"c69f173db021200800622ee325b73e3ae28ad79875941413ee70238206ab9ed6"} Jul 30 10:13:16.282187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:16.282125 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" podStartSLOduration=1.282106288 podStartE2EDuration="1.282106288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:13:16.279153701 +0000 UTC m=+1411.805581033" watchObservedRunningTime="2026-07-30 10:13:16.282106288 +0000 UTC m=+1411.808533616" Jul 30 10:13:27.274450 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:13:27.274414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:22:17.217103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.217062 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:17.220670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.220653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.226211 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.226189 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a3cc1f19-openshift-default-dockercfg-vfc2j\"" Jul 30 10:22:17.262395 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.262336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:17.321248 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gs8b\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.321675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.321566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422180 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gs8b\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422551 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422551 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422551 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422551 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422551 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422814 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422814 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422724 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422924 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422862 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.422924 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.422866 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.423195 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.423157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.424691 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.424669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.425005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.424985 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.429816 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.429793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.430441 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.430418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gs8b\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b\") pod \"e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.531330 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.531240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:17.669433 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.669404 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:17.671760 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:22:17.671732 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496798b5_e376_422e_9c19_f8c9721477f4.slice/crio-5aa3cf0c99374e7f9315552255ca9a24a1b7d066ec1e8ad7f1273795cb04bcf5 WatchSource:0}: Error finding container 5aa3cf0c99374e7f9315552255ca9a24a1b7d066ec1e8ad7f1273795cb04bcf5: Status 404 returned error can't find the container with id 5aa3cf0c99374e7f9315552255ca9a24a1b7d066ec1e8ad7f1273795cb04bcf5 Jul 30 10:22:17.674235 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.674206 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:17.674340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.674282 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:17.674340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:17.674324 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:18.295943 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:18.295898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerStarted","Data":"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f"} Jul 30 10:22:18.296411 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:18.295965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerStarted","Data":"5aa3cf0c99374e7f9315552255ca9a24a1b7d066ec1e8ad7f1273795cb04bcf5"} Jul 30 10:22:18.315300 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:18.315250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podStartSLOduration=1.3152354210000001 podStartE2EDuration="1.315235421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:18.314101056 +0000 UTC m=+1953.840528386" watchObservedRunningTime="2026-07-30 10:22:18.315235421 +0000 UTC m=+1953.841662785" Jul 30 10:22:18.531851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:18.531802 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:18.536977 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:18.536948 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:19.301357 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:19.301321 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:19.302448 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:19.302425 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:21.526381 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.526334 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:21.529758 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.529741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.532349 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.532324 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a3cc1f19\"" Jul 30 10:22:21.548615 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.548589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:21.582852 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.582816 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:21.586119 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.586104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.588785 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.588754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a3cc1f19-dockercfg-rqcwr\"" Jul 30 10:22:21.598735 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.598707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:21.668878 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.668838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.669104 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.669079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cppj\" (UniqueName: \"kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.770164 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.770125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbbq\" (UniqueName: \"kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.770369 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.770180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.770369 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.770212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.770369 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.770246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cppj\" (UniqueName: \"kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.770894 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.770874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.777909 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.777837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cppj\" (UniqueName: \"kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj\") pod \"payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.840370 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.840324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:21.871586 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.871558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svbbq\" (UniqueName: \"kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.871730 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.871613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.872593 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.872568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.879217 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.879194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbbq\" (UniqueName: \"kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq\") pod \"payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:21.897463 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:21.897423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:22.052811 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.052782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:22.054533 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:22:22.054500 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517f99ed_34b5_4028_a4d1_8def866356c6.slice/crio-5a99cb61e55617f166b19faa0e25f0b99b5f4c9599b6545a330bb504cef4abca WatchSource:0}: Error finding container 5a99cb61e55617f166b19faa0e25f0b99b5f4c9599b6545a330bb504cef4abca: Status 404 returned error can't find the container with id 5a99cb61e55617f166b19faa0e25f0b99b5f4c9599b6545a330bb504cef4abca Jul 30 10:22:22.191226 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.191201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:22.192582 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:22:22.192548 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e389b34_0708_49e6_86c9_6d3999d85ca5.slice/crio-6ca9c25632194c2a7aa5d59a4310acb4f0403abb4d5e465266663beac217e06a WatchSource:0}: Error finding container 6ca9c25632194c2a7aa5d59a4310acb4f0403abb4d5e465266663beac217e06a: Status 404 returned error can't find the container with id 6ca9c25632194c2a7aa5d59a4310acb4f0403abb4d5e465266663beac217e06a Jul 30 10:22:22.321905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.321790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" event={"ID":"517f99ed-34b5-4028-a4d1-8def866356c6","Type":"ContainerStarted","Data":"910f7c42bf208544160fd3803814637f94e36c308793bc8776c3eac126ef85c4"} Jul 30 10:22:22.321905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.321868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" event={"ID":"517f99ed-34b5-4028-a4d1-8def866356c6","Type":"ContainerStarted","Data":"5a99cb61e55617f166b19faa0e25f0b99b5f4c9599b6545a330bb504cef4abca"} Jul 30 10:22:22.321905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.321898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:22.323336 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.323311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" event={"ID":"9e389b34-0708-49e6-86c9-6d3999d85ca5","Type":"ContainerStarted","Data":"05f68e10a9f868e4352a602bf4953fdf60156285fd4860f449f196388f580113"} Jul 30 10:22:22.323432 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.323353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" event={"ID":"9e389b34-0708-49e6-86c9-6d3999d85ca5","Type":"ContainerStarted","Data":"6ca9c25632194c2a7aa5d59a4310acb4f0403abb4d5e465266663beac217e06a"} Jul 30 10:22:22.323432 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.323373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:22.336310 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.336268 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" podStartSLOduration=1.3362528249999999 podStartE2EDuration="1.336252825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:22.335655954 +0000 UTC m=+1957.862083283" watchObservedRunningTime="2026-07-30 10:22:22.336252825 +0000 UTC m=+1957.862680158" Jul 30 10:22:22.349956 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:22.349712 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" podStartSLOduration=1.349692966 podStartE2EDuration="1.349692966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:22.349178118 +0000 UTC m=+1957.875605446" watchObservedRunningTime="2026-07-30 10:22:22.349692966 +0000 UTC m=+1957.876120295" Jul 30 10:22:33.333759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:33.333438 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:33.334293 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:33.333776 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:35.011654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.011346 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": read tcp 10.134.0.2:35074->10.134.0.54:15021: read: connection reset by peer" start-of-body= Jul 30 10:22:35.011654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.011412 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": read tcp 10.134.0.2:35074->10.134.0.54:15021: read: connection reset by peer" Jul 30 10:22:35.409404 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.409371 2576 generic.go:356] "Generic (PLEG): container finished" podID="496798b5-e376-422e-9c19-f8c9721477f4" containerID="8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f" exitCode=0 Jul 30 10:22:35.409579 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.409444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerDied","Data":"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f"} Jul 30 10:22:35.409878 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.409864 2576 scope.go:117] "RemoveContainer" containerID="8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f" Jul 30 10:22:35.410840 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.410817 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:35.410919 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.410906 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:35.410958 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:35.410939 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:36.417506 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:36.417469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerStarted","Data":"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a"} Jul 30 10:22:36.531950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:36.531920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:36.532169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:36.532148 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 30 10:22:36.532220 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:36.532195 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 30 10:22:37.532525 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:37.532489 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 30 10:22:37.532904 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:37.532554 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 30 10:22:38.532437 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:38.532398 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 30 10:22:38.532625 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:38.532455 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 30 10:22:39.531831 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:39.531796 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 30 10:22:39.532014 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:39.531852 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 30 10:22:40.535465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:40.535430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:40.535933 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:40.535740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:40.536410 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:40.536394 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:51.295628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.295588 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:51.296249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.295864 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" podUID="9e389b34-0708-49e6-86c9-6d3999d85ca5" containerName="payload-processing" containerID="cri-o://05f68e10a9f868e4352a602bf4953fdf60156285fd4860f449f196388f580113" gracePeriod=30 Jul 30 10:22:51.302182 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.302152 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:51.302549 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.302501 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" podUID="517f99ed-34b5-4028-a4d1-8def866356c6" containerName="payload-pre-processing" containerID="cri-o://910f7c42bf208544160fd3803814637f94e36c308793bc8776c3eac126ef85c4" gracePeriod=30 Jul 30 10:22:51.505175 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.505021 2576 generic.go:356] "Generic (PLEG): container finished" podID="517f99ed-34b5-4028-a4d1-8def866356c6" containerID="910f7c42bf208544160fd3803814637f94e36c308793bc8776c3eac126ef85c4" exitCode=0 Jul 30 10:22:51.505175 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.505064 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" event={"ID":"517f99ed-34b5-4028-a4d1-8def866356c6","Type":"ContainerDied","Data":"910f7c42bf208544160fd3803814637f94e36c308793bc8776c3eac126ef85c4"} Jul 30 10:22:51.507129 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.507101 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e389b34-0708-49e6-86c9-6d3999d85ca5" containerID="05f68e10a9f868e4352a602bf4953fdf60156285fd4860f449f196388f580113" exitCode=0 Jul 30 10:22:51.507313 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.507141 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" event={"ID":"9e389b34-0708-49e6-86c9-6d3999d85ca5","Type":"ContainerDied","Data":"05f68e10a9f868e4352a602bf4953fdf60156285fd4860f449f196388f580113"} Jul 30 10:22:51.560102 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.558940 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:51.560102 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.559276 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" containerID="cri-o://61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a" gracePeriod=30 Jul 30 10:22:51.609295 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.609268 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:51.613453 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.613431 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:51.777869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.777832 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svbbq\" (UniqueName: \"kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq\") pod \"517f99ed-34b5-4028-a4d1-8def866356c6\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " Jul 30 10:22:51.778017 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.777904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume\") pod \"9e389b34-0708-49e6-86c9-6d3999d85ca5\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " Jul 30 10:22:51.778017 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.777973 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cppj\" (UniqueName: \"kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj\") pod \"9e389b34-0708-49e6-86c9-6d3999d85ca5\" (UID: \"9e389b34-0708-49e6-86c9-6d3999d85ca5\") " Jul 30 10:22:51.778162 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.778020 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume\") pod \"517f99ed-34b5-4028-a4d1-8def866356c6\" (UID: \"517f99ed-34b5-4028-a4d1-8def866356c6\") " Jul 30 10:22:51.778296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.778270 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e389b34-0708-49e6-86c9-6d3999d85ca5" (UID: "9e389b34-0708-49e6-86c9-6d3999d85ca5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:22:51.778439 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.778415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "517f99ed-34b5-4028-a4d1-8def866356c6" (UID: "517f99ed-34b5-4028-a4d1-8def866356c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:22:51.779998 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.779977 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq" (OuterVolumeSpecName: "kube-api-access-svbbq") pod "517f99ed-34b5-4028-a4d1-8def866356c6" (UID: "517f99ed-34b5-4028-a4d1-8def866356c6"). InnerVolumeSpecName "kube-api-access-svbbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:22:51.780080 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.780007 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj" (OuterVolumeSpecName: "kube-api-access-7cppj") pod "9e389b34-0708-49e6-86c9-6d3999d85ca5" (UID: "9e389b34-0708-49e6-86c9-6d3999d85ca5"). InnerVolumeSpecName "kube-api-access-7cppj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:22:51.879169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.879138 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/517f99ed-34b5-4028-a4d1-8def866356c6-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:51.879169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.879163 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svbbq\" (UniqueName: \"kubernetes.io/projected/517f99ed-34b5-4028-a4d1-8def866356c6-kube-api-access-svbbq\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:51.879169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.879172 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e389b34-0708-49e6-86c9-6d3999d85ca5-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:51.879383 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:51.879182 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cppj\" (UniqueName: \"kubernetes.io/projected/9e389b34-0708-49e6-86c9-6d3999d85ca5-kube-api-access-7cppj\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:52.515002 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.514970 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" Jul 30 10:22:52.515452 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.515010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4" event={"ID":"517f99ed-34b5-4028-a4d1-8def866356c6","Type":"ContainerDied","Data":"5a99cb61e55617f166b19faa0e25f0b99b5f4c9599b6545a330bb504cef4abca"} Jul 30 10:22:52.515452 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.515097 2576 scope.go:117] "RemoveContainer" containerID="910f7c42bf208544160fd3803814637f94e36c308793bc8776c3eac126ef85c4" Jul 30 10:22:52.516506 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.516487 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" Jul 30 10:22:52.516506 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.516499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh" event={"ID":"9e389b34-0708-49e6-86c9-6d3999d85ca5","Type":"ContainerDied","Data":"6ca9c25632194c2a7aa5d59a4310acb4f0403abb4d5e465266663beac217e06a"} Jul 30 10:22:52.524058 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.524012 2576 scope.go:117] "RemoveContainer" containerID="05f68e10a9f868e4352a602bf4953fdf60156285fd4860f449f196388f580113" Jul 30 10:22:52.543158 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.543137 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:52.548874 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.548852 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a3cc1f19-6b9799dc4b-c89bh"] Jul 30 10:22:52.568768 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.568708 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:52.592258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.592226 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a3cc1f19-84885fdb8-tsmk4"] Jul 30 10:22:52.693885 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.693850 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:22:52.694366 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694298 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517f99ed-34b5-4028-a4d1-8def866356c6" containerName="payload-pre-processing" Jul 30 10:22:52.694366 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694330 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517f99ed-34b5-4028-a4d1-8def866356c6" containerName="payload-pre-processing" Jul 30 10:22:52.694538 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694378 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e389b34-0708-49e6-86c9-6d3999d85ca5" containerName="payload-processing" Jul 30 10:22:52.694538 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694385 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e389b34-0708-49e6-86c9-6d3999d85ca5" containerName="payload-processing" Jul 30 10:22:52.694538 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694496 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="517f99ed-34b5-4028-a4d1-8def866356c6" containerName="payload-pre-processing" Jul 30 10:22:52.694538 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.694510 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e389b34-0708-49e6-86c9-6d3999d85ca5" containerName="payload-processing" Jul 30 10:22:52.699095 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.699079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.701922 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.701908 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4daf5ef5-gw-openshift-default-dockercfg-lvhff\"" Jul 30 10:22:52.715408 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.715386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:22:52.787374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787566 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787566 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787566 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787566 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbd5g\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787790 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787790 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787790 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.787790 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.787738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888278 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888477 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888292 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888477 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888596 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888652 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbd5g\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888810 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888767 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888810 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888921 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.888993 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.888948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.889099 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.889057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.889099 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.889084 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.889218 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.889145 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.890927 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.890907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.891053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.890925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.895592 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.895558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.896211 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.896190 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbd5g\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g\") pod \"e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:52.937760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.937723 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="517f99ed-34b5-4028-a4d1-8def866356c6" path="/var/lib/kubelet/pods/517f99ed-34b5-4028-a4d1-8def866356c6/volumes" Jul 30 10:22:52.938165 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:52.938150 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e389b34-0708-49e6-86c9-6d3999d85ca5" path="/var/lib/kubelet/pods/9e389b34-0708-49e6-86c9-6d3999d85ca5/volumes" Jul 30 10:22:53.009261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.009230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:53.155469 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.155445 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:22:53.157540 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:22:53.157511 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9484add8_f053_4c11_a325_99bc2ec96a4f.slice/crio-ab9487ca811b702d323cd3bc1b6cbba01f7cee7e598209150753217bd26b95a8 WatchSource:0}: Error finding container ab9487ca811b702d323cd3bc1b6cbba01f7cee7e598209150753217bd26b95a8: Status 404 returned error can't find the container with id ab9487ca811b702d323cd3bc1b6cbba01f7cee7e598209150753217bd26b95a8 Jul 30 10:22:53.159721 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.159683 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:53.159789 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.159770 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:53.159830 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.159807 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:22:53.524570 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.524460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerStarted","Data":"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369"} Jul 30 10:22:53.524570 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.524528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerStarted","Data":"ab9487ca811b702d323cd3bc1b6cbba01f7cee7e598209150753217bd26b95a8"} Jul 30 10:22:53.545947 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:53.545885 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podStartSLOduration=1.545868151 podStartE2EDuration="1.545868151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:53.542934589 +0000 UTC m=+1989.069361917" watchObservedRunningTime="2026-07-30 10:22:53.545868151 +0000 UTC m=+1989.072295480" Jul 30 10:22:54.010214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:54.010174 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:54.015168 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:54.015141 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:54.531156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:54.531125 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:54.532196 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:54.532175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:22:55.538064 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.538009 2576 patch_prober.go:28] interesting pod/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:22:55.538423 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.538099 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:22:55.800201 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.800052 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:22:55.803833 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.803814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:55.806164 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.806145 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4daf5ef5\"" Jul 30 10:22:55.806272 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.806144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-4daf5ef5-dockercfg-d67gc\"" Jul 30 10:22:55.813203 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.813177 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:22:55.920196 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.920161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:55.920374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:55.920217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k84bs\" (UniqueName: \"kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.021509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.021474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.021669 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.021547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k84bs\" (UniqueName: \"kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.022139 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.022118 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.033561 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.033540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k84bs\" (UniqueName: \"kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs\") pod \"payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.115494 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.115463 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.250072 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.250042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:22:56.251962 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:22:56.251930 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc293530d_953a_46c7_8006_ae94b8152389.slice/crio-41d14498ed5a3d626cf550e807fc16d9764618aa24596874ff54432b744270db WatchSource:0}: Error finding container 41d14498ed5a3d626cf550e807fc16d9764618aa24596874ff54432b744270db: Status 404 returned error can't find the container with id 41d14498ed5a3d626cf550e807fc16d9764618aa24596874ff54432b744270db Jul 30 10:22:56.546186 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.546071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" event={"ID":"c293530d-953a-46c7-8006-ae94b8152389","Type":"ContainerStarted","Data":"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1"} Jul 30 10:22:56.546186 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.546144 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" event={"ID":"c293530d-953a-46c7-8006-ae94b8152389","Type":"ContainerStarted","Data":"41d14498ed5a3d626cf550e807fc16d9764618aa24596874ff54432b744270db"} Jul 30 10:22:56.546705 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.546337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:22:56.565148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.564967 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" podStartSLOduration=1.564948098 podStartE2EDuration="1.564948098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:22:56.560664844 +0000 UTC m=+1992.087092172" watchObservedRunningTime="2026-07-30 10:22:56.564948098 +0000 UTC m=+1992.091375429" Jul 30 10:22:56.838225 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.838200 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:56.930980 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.930954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931010 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931069 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931106 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gs8b\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931173 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket\") pod \"496798b5-e376-422e-9c19-f8c9721477f4\" (UID: \"496798b5-e376-422e-9c19-f8c9721477f4\") " Jul 30 10:22:56.931444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:22:56.931661 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931623 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:22:56.931661 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931629 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:22:56.931764 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931705 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:56.931874 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.931855 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:22:56.932349 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.932316 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:22:56.933293 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.933269 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:22:56.933612 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.933577 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b" (OuterVolumeSpecName: "kube-api-access-7gs8b") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "kube-api-access-7gs8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:22:56.933716 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.933617 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:22:56.933716 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:56.933688 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "496798b5-e376-422e-9c19-f8c9721477f4" (UID: "496798b5-e376-422e-9c19-f8c9721477f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:22:57.033073 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033011 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033073 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033065 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/496798b5-e376-422e-9c19-f8c9721477f4-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033073 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033074 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/496798b5-e376-422e-9c19-f8c9721477f4-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033073 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033081 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033091 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033099 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033107 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/496798b5-e376-422e-9c19-f8c9721477f4-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.033405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.033116 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gs8b\" (UniqueName: \"kubernetes.io/projected/496798b5-e376-422e-9c19-f8c9721477f4-kube-api-access-7gs8b\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:22:57.554678 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.554644 2576 generic.go:356] "Generic (PLEG): container finished" podID="496798b5-e376-422e-9c19-f8c9721477f4" containerID="61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a" exitCode=0 Jul 30 10:22:57.555137 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.554688 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" Jul 30 10:22:57.555137 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.554728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerDied","Data":"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a"} Jul 30 10:22:57.555137 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.554785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d" event={"ID":"496798b5-e376-422e-9c19-f8c9721477f4","Type":"ContainerDied","Data":"5aa3cf0c99374e7f9315552255ca9a24a1b7d066ec1e8ad7f1273795cb04bcf5"} Jul 30 10:22:57.555137 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.554808 2576 scope.go:117] "RemoveContainer" containerID="61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a" Jul 30 10:22:57.564536 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.564521 2576 scope.go:117] "RemoveContainer" containerID="8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f" Jul 30 10:22:57.573102 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.573083 2576 scope.go:117] "RemoveContainer" containerID="61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a" Jul 30 10:22:57.573411 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:22:57.573384 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a\": container with ID starting with 61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a not found: ID does not exist" containerID="61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a" Jul 30 10:22:57.573557 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.573421 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a"} err="failed to get container status \"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a\": rpc error: code = NotFound desc = could not find container \"61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a\": container with ID starting with 61a871729faa1aaf242a61cd643df1a888dcaa4e5de6c378709c0f1a5bb5f02a not found: ID does not exist" Jul 30 10:22:57.573557 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.573445 2576 scope.go:117] "RemoveContainer" containerID="8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f" Jul 30 10:22:57.573766 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:22:57.573708 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f\": container with ID starting with 8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f not found: ID does not exist" containerID="8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f" Jul 30 10:22:57.573766 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.573734 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f"} err="failed to get container status \"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f\": rpc error: code = NotFound desc = could not find container \"8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f\": container with ID starting with 8c67ead4f62aaaf940ac7bc8fe9dabf5097dca15e9082cee5c7f695e89ad5d0f not found: ID does not exist" Jul 30 10:22:57.576464 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.576444 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:57.579989 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:57.579961 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a3cc1f19-openshift-default-7c58ddcf98-9p25d"] Jul 30 10:22:58.930844 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:22:58.930810 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="496798b5-e376-422e-9c19-f8c9721477f4" path="/var/lib/kubelet/pods/496798b5-e376-422e-9c19-f8c9721477f4/volumes" Jul 30 10:23:07.557608 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:07.557574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:23:08.623994 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.623953 2576 generic.go:356] "Generic (PLEG): container finished" podID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerID="34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369" exitCode=0 Jul 30 10:23:08.624487 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.624022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerDied","Data":"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369"} Jul 30 10:23:08.624487 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.624460 2576 scope.go:117] "RemoveContainer" containerID="34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369" Jul 30 10:23:08.625481 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.625454 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:08.625572 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.625534 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:08.625635 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:08.625580 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:09.531383 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:09.531344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:09.631288 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:09.631248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerStarted","Data":"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d"} Jul 30 10:23:10.010353 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:10.010310 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:10.011461 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:10.011427 2576 patch_prober.go:28] interesting pod/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 30 10:23:10.011599 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:10.011479 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 30 10:23:11.009813 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:11.009779 2576 patch_prober.go:28] interesting pod/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 30 10:23:11.010214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:11.009833 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 30 10:23:12.010277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:12.010246 2576 patch_prober.go:28] interesting pod/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 30 10:23:12.010642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:12.010308 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 30 10:23:13.010090 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:13.010059 2576 patch_prober.go:28] interesting pod/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 30 10:23:13.010262 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:13.010111 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 30 10:23:14.014307 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:14.014272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:14.014716 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:14.014553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:14.015313 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:14.015295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:25.735367 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:25.735330 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:23:25.735986 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:25.735575 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" podUID="c293530d-953a-46c7-8006-ae94b8152389" containerName="payload-pre-processing" containerID="cri-o://0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1" gracePeriod=30 Jul 30 10:23:26.002790 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.002705 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:23:26.011227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.011197 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:23:26.011499 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.011427 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" containerID="cri-o://afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d" gracePeriod=30 Jul 30 10:23:26.118329 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.117563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k84bs\" (UniqueName: \"kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs\") pod \"c293530d-953a-46c7-8006-ae94b8152389\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " Jul 30 10:23:26.118329 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.117638 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume\") pod \"c293530d-953a-46c7-8006-ae94b8152389\" (UID: \"c293530d-953a-46c7-8006-ae94b8152389\") " Jul 30 10:23:26.118329 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.118262 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c293530d-953a-46c7-8006-ae94b8152389" (UID: "c293530d-953a-46c7-8006-ae94b8152389"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:23:26.120311 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.120273 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs" (OuterVolumeSpecName: "kube-api-access-k84bs") pod "c293530d-953a-46c7-8006-ae94b8152389" (UID: "c293530d-953a-46c7-8006-ae94b8152389"). InnerVolumeSpecName "kube-api-access-k84bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:23:26.218916 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.218885 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c293530d-953a-46c7-8006-ae94b8152389-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:26.218916 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.218911 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k84bs\" (UniqueName: \"kubernetes.io/projected/c293530d-953a-46c7-8006-ae94b8152389-kube-api-access-k84bs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:26.746336 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.746294 2576 generic.go:356] "Generic (PLEG): container finished" podID="c293530d-953a-46c7-8006-ae94b8152389" containerID="0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1" exitCode=0 Jul 30 10:23:26.746826 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.746353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" event={"ID":"c293530d-953a-46c7-8006-ae94b8152389","Type":"ContainerDied","Data":"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1"} Jul 30 10:23:26.746826 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.746384 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" Jul 30 10:23:26.746826 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.746438 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl" event={"ID":"c293530d-953a-46c7-8006-ae94b8152389","Type":"ContainerDied","Data":"41d14498ed5a3d626cf550e807fc16d9764618aa24596874ff54432b744270db"} Jul 30 10:23:26.746826 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.746474 2576 scope.go:117] "RemoveContainer" containerID="0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1" Jul 30 10:23:26.757342 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.757317 2576 scope.go:117] "RemoveContainer" containerID="0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1" Jul 30 10:23:26.757753 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:23:26.757724 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1\": container with ID starting with 0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1 not found: ID does not exist" containerID="0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1" Jul 30 10:23:26.757929 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.757899 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1"} err="failed to get container status \"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1\": rpc error: code = NotFound desc = could not find container \"0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1\": container with ID starting with 0fcadd44fdf336d58bb0721122769231e7c85d9cdd78646f510e436cef52b2e1 not found: ID does not exist" Jul 30 10:23:26.769792 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.769764 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:23:26.778065 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.778018 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-4daf5ef5-7ddf65fd7b-xmxkl"] Jul 30 10:23:26.819440 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819409 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:23:26.819836 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819823 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:23:26.819882 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819838 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:23:26.819882 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819858 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:23:26.819882 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819864 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:23:26.819882 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819870 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c293530d-953a-46c7-8006-ae94b8152389" containerName="payload-pre-processing" Jul 30 10:23:26.819882 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819875 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c293530d-953a-46c7-8006-ae94b8152389" containerName="payload-pre-processing" Jul 30 10:23:26.820110 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819941 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:23:26.820110 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.819953 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c293530d-953a-46c7-8006-ae94b8152389" containerName="payload-pre-processing" Jul 30 10:23:26.824492 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.824473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.826561 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.826540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-237c0540-openshift-default-dockercfg-568sn\"" Jul 30 10:23:26.832952 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.832926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:23:26.925500 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925500 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24rv\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.925771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.926113 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.925777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:26.932150 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:26.932122 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c293530d-953a-46c7-8006-ae94b8152389" path="/var/lib/kubelet/pods/c293530d-953a-46c7-8006-ae94b8152389/volumes" Jul 30 10:23:27.026818 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.026736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24rv\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.026818 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.026778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027050 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027173 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027339 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027339 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027471 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027449 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027661 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027830 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.027907 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.027729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.028140 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.028123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.029311 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.029291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.029398 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.029308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.033992 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.033971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24rv\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.034091 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.033987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token\") pod \"e2e-ait-237c0540-openshift-default-78648d5848-cht7m\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.136097 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.136063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:27.278492 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.278466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:23:27.279935 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:23:27.279904 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778ab1c2_c2f9_4c4b_93df_5a27ab9ef997.slice/crio-108b0b6dae3478029e5f45f665448955e896de534847f5218158f6165c17da88 WatchSource:0}: Error finding container 108b0b6dae3478029e5f45f665448955e896de534847f5218158f6165c17da88: Status 404 returned error can't find the container with id 108b0b6dae3478029e5f45f665448955e896de534847f5218158f6165c17da88 Jul 30 10:23:27.282045 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.281998 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:27.282152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.282104 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:27.282152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.282140 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:27.754355 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.754322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerStarted","Data":"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0"} Jul 30 10:23:27.754802 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.754384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerStarted","Data":"108b0b6dae3478029e5f45f665448955e896de534847f5218158f6165c17da88"} Jul 30 10:23:27.771082 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:27.771009 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podStartSLOduration=1.770986975 podStartE2EDuration="1.770986975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:23:27.77076299 +0000 UTC m=+2023.297190324" watchObservedRunningTime="2026-07-30 10:23:27.770986975 +0000 UTC m=+2023.297414305" Jul 30 10:23:28.136488 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:28.136458 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:28.141732 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:28.141706 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:28.761094 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:28.761066 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:28.761957 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:28.761940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:29.016834 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:29.016754 2576 patch_prober.go:28] interesting pod/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:23:29.016834 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:29.016815 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:23:31.258840 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.258815 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:31.373046 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.372996 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373222 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373222 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373236 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:23:31.373340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373271 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbd5g\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373496 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373369 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373496 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373422 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373496 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373462 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373641 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373494 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token\") pod \"9484add8-f053-4c11-a325-99bc2ec96a4f\" (UID: \"9484add8-f053-4c11-a325-99bc2ec96a4f\") " Jul 30 10:23:31.373641 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373494 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:23:31.373641 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373531 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:23:31.373641 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373622 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:23:31.373868 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373845 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.373868 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373870 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.374103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373883 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9484add8-f053-4c11-a325-99bc2ec96a4f-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.374103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.373892 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.374294 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.374272 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:23:31.375406 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.375378 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:23:31.375524 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.375497 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:23:31.375789 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.375770 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:23:31.375856 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.375770 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g" (OuterVolumeSpecName: "kube-api-access-mbd5g") pod "9484add8-f053-4c11-a325-99bc2ec96a4f" (UID: "9484add8-f053-4c11-a325-99bc2ec96a4f"). InnerVolumeSpecName "kube-api-access-mbd5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:23:31.475291 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.475257 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.475291 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.475285 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbd5g\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-kube-api-access-mbd5g\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.475291 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.475296 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.475525 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.475306 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.475525 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.475314 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9484add8-f053-4c11-a325-99bc2ec96a4f-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:23:31.780353 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.780257 2576 generic.go:356] "Generic (PLEG): container finished" podID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerID="afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d" exitCode=0 Jul 30 10:23:31.780353 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.780299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerDied","Data":"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d"} Jul 30 10:23:31.780581 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.780310 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" Jul 30 10:23:31.780581 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.780366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4" event={"ID":"9484add8-f053-4c11-a325-99bc2ec96a4f","Type":"ContainerDied","Data":"ab9487ca811b702d323cd3bc1b6cbba01f7cee7e598209150753217bd26b95a8"} Jul 30 10:23:31.780581 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.780398 2576 scope.go:117] "RemoveContainer" containerID="afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d" Jul 30 10:23:31.790997 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.790977 2576 scope.go:117] "RemoveContainer" containerID="34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369" Jul 30 10:23:31.799410 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.799365 2576 scope.go:117] "RemoveContainer" containerID="afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d" Jul 30 10:23:31.799612 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:23:31.799585 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d\": container with ID starting with afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d not found: ID does not exist" containerID="afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d" Jul 30 10:23:31.799688 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.799624 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d"} err="failed to get container status \"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d\": rpc error: code = NotFound desc = could not find container \"afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d\": container with ID starting with afbc2d2c8172f906439ca1a62816024e51c22149f7c77211ba698ef04a3aa58d not found: ID does not exist" Jul 30 10:23:31.799688 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.799650 2576 scope.go:117] "RemoveContainer" containerID="34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369" Jul 30 10:23:31.800092 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:23:31.799997 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369\": container with ID starting with 34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369 not found: ID does not exist" containerID="34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369" Jul 30 10:23:31.800261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.800228 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369"} err="failed to get container status \"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369\": rpc error: code = NotFound desc = could not find container \"34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369\": container with ID starting with 34d07d07cc2cedbf132c1f40908a4348b6a1b840f67575ff3ade0e93dd642369 not found: ID does not exist" Jul 30 10:23:31.802686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.802668 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:23:31.806422 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:31.806401 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4daf5ef5-gw-openshift-default-847bb595dd-nlfr4"] Jul 30 10:23:32.930553 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:32.930521 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" path="/var/lib/kubelet/pods/9484add8-f053-4c11-a325-99bc2ec96a4f/volumes" Jul 30 10:23:43.762900 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.762861 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 30 10:23:43.763930 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.762925 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 30 10:23:43.853942 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.853905 2576 generic.go:356] "Generic (PLEG): container finished" podID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerID="295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0" exitCode=0 Jul 30 10:23:43.854143 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.853979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerDied","Data":"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0"} Jul 30 10:23:43.854464 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.854434 2576 scope.go:117] "RemoveContainer" containerID="295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0" Jul 30 10:23:43.855450 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.855421 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:43.855555 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.855493 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:43.855555 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:43.855528 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:23:44.867940 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:44.867905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerStarted","Data":"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3"} Jul 30 10:23:45.136468 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:45.136364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:45.136654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:45.136626 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 30 10:23:45.136737 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:45.136688 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 30 10:23:46.137374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:46.137341 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 30 10:23:46.137769 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:46.137403 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 30 10:23:47.136623 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:47.136568 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 30 10:23:47.136832 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:47.136676 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 30 10:23:48.136417 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:48.136384 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 30 10:23:48.136783 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:48.136449 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 30 10:23:49.140439 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:49.140404 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:49.140911 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:49.140840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:23:49.141543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:23:49.141526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:24:02.026048 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.026005 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:24:02.026482 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.026231 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" containerID="cri-o://236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3" gracePeriod=30 Jul 30 10:24:02.783982 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.783944 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:02.784547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.784524 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:24:02.784547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.784548 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:24:02.784676 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.784662 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="496798b5-e376-422e-9c19-f8c9721477f4" containerName="istio-proxy" Jul 30 10:24:02.784676 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.784672 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:24:02.784747 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.784680 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:24:02.786704 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.786686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.788898 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.788874 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f9b729be-openshift-default-dockercfg-rttgs\"" Jul 30 10:24:02.798983 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.798958 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:02.867204 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867390 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867390 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbn8\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867390 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.867550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.867532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbn8\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968343 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968889 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.968950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.968885 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.969060 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.969023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.969152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.969092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.969398 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.969379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.970717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.970691 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.971100 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.971080 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.977574 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.977551 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:02.977867 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:02.977845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbn8\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8\") pod \"e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:03.097945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.097849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:03.243174 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.243143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:03.245135 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:24:03.245103 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431ba037_cea6_4238_b44f_9ef07b0c3f78.slice/crio-45c9f711c584bb53c664e4609adb06648f403a3d153e8dee0925e635f6b7c1c5 WatchSource:0}: Error finding container 45c9f711c584bb53c664e4609adb06648f403a3d153e8dee0925e635f6b7c1c5: Status 404 returned error can't find the container with id 45c9f711c584bb53c664e4609adb06648f403a3d153e8dee0925e635f6b7c1c5 Jul 30 10:24:03.255355 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.247939 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:03.255355 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.248159 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:03.255355 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.248261 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:03.976100 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.976061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerStarted","Data":"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed"} Jul 30 10:24:03.976323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.976129 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerStarted","Data":"45c9f711c584bb53c664e4609adb06648f403a3d153e8dee0925e635f6b7c1c5"} Jul 30 10:24:03.999017 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:03.998959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podStartSLOduration=1.998942194 podStartE2EDuration="1.998942194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:24:03.997775367 +0000 UTC m=+2059.524202694" watchObservedRunningTime="2026-07-30 10:24:03.998942194 +0000 UTC m=+2059.525369521" Jul 30 10:24:04.098116 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:04.098073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:04.099717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:04.099690 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:04.099849 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:04.099744 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:04.143988 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:04.143945 2576 patch_prober.go:28] interesting pod/e2e-ait-237c0540-openshift-default-78648d5848-cht7m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:24:04.144186 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:04.144008 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:24:05.102960 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:05.102930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:05.987711 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:05.987677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:05.988750 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:05.988728 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:07.316987 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.316961 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:24:07.413306 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413277 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413306 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413309 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q24rv\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413358 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413379 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413402 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413474 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413519 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413873 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413541 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:07.413873 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413574 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket\") pod \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\" (UID: \"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997\") " Jul 30 10:24:07.413873 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413793 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:07.414053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413797 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:24:07.414053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413964 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.414053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.414000 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.414053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.414017 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.414053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.413968 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:07.414336 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.414230 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data" (OuterVolumeSpecName: "istio-data") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:07.415761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.415732 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token" (OuterVolumeSpecName: "istio-token") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:24:07.415887 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.415722 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv" (OuterVolumeSpecName: "kube-api-access-q24rv") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "kube-api-access-q24rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:24:07.415887 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.415832 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:07.415980 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.415956 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" (UID: "778ab1c2-c2f9-4c4b-93df-5a27ab9ef997"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:24:07.514771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514730 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.514771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514765 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.514771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514775 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.514771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514784 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q24rv\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-kube-api-access-q24rv\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.515005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514794 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:07.515005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:07.514802 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:08.000566 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.000532 2576 generic.go:356] "Generic (PLEG): container finished" podID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerID="236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3" exitCode=0 Jul 30 10:24:08.000784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.000581 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" Jul 30 10:24:08.000784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.000628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerDied","Data":"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3"} Jul 30 10:24:08.000784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.000683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m" event={"ID":"778ab1c2-c2f9-4c4b-93df-5a27ab9ef997","Type":"ContainerDied","Data":"108b0b6dae3478029e5f45f665448955e896de534847f5218158f6165c17da88"} Jul 30 10:24:08.000784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.000706 2576 scope.go:117] "RemoveContainer" containerID="236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3" Jul 30 10:24:08.013713 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.013697 2576 scope.go:117] "RemoveContainer" containerID="295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0" Jul 30 10:24:08.022132 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.022113 2576 scope.go:117] "RemoveContainer" containerID="236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3" Jul 30 10:24:08.022416 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:24:08.022397 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3\": container with ID starting with 236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3 not found: ID does not exist" containerID="236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3" Jul 30 10:24:08.022465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.022425 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3"} err="failed to get container status \"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3\": rpc error: code = NotFound desc = could not find container \"236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3\": container with ID starting with 236b7836241c2d5b3aba6ebed11951ef14551c1df181de3585a8348354eaddc3 not found: ID does not exist" Jul 30 10:24:08.022465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.022445 2576 scope.go:117] "RemoveContainer" containerID="295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0" Jul 30 10:24:08.022678 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:24:08.022658 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0\": container with ID starting with 295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0 not found: ID does not exist" containerID="295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0" Jul 30 10:24:08.022740 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.022686 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0"} err="failed to get container status \"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0\": rpc error: code = NotFound desc = could not find container \"295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0\": container with ID starting with 295ae709834832a27e3030ad5a9bac54d9a5fdb1906064bce86d28050ba758f0 not found: ID does not exist" Jul 30 10:24:08.023845 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.023826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:24:08.027639 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.027618 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-237c0540-openshift-default-78648d5848-cht7m"] Jul 30 10:24:08.930891 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:08.930854 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" path="/var/lib/kubelet/pods/778ab1c2-c2f9-4c4b-93df-5a27ab9ef997/volumes" Jul 30 10:24:20.989472 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:20.989437 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:20.989865 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:20.989507 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:21.083005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.082915 2576 generic.go:356] "Generic (PLEG): container finished" podID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerID="4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed" exitCode=0 Jul 30 10:24:21.083005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.082988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerDied","Data":"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed"} Jul 30 10:24:21.083440 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.083425 2576 scope.go:117] "RemoveContainer" containerID="4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed" Jul 30 10:24:21.084535 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.084507 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:21.084604 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.084589 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:21.084646 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:21.084629 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:24:22.090362 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:22.090322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerStarted","Data":"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8"} Jul 30 10:24:22.098370 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:22.098346 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:22.098560 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:22.098540 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:22.098612 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:22.098594 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:23.098692 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:23.098657 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:23.099093 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:23.098709 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:24.098354 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:24.098316 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:24.098546 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:24.098377 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:25.099052 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:25.098984 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:25.099444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:25.099071 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:26.098965 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:26.098924 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 30 10:24:26.099173 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:26.098991 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 30 10:24:27.102650 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:27.102620 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:27.103064 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:27.102883 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:27.103498 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:27.103480 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:37.171407 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:37.171367 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:37.171910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:37.171638 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" containerID="cri-o://970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8" gracePeriod=30 Jul 30 10:24:42.106087 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.106022 2576 patch_prober.go:28] interesting pod/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 30 10:24:42.106487 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.106151 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:24:42.433934 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.433900 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:42.575800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.575764 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576002 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.575819 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576002 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.575841 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkbn8\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576002 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.575858 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576002 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.575884 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576097 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576119 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576204 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576246 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo\") pod \"431ba037-cea6-4238-b44f-9ef07b0c3f78\" (UID: \"431ba037-cea6-4238-b44f-9ef07b0c3f78\") " Jul 30 10:24:42.576297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576275 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:42.576615 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576370 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:42.576673 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576642 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:24:42.576673 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576660 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.576786 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576681 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.576786 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576700 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.576786 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.576768 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data" (OuterVolumeSpecName: "istio-data") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:42.578125 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.578095 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8" (OuterVolumeSpecName: "kube-api-access-hkbn8") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "kube-api-access-hkbn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:24:42.578503 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.578475 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:24:42.578617 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.578532 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token" (OuterVolumeSpecName: "istio-token") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:24:42.578617 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.578597 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "431ba037-cea6-4238-b44f-9ef07b0c3f78" (UID: "431ba037-cea6-4238-b44f-9ef07b0c3f78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677681 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677723 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkbn8\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-kube-api-access-hkbn8\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677738 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677750 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431ba037-cea6-4238-b44f-9ef07b0c3f78-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677761 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:42.677780 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:42.677772 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431ba037-cea6-4238-b44f-9ef07b0c3f78-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:24:43.216155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.216071 2576 generic.go:356] "Generic (PLEG): container finished" podID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerID="970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8" exitCode=0 Jul 30 10:24:43.216155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.216112 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" Jul 30 10:24:43.216636 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.216156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerDied","Data":"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8"} Jul 30 10:24:43.216636 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.216219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r" event={"ID":"431ba037-cea6-4238-b44f-9ef07b0c3f78","Type":"ContainerDied","Data":"45c9f711c584bb53c664e4609adb06648f403a3d153e8dee0925e635f6b7c1c5"} Jul 30 10:24:43.216636 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.216252 2576 scope.go:117] "RemoveContainer" containerID="970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8" Jul 30 10:24:43.225262 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.225243 2576 scope.go:117] "RemoveContainer" containerID="4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed" Jul 30 10:24:43.233057 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.233020 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:43.233468 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.233447 2576 scope.go:117] "RemoveContainer" containerID="970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8" Jul 30 10:24:43.233831 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:24:43.233806 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8\": container with ID starting with 970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8 not found: ID does not exist" containerID="970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8" Jul 30 10:24:43.233926 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.233846 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8"} err="failed to get container status \"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8\": rpc error: code = NotFound desc = could not find container \"970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8\": container with ID starting with 970f0cadf38b1df7d6fd65b47fbb60543534185b166619311d469f7d3aafb0d8 not found: ID does not exist" Jul 30 10:24:43.233926 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.233871 2576 scope.go:117] "RemoveContainer" containerID="4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed" Jul 30 10:24:43.234222 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:24:43.234194 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed\": container with ID starting with 4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed not found: ID does not exist" containerID="4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed" Jul 30 10:24:43.234323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.234230 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed"} err="failed to get container status \"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed\": rpc error: code = NotFound desc = could not find container \"4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed\": container with ID starting with 4a48ceda298dd4685a9a654de262441fc484a3ffbd397d7defba6d063bed6aed not found: ID does not exist" Jul 30 10:24:43.236509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:43.236487 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f9b729be-openshift-default-694b97cfbd-mgm5r"] Jul 30 10:24:44.932402 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:24:44.932372 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" path="/var/lib/kubelet/pods/431ba037-cea6-4238-b44f-9ef07b0c3f78/volumes" Jul 30 10:26:45.968744 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.968706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969098 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969110 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969119 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969124 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969130 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969136 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969151 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969156 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9484add8-f053-4c11-a325-99bc2ec96a4f" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969230 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969239 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:26:45.969384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.969246 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:26:45.972383 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.972360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:45.974426 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.974395 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-51353e63-openshift-default-dockercfg-4w7tl\"" Jul 30 10:26:45.993437 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:45.993409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:26:46.153465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153772 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkqm4\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153772 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153772 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153772 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.153945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.153795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255225 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255225 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkqm4\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255779 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.255779 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.255646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.256102 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.256075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.256323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.256302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.256398 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.256370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.256449 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.256394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.257779 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.257758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.258004 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.257987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.266070 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.266017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkqm4\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.269187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.269168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token\") pod \"e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.283064 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.283004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:46.449142 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.449061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:26:46.450539 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:26:46.450502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6265e64d_0e27_49af_9c23_be2964db8df0.slice/crio-40a18145eb1f5673d66cf6c11ca1194b4a367531e278d476be43f79885cfaf72 WatchSource:0}: Error finding container 40a18145eb1f5673d66cf6c11ca1194b4a367531e278d476be43f79885cfaf72: Status 404 returned error can't find the container with id 40a18145eb1f5673d66cf6c11ca1194b4a367531e278d476be43f79885cfaf72 Jul 30 10:26:46.453097 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.453057 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:26:46.453244 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.453153 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:26:46.453244 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.453197 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:26:46.915724 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.915685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerStarted","Data":"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab"} Jul 30 10:26:46.915910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.915752 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerStarted","Data":"40a18145eb1f5673d66cf6c11ca1194b4a367531e278d476be43f79885cfaf72"} Jul 30 10:26:46.941114 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:46.941047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podStartSLOduration=1.941010949 podStartE2EDuration="1.941010949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:26:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:26:46.938773561 +0000 UTC m=+2222.465200913" watchObservedRunningTime="2026-07-30 10:26:46.941010949 +0000 UTC m=+2222.467438276" Jul 30 10:26:47.283960 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:47.283880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:47.289925 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:47.289894 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:47.922476 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:47.922431 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:26:47.923498 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:26:47.923476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:03.847731 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:03.847293 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:54514->10.134.0.61:15021: read: connection reset by peer" start-of-body= Jul 30 10:27:03.847731 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:03.847375 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:54514->10.134.0.61:15021: read: connection reset by peer" Jul 30 10:27:04.018965 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.018883 2576 generic.go:356] "Generic (PLEG): container finished" podID="6265e64d-0e27-49af-9c23-be2964db8df0" containerID="e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab" exitCode=0 Jul 30 10:27:04.019135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.018957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerDied","Data":"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab"} Jul 30 10:27:04.019426 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.019410 2576 scope.go:117] "RemoveContainer" containerID="e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab" Jul 30 10:27:04.020444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.020416 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:27:04.020550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.020478 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:27:04.020550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:04.020513 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:27:05.026198 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:05.026165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerStarted","Data":"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f"} Jul 30 10:27:05.284187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:05.284082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:05.284370 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:05.284319 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 30 10:27:05.284445 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:05.284374 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 30 10:27:06.283506 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:06.283472 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 30 10:27:06.283886 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:06.283538 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 30 10:27:07.284465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:07.284378 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 30 10:27:07.284465 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:07.284445 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 30 10:27:08.283413 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:08.283378 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 30 10:27:08.283609 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:08.283436 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 30 10:27:09.286981 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:09.286950 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:09.287485 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:09.287368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:09.288107 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:09.288087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:38.180105 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:38.180072 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:27:38.180689 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:38.180323 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" containerID="cri-o://133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f" gracePeriod=30 Jul 30 10:27:39.290458 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:39.290422 2576 patch_prober.go:28] interesting pod/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:27:39.290835 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:39.290509 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:27:43.433370 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.433343 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:43.517851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.517762 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkqm4\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.517851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.517825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.517851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.517849 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.517905 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518068 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518111 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518143 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518197 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs\") pod \"6265e64d-0e27-49af-9c23-be2964db8df0\" (UID: \"6265e64d-0e27-49af-9c23-be2964db8df0\") " Jul 30 10:27:43.518372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518297 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:27:43.518573 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518547 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:27:43.518634 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518621 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6265e64d-0e27-49af-9c23-be2964db8df0-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.518689 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518597 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:27:43.518689 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518656 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:27:43.518802 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.518762 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data" (OuterVolumeSpecName: "istio-data") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:27:43.520316 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.520285 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token" (OuterVolumeSpecName: "istio-token") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:27:43.520433 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.520346 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:27:43.520532 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.520514 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4" (OuterVolumeSpecName: "kube-api-access-wkqm4") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "kube-api-access-wkqm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:27:43.520584 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.520527 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6265e64d-0e27-49af-9c23-be2964db8df0" (UID: "6265e64d-0e27-49af-9c23-be2964db8df0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:27:43.619822 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619779 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.619822 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619813 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.619822 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619825 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.620135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619835 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.620135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619847 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.620135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619859 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6265e64d-0e27-49af-9c23-be2964db8df0-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.620135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619870 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkqm4\" (UniqueName: \"kubernetes.io/projected/6265e64d-0e27-49af-9c23-be2964db8df0-kube-api-access-wkqm4\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:43.620135 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:43.619880 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6265e64d-0e27-49af-9c23-be2964db8df0-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:27:44.243308 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.243273 2576 generic.go:356] "Generic (PLEG): container finished" podID="6265e64d-0e27-49af-9c23-be2964db8df0" containerID="133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f" exitCode=0 Jul 30 10:27:44.243508 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.243314 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" Jul 30 10:27:44.243508 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.243340 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerDied","Data":"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f"} Jul 30 10:27:44.243508 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.243391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq" event={"ID":"6265e64d-0e27-49af-9c23-be2964db8df0","Type":"ContainerDied","Data":"40a18145eb1f5673d66cf6c11ca1194b4a367531e278d476be43f79885cfaf72"} Jul 30 10:27:44.243508 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.243420 2576 scope.go:117] "RemoveContainer" containerID="133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f" Jul 30 10:27:44.253268 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.253251 2576 scope.go:117] "RemoveContainer" containerID="e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab" Jul 30 10:27:44.261093 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.261076 2576 scope.go:117] "RemoveContainer" containerID="133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f" Jul 30 10:27:44.261352 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:27:44.261333 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f\": container with ID starting with 133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f not found: ID does not exist" containerID="133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f" Jul 30 10:27:44.261432 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.261363 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f"} err="failed to get container status \"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f\": rpc error: code = NotFound desc = could not find container \"133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f\": container with ID starting with 133a5c26ec2d3b7d5566b08b86c6197da07418a9f978a3068bf0d678033ab83f not found: ID does not exist" Jul 30 10:27:44.261432 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.261387 2576 scope.go:117] "RemoveContainer" containerID="e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab" Jul 30 10:27:44.261653 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:27:44.261635 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab\": container with ID starting with e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab not found: ID does not exist" containerID="e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab" Jul 30 10:27:44.261693 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.261659 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab"} err="failed to get container status \"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab\": rpc error: code = NotFound desc = could not find container \"e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab\": container with ID starting with e682fbaef8743d9e4ce7c5d2a1f8542fb16de8deb490d212b00c7daf1ab5ddab not found: ID does not exist" Jul 30 10:27:44.270710 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.270680 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:27:44.273082 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.273065 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-51353e63-openshift-default-5f9fd87fd4-ktjpq"] Jul 30 10:27:44.932822 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:27:44.932790 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" path="/var/lib/kubelet/pods/6265e64d-0e27-49af-9c23-be2964db8df0/volumes" Jul 30 10:28:19.366126 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:19.366091 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:28:19.366644 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:19.366327 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" podUID="a4ef1079-7e48-495c-8947-268793cc3bc2" containerName="manager" containerID="cri-o://2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19" gracePeriod=10 Jul 30 10:28:20.021141 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.021116 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:28:20.169804 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.169768 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl4kv\" (UniqueName: \"kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv\") pod \"a4ef1079-7e48-495c-8947-268793cc3bc2\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " Jul 30 10:28:20.169990 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.169820 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume\") pod \"a4ef1079-7e48-495c-8947-268793cc3bc2\" (UID: \"a4ef1079-7e48-495c-8947-268793cc3bc2\") " Jul 30 10:28:20.170246 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.170220 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a4ef1079-7e48-495c-8947-268793cc3bc2" (UID: "a4ef1079-7e48-495c-8947-268793cc3bc2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:28:20.171799 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.171779 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv" (OuterVolumeSpecName: "kube-api-access-tl4kv") pod "a4ef1079-7e48-495c-8947-268793cc3bc2" (UID: "a4ef1079-7e48-495c-8947-268793cc3bc2"). InnerVolumeSpecName "kube-api-access-tl4kv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:28:20.271128 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.271092 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl4kv\" (UniqueName: \"kubernetes.io/projected/a4ef1079-7e48-495c-8947-268793cc3bc2-kube-api-access-tl4kv\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:28:20.271128 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.271121 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ef1079-7e48-495c-8947-268793cc3bc2-extensions-socket-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:28:20.441475 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.441376 2576 generic.go:356] "Generic (PLEG): container finished" podID="a4ef1079-7e48-495c-8947-268793cc3bc2" containerID="2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19" exitCode=0 Jul 30 10:28:20.441475 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.441419 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" Jul 30 10:28:20.441475 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.441465 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" event={"ID":"a4ef1079-7e48-495c-8947-268793cc3bc2","Type":"ContainerDied","Data":"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19"} Jul 30 10:28:20.442065 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.441515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc" event={"ID":"a4ef1079-7e48-495c-8947-268793cc3bc2","Type":"ContainerDied","Data":"c69f173db021200800622ee325b73e3ae28ad79875941413ee70238206ab9ed6"} Jul 30 10:28:20.442065 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.441539 2576 scope.go:117] "RemoveContainer" containerID="2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19" Jul 30 10:28:20.452426 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.452409 2576 scope.go:117] "RemoveContainer" containerID="2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19" Jul 30 10:28:20.452697 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:28:20.452676 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19\": container with ID starting with 2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19 not found: ID does not exist" containerID="2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19" Jul 30 10:28:20.452743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.452706 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19"} err="failed to get container status \"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19\": rpc error: code = NotFound desc = could not find container \"2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19\": container with ID starting with 2fc581cd4b91988d7fa235f606d4252f968404df869ca38934a9b51b3500ac19 not found: ID does not exist" Jul 30 10:28:20.462324 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.462298 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:28:20.465838 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.465810 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ncblc"] Jul 30 10:28:20.930103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:28:20.930074 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ef1079-7e48-495c-8947-268793cc3bc2" path="/var/lib/kubelet/pods/a4ef1079-7e48-495c-8947-268793cc3bc2/volumes" Jul 30 10:29:35.072411 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072376 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd"] Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072773 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072786 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="431ba037-cea6-4238-b44f-9ef07b0c3f78" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072797 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072804 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072810 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072815 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072826 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ef1079-7e48-495c-8947-268793cc3bc2" containerName="manager" Jul 30 10:29:35.072869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072832 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ef1079-7e48-495c-8947-268793cc3bc2" containerName="manager" Jul 30 10:29:35.073150 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072891 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:35.073150 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072901 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ef1079-7e48-495c-8947-268793cc3bc2" containerName="manager" Jul 30 10:29:35.073150 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.072910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="778ab1c2-c2f9-4c4b-93df-5a27ab9ef997" containerName="istio-proxy" Jul 30 10:29:35.075818 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.075801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.079752 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.079733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z2cjd\"" Jul 30 10:29:35.097530 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.097505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd"] Jul 30 10:29:35.157437 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.157407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn6t2\" (UniqueName: \"kubernetes.io/projected/c463b2f7-c075-4392-acf3-d030054790a9-kube-api-access-sn6t2\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.157609 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.157464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c463b2f7-c075-4392-acf3-d030054790a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.258543 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.258508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn6t2\" (UniqueName: \"kubernetes.io/projected/c463b2f7-c075-4392-acf3-d030054790a9-kube-api-access-sn6t2\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.258704 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.258561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c463b2f7-c075-4392-acf3-d030054790a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.258906 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.258889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c463b2f7-c075-4392-acf3-d030054790a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.273410 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.273380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn6t2\" (UniqueName: \"kubernetes.io/projected/c463b2f7-c075-4392-acf3-d030054790a9-kube-api-access-sn6t2\") pod \"kuadrant-operator-controller-manager-86878c769f-7plzd\" (UID: \"c463b2f7-c075-4392-acf3-d030054790a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.385007 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.384976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.558184 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.558158 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd"] Jul 30 10:29:35.562820 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:29:35.562780 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc463b2f7_c075_4392_acf3_d030054790a9.slice/crio-9526ddd420d4c7a7419d9d3aa4aec61d860b5b32e0fc12ba91cad07b36af01f0 WatchSource:0}: Error finding container 9526ddd420d4c7a7419d9d3aa4aec61d860b5b32e0fc12ba91cad07b36af01f0: Status 404 returned error can't find the container with id 9526ddd420d4c7a7419d9d3aa4aec61d860b5b32e0fc12ba91cad07b36af01f0 Jul 30 10:29:35.850044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.849935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" event={"ID":"c463b2f7-c075-4392-acf3-d030054790a9","Type":"ContainerStarted","Data":"a83b58b11d424073babcc7e453a2f2ae12ffee252acad00d0e11dbcd2dd45e25"} Jul 30 10:29:35.850044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.849991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" event={"ID":"c463b2f7-c075-4392-acf3-d030054790a9","Type":"ContainerStarted","Data":"9526ddd420d4c7a7419d9d3aa4aec61d860b5b32e0fc12ba91cad07b36af01f0"} Jul 30 10:29:35.850044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.850020 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:35.882261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:35.882214 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" podStartSLOduration=0.882197128 podStartE2EDuration="882.197128ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:29:35.880263595 +0000 UTC m=+2391.406690922" watchObservedRunningTime="2026-07-30 10:29:35.882197128 +0000 UTC m=+2391.408624456" Jul 30 10:29:46.857758 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:46.857725 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7plzd" Jul 30 10:29:53.932253 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.932208 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:29:53.932893 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.932872 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6265e64d-0e27-49af-9c23-be2964db8df0" containerName="istio-proxy" Jul 30 10:29:53.936126 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.936105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.939670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.939650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2c013e89-openshift-default-dockercfg-c9qt4\"" Jul 30 10:29:53.940701 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.940811 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.940811 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.940811 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.941044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.941044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.941044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.941044 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.940963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4wv\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.941256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.941040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:53.978950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:53.978911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:29:54.041881 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.041841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042118 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.041905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042118 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.041976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042118 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042118 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042371 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4wv\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042371 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042371 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042371 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.042371 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.043016 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.042987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.043251 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.043063 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.043409 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.043385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.043601 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.043236 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.045762 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.045740 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.046161 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.046135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.059052 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.059007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.059282 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.059147 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4wv\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv\") pod \"e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.249573 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.249489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:54.392723 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.392695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:29:54.394111 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:29:54.394086 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f270800_735e_4793_a568_78bb33258894.slice/crio-77f57d60f05da452217bfdeecd6c93c17bef8f218b602ef253a9caf2601c8dae WatchSource:0}: Error finding container 77f57d60f05da452217bfdeecd6c93c17bef8f218b602ef253a9caf2601c8dae: Status 404 returned error can't find the container with id 77f57d60f05da452217bfdeecd6c93c17bef8f218b602ef253a9caf2601c8dae Jul 30 10:29:54.396115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.396080 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:29:54.396224 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.396155 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:29:54.396224 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.396201 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:29:54.957101 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.957065 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerStarted","Data":"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85"} Jul 30 10:29:54.957510 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.957114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerStarted","Data":"77f57d60f05da452217bfdeecd6c93c17bef8f218b602ef253a9caf2601c8dae"} Jul 30 10:29:54.978571 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:54.978520 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podStartSLOduration=1.978505013 podStartE2EDuration="1.978505013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:29:54.976883789 +0000 UTC m=+2410.503311119" watchObservedRunningTime="2026-07-30 10:29:54.978505013 +0000 UTC m=+2410.504932341" Jul 30 10:29:55.250466 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:55.250375 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:55.256151 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:55.256128 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:55.963166 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:55.963136 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:29:55.963983 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:29:55.963965 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:30:15.077492 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.077456 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f270800-735e-4793-a568-78bb33258894" containerID="cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85" exitCode=0 Jul 30 10:30:15.078115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.077505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerDied","Data":"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85"} Jul 30 10:30:15.078115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.077907 2576 scope.go:117] "RemoveContainer" containerID="cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85" Jul 30 10:30:15.078929 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.078898 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:30:15.079047 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.078969 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:30:15.079047 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:15.079003 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:30:16.085017 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:16.084983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerStarted","Data":"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251"} Jul 30 10:30:16.250800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:16.250757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:30:16.250800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:16.250791 2576 patch_prober.go:28] interesting pod/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Jul 30 10:30:16.251096 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:16.250857 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Jul 30 10:30:17.251023 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:17.250982 2576 patch_prober.go:28] interesting pod/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Jul 30 10:30:17.251534 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:17.251075 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Jul 30 10:30:18.250799 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:18.250756 2576 patch_prober.go:28] interesting pod/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Jul 30 10:30:18.251050 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:18.250832 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Jul 30 10:30:19.249969 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:19.249931 2576 patch_prober.go:28] interesting pod/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body= Jul 30 10:30:19.250623 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:19.250588 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" Jul 30 10:30:20.253840 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:20.253809 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:30:20.254285 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:20.254224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:30:20.255068 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:30:20.255048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:32:35.160919 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:35.160876 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:32:35.161509 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:35.161244 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" containerID="cri-o://a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251" gracePeriod=30 Jul 30 10:32:35.257150 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:35.257101 2576 patch_prober.go:28] interesting pod/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:32:35.257310 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:35.257210 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:32:40.422637 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.422612 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:32:40.476245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476142 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476193 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476260 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph4wv\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476401 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476445 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476471 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:32:40.476542 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs\") pod \"7f270800-735e-4793-a568-78bb33258894\" (UID: \"7f270800-735e-4793-a568-78bb33258894\") " Jul 30 10:32:40.477227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.476967 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:32:40.477227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.477178 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:32:40.477227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.477183 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.477227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.477210 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.477458 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.477258 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:32:40.477458 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.477307 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:32:40.478582 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.478560 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:32:40.478683 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.478590 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:32:40.478887 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.478869 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:32:40.478964 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.478893 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv" (OuterVolumeSpecName: "kube-api-access-ph4wv") pod "7f270800-735e-4793-a568-78bb33258894" (UID: "7f270800-735e-4793-a568-78bb33258894"). InnerVolumeSpecName "kube-api-access-ph4wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:32:40.577883 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577847 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph4wv\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-kube-api-access-ph4wv\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.577883 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577879 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f270800-735e-4793-a568-78bb33258894-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.577883 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577889 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.578170 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577898 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.578170 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577906 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f270800-735e-4793-a568-78bb33258894-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.578170 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577913 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f270800-735e-4793-a568-78bb33258894-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.578170 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.577921 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f270800-735e-4793-a568-78bb33258894-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:32:40.888082 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.888015 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f270800-735e-4793-a568-78bb33258894" containerID="a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251" exitCode=0 Jul 30 10:32:40.888255 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.888092 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" Jul 30 10:32:40.888255 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.888110 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerDied","Data":"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251"} Jul 30 10:32:40.888255 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.888198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5" event={"ID":"7f270800-735e-4793-a568-78bb33258894","Type":"ContainerDied","Data":"77f57d60f05da452217bfdeecd6c93c17bef8f218b602ef253a9caf2601c8dae"} Jul 30 10:32:40.888255 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.888225 2576 scope.go:117] "RemoveContainer" containerID="a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251" Jul 30 10:32:40.898148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.898096 2576 scope.go:117] "RemoveContainer" containerID="cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85" Jul 30 10:32:40.906290 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.906272 2576 scope.go:117] "RemoveContainer" containerID="a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251" Jul 30 10:32:40.906533 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:32:40.906517 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251\": container with ID starting with a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251 not found: ID does not exist" containerID="a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251" Jul 30 10:32:40.906572 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.906541 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251"} err="failed to get container status \"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251\": rpc error: code = NotFound desc = could not find container \"a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251\": container with ID starting with a003a5365bf77feb6853d28928f1da72b14fbc1458cb3aa257218348977b1251 not found: ID does not exist" Jul 30 10:32:40.906572 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.906558 2576 scope.go:117] "RemoveContainer" containerID="cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85" Jul 30 10:32:40.906765 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:32:40.906750 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85\": container with ID starting with cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85 not found: ID does not exist" containerID="cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85" Jul 30 10:32:40.906804 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.906771 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85"} err="failed to get container status \"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85\": rpc error: code = NotFound desc = could not find container \"cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85\": container with ID starting with cfbccbf642746f74df908fa6b234fe5a017d8081459adda51ce507e994302f85 not found: ID does not exist" Jul 30 10:32:40.911771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.911749 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:32:40.915405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.915384 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2c013e89-openshift-default-7c9bfc9f6d-9slj5"] Jul 30 10:32:40.930302 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:32:40.930281 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f270800-735e-4793-a568-78bb33258894" path="/var/lib/kubelet/pods/7f270800-735e-4793-a568-78bb33258894/volumes" Jul 30 10:33:50.705947 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.705912 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:33:50.706447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.706328 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:33:50.706447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.706340 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:33:50.706447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.706435 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:33:50.709426 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.709410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.711497 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.711478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-98c9c7-openshift-default-dockercfg-64frf\"" Jul 30 10:33:50.722784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.722751 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:33:50.771223 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5v5g\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771384 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771528 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771528 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771528 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.771631 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.771540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872279 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872279 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5v5g\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872531 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872901 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872966 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872966 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.872966 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.872954 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.873147 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.873096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.874644 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.874615 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.874884 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.874866 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.880107 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.880085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:50.880311 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:50.880290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5v5g\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g\") pod \"e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:51.021090 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.020985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:51.179259 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.179233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:33:51.182328 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:33:51.182298 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360791c5_d244_485f_9ddf_72b109458de1.slice/crio-751eb0f8db3dd164f8a8db70697b516258a66a02b7382b50beb437ca8c97eeb0 WatchSource:0}: Error finding container 751eb0f8db3dd164f8a8db70697b516258a66a02b7382b50beb437ca8c97eeb0: Status 404 returned error can't find the container with id 751eb0f8db3dd164f8a8db70697b516258a66a02b7382b50beb437ca8c97eeb0 Jul 30 10:33:51.184611 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.184579 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:33:51.184717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.184662 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:33:51.184717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.184708 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:33:51.281823 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.281718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerStarted","Data":"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5"} Jul 30 10:33:51.281823 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.281785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerStarted","Data":"751eb0f8db3dd164f8a8db70697b516258a66a02b7382b50beb437ca8c97eeb0"} Jul 30 10:33:51.302004 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:51.301942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podStartSLOduration=1.301926403 podStartE2EDuration="1.301926403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:33:51.300149642 +0000 UTC m=+2646.826576973" watchObservedRunningTime="2026-07-30 10:33:51.301926403 +0000 UTC m=+2646.828353731" Jul 30 10:33:52.021642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:52.021597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:52.026862 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:52.026838 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:52.287567 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:52.287474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:33:52.288654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:33:52.288633 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:34:08.329198 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:08.329156 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 30 10:34:08.329604 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:08.329220 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 30 10:34:09.409296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.409259 2576 generic.go:356] "Generic (PLEG): container finished" podID="360791c5-d244-485f-9ddf-72b109458de1" containerID="ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5" exitCode=0 Jul 30 10:34:09.409296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.409297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerDied","Data":"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5"} Jul 30 10:34:09.409745 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.409672 2576 scope.go:117] "RemoveContainer" containerID="ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5" Jul 30 10:34:09.410732 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.410703 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:09.410787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.410775 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:09.410826 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:09.410807 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:10.416678 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:10.416641 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerStarted","Data":"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805"} Jul 30 10:34:11.022144 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:11.022095 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:34:11.022414 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:11.022392 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Jul 30 10:34:11.022501 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:11.022448 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Jul 30 10:34:12.021739 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:12.021703 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Jul 30 10:34:12.022244 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:12.021765 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Jul 30 10:34:13.021621 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:13.021586 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Jul 30 10:34:13.021806 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:13.021640 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Jul 30 10:34:14.021993 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:14.021959 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body= Jul 30 10:34:14.022407 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:14.022011 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" Jul 30 10:34:15.024567 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:15.024534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:34:15.025011 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:15.024826 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:34:15.025614 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:15.025599 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:34:18.993610 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.993566 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:34:18.994181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.994163 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:34:18.994243 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.994183 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:34:18.994280 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.994257 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f270800-735e-4793-a568-78bb33258894" containerName="istio-proxy" Jul 30 10:34:18.996318 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.996300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:18.998484 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:18.998462 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fde6bc-openshift-default-dockercfg-7kmrl\"" Jul 30 10:34:19.009263 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.009242 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:34:19.056040 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkt85\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056395 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056395 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056464 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056513 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.056550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.056507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.157755 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.157715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.157946 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.157795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.157946 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.157824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkt85\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.157946 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.157854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.157987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158419 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158419 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158224 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158419 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158386 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158585 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.158842 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.158821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.160230 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.160210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.160446 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.160430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.165077 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.165053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.165240 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.165219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkt85\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85\") pod \"e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.308962 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.308870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:19.446484 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.446453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:34:19.447915 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:34:19.447883 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295839cb_96f7_4941_b138_ae1942f26d78.slice/crio-6ecbfb8f05a416b3b8a3620d3684cbdd3a17a4d2966effb2cff14c0037467fba WatchSource:0}: Error finding container 6ecbfb8f05a416b3b8a3620d3684cbdd3a17a4d2966effb2cff14c0037467fba: Status 404 returned error can't find the container with id 6ecbfb8f05a416b3b8a3620d3684cbdd3a17a4d2966effb2cff14c0037467fba Jul 30 10:34:19.450201 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.450168 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:19.450294 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.450232 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:19.450294 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.450261 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:19.467422 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:19.467393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerStarted","Data":"6ecbfb8f05a416b3b8a3620d3684cbdd3a17a4d2966effb2cff14c0037467fba"} Jul 30 10:34:20.474131 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:20.474094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerStarted","Data":"a5661500c468172493a7c7f2d8c9bd0554b65b09f52b4edc413aa67be0b2f507"} Jul 30 10:34:20.493200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:20.493142 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podStartSLOduration=2.493124117 podStartE2EDuration="2.493124117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:34:20.49212674 +0000 UTC m=+2676.018554068" watchObservedRunningTime="2026-07-30 10:34:20.493124117 +0000 UTC m=+2676.019551446" Jul 30 10:34:21.309053 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:21.309007 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:21.314665 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:21.314641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:21.483564 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:21.483519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:21.484522 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:21.484502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:37.524296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:37.524189 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 30 10:34:37.524296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:37.524272 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 30 10:34:39.595541 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.595505 2576 generic.go:356] "Generic (PLEG): container finished" podID="295839cb-96f7-4941-b138-ae1942f26d78" containerID="a5661500c468172493a7c7f2d8c9bd0554b65b09f52b4edc413aa67be0b2f507" exitCode=0 Jul 30 10:34:39.595971 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.595578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerDied","Data":"a5661500c468172493a7c7f2d8c9bd0554b65b09f52b4edc413aa67be0b2f507"} Jul 30 10:34:39.596048 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.596013 2576 scope.go:117] "RemoveContainer" containerID="a5661500c468172493a7c7f2d8c9bd0554b65b09f52b4edc413aa67be0b2f507" Jul 30 10:34:39.597060 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.597016 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:39.597123 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.597102 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:39.597160 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:39.597132 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:34:40.603714 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:40.603678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerStarted","Data":"b67cdc42dcea886d41823eba2b2dd457e81ba3d78e9614e98537596422574467"} Jul 30 10:34:41.309268 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:41.309224 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:41.309550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:41.309525 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body= Jul 30 10:34:41.309599 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:41.309579 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" Jul 30 10:34:42.310279 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:42.310234 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body= Jul 30 10:34:42.310679 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:42.310317 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" Jul 30 10:34:43.310250 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:43.310215 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body= Jul 30 10:34:43.310451 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:43.310274 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" Jul 30 10:34:44.309949 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:44.309913 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body= Jul 30 10:34:44.310156 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:44.309969 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" Jul 30 10:34:45.313316 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:45.313286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:45.313731 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:45.313657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:34:45.314433 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:34:45.314412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:36:25.732552 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:25.732466 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:36:25.733081 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:25.732725 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" containerID="cri-o://ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805" gracePeriod=30 Jul 30 10:36:30.027718 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:30.027678 2576 patch_prober.go:28] interesting pod/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:36:30.028113 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:30.027759 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:36:30.993018 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:30.992960 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:36:31.170324 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170395 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170420 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170489 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170534 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5v5g\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170619 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket\") pod \"360791c5-d244-485f-9ddf-72b109458de1\" (UID: \"360791c5-d244-485f-9ddf-72b109458de1\") " Jul 30 10:36:31.170775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170738 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170782 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170946 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.170957 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.171128 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.171148 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.171163 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.171256 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.171177 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/360791c5-d244-485f-9ddf-72b109458de1-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.171562 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.171326 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data" (OuterVolumeSpecName: "istio-data") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:31.172701 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.172669 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:36:31.172940 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.172922 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token" (OuterVolumeSpecName: "istio-token") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:36:31.173086 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.173063 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:31.173169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.173098 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g" (OuterVolumeSpecName: "kube-api-access-l5v5g") pod "360791c5-d244-485f-9ddf-72b109458de1" (UID: "360791c5-d244-485f-9ddf-72b109458de1"). InnerVolumeSpecName "kube-api-access-l5v5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:36:31.245541 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.245455 2576 generic.go:356] "Generic (PLEG): container finished" podID="360791c5-d244-485f-9ddf-72b109458de1" containerID="ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805" exitCode=0 Jul 30 10:36:31.245541 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.245505 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" Jul 30 10:36:31.245742 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.245536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerDied","Data":"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805"} Jul 30 10:36:31.245742 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.245594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl" event={"ID":"360791c5-d244-485f-9ddf-72b109458de1","Type":"ContainerDied","Data":"751eb0f8db3dd164f8a8db70697b516258a66a02b7382b50beb437ca8c97eeb0"} Jul 30 10:36:31.245742 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.245620 2576 scope.go:117] "RemoveContainer" containerID="ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805" Jul 30 10:36:31.256660 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.256641 2576 scope.go:117] "RemoveContainer" containerID="ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5" Jul 30 10:36:31.268351 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.268332 2576 scope.go:117] "RemoveContainer" containerID="ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805" Jul 30 10:36:31.268879 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:36:31.268853 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805\": container with ID starting with ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805 not found: ID does not exist" containerID="ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805" Jul 30 10:36:31.268980 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.268886 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805"} err="failed to get container status \"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805\": rpc error: code = NotFound desc = could not find container \"ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805\": container with ID starting with ccb065b19847b30eadec1a73265b83edc62f59aab6ca20a7b6bff18cbe82d805 not found: ID does not exist" Jul 30 10:36:31.268980 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.268910 2576 scope.go:117] "RemoveContainer" containerID="ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5" Jul 30 10:36:31.269235 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:36:31.269204 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5\": container with ID starting with ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5 not found: ID does not exist" containerID="ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5" Jul 30 10:36:31.269340 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.269242 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5"} err="failed to get container status \"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5\": rpc error: code = NotFound desc = could not find container \"ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5\": container with ID starting with ffa02d551400f854288938789b4c9bdb956c2f2f9da32d5a6fdde23fb2bc9fd5 not found: ID does not exist" Jul 30 10:36:31.270357 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.270335 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:36:31.271867 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.271846 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.271950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.271868 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5v5g\" (UniqueName: \"kubernetes.io/projected/360791c5-d244-485f-9ddf-72b109458de1-kube-api-access-l5v5g\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.271950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.271879 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.271950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.271891 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/360791c5-d244-485f-9ddf-72b109458de1-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.271950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.271902 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/360791c5-d244-485f-9ddf-72b109458de1-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:31.273834 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:31.273816 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-98c9c7-openshift-default-6b764dd568-b6sgl"] Jul 30 10:36:32.930471 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:32.930440 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="360791c5-d244-485f-9ddf-72b109458de1" path="/var/lib/kubelet/pods/360791c5-d244-485f-9ddf-72b109458de1/volumes" Jul 30 10:36:43.226702 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:43.226655 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:36:43.227123 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:43.226873 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" containerID="cri-o://b67cdc42dcea886d41823eba2b2dd457e81ba3d78e9614e98537596422574467" gracePeriod=30 Jul 30 10:36:44.157455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.157423 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:36:44.158074 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.158050 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:36:44.158304 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.158284 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:36:44.158533 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.158514 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:36:44.158616 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.158539 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:36:44.163561 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.163531 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.165637 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.165616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b89f96-openshift-default-dockercfg-lp7qp\"" Jul 30 10:36:44.173181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.173159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:36:44.201110 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201259 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201259 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lngsl\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201259 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201376 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201376 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201376 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201494 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.201494 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.201464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302242 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302457 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lngsl\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.302674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.303119 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.303119 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.303119 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.302958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.303221 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.303141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.304904 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.304881 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.305108 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.305091 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.309651 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.309629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.310155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.310138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lngsl\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl\") pod \"e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.475808 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.475717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:44.615946 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.615902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:36:44.618291 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:36:44.618261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6135593f_e02a_48e4_a891_beab1c8d1333.slice/crio-ed0438b9ccc400690c43d3de68028c442e5a58c89a22fee0d8b457dda0c6357b WatchSource:0}: Error finding container ed0438b9ccc400690c43d3de68028c442e5a58c89a22fee0d8b457dda0c6357b: Status 404 returned error can't find the container with id ed0438b9ccc400690c43d3de68028c442e5a58c89a22fee0d8b457dda0c6357b Jul 30 10:36:44.620309 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.620277 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:36:44.620388 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.620342 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:36:44.620388 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:44.620373 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:36:45.317710 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.317677 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:36:45.318114 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.317735 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:36:45.324519 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.324491 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerStarted","Data":"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d"} Jul 30 10:36:45.324631 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.324566 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerStarted","Data":"ed0438b9ccc400690c43d3de68028c442e5a58c89a22fee0d8b457dda0c6357b"} Jul 30 10:36:45.350152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.350094 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podStartSLOduration=1.350075725 podStartE2EDuration="1.350075725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:36:45.346020237 +0000 UTC m=+2820.872447577" watchObservedRunningTime="2026-07-30 10:36:45.350075725 +0000 UTC m=+2820.876503055" Jul 30 10:36:45.475943 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.475909 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:45.481289 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:45.481262 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:46.330880 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:46.330845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:46.332023 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:46.332001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:36:48.344233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.343878 2576 generic.go:356] "Generic (PLEG): container finished" podID="295839cb-96f7-4941-b138-ae1942f26d78" containerID="b67cdc42dcea886d41823eba2b2dd457e81ba3d78e9614e98537596422574467" exitCode=0 Jul 30 10:36:48.344233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.343965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerDied","Data":"b67cdc42dcea886d41823eba2b2dd457e81ba3d78e9614e98537596422574467"} Jul 30 10:36:48.344233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.344110 2576 scope.go:117] "RemoveContainer" containerID="a5661500c468172493a7c7f2d8c9bd0554b65b09f52b4edc413aa67be0b2f507" Jul 30 10:36:48.495231 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.495127 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:36:48.543086 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543016 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543105 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543215 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543245 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543530 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkt85\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543530 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543366 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543530 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543430 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo\") pod \"295839cb-96f7-4941-b138-ae1942f26d78\" (UID: \"295839cb-96f7-4941-b138-ae1942f26d78\") " Jul 30 10:36:48.543530 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543431 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:48.543738 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543674 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:48.543838 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543820 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.543896 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.543844 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.544110 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.544078 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data" (OuterVolumeSpecName: "istio-data") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:48.544236 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.544176 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:36:48.544643 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.544392 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:48.546245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.546216 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:36:48.546700 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.546674 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85" (OuterVolumeSpecName: "kube-api-access-bkt85") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "kube-api-access-bkt85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:36:48.546793 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.546738 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:36:48.546793 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.546749 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token" (OuterVolumeSpecName: "istio-token") pod "295839cb-96f7-4941-b138-ae1942f26d78" (UID: "295839cb-96f7-4941-b138-ae1942f26d78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:36:48.644562 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644519 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644562 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644554 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295839cb-96f7-4941-b138-ae1942f26d78-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644562 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644566 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644888 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644599 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644888 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644613 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkt85\" (UniqueName: \"kubernetes.io/projected/295839cb-96f7-4941-b138-ae1942f26d78-kube-api-access-bkt85\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644888 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644628 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295839cb-96f7-4941-b138-ae1942f26d78-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:48.644888 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:48.644642 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295839cb-96f7-4941-b138-ae1942f26d78-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:36:49.350674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:49.350608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" event={"ID":"295839cb-96f7-4941-b138-ae1942f26d78","Type":"ContainerDied","Data":"6ecbfb8f05a416b3b8a3620d3684cbdd3a17a4d2966effb2cff14c0037467fba"} Jul 30 10:36:49.350674 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:49.350631 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f" Jul 30 10:36:49.351191 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:49.350677 2576 scope.go:117] "RemoveContainer" containerID="b67cdc42dcea886d41823eba2b2dd457e81ba3d78e9614e98537596422574467" Jul 30 10:36:49.380059 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:49.380011 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:36:49.393902 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:49.393870 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fde6bc-openshift-default-5c4b994464-p7s2f"] Jul 30 10:36:50.931147 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:36:50.931112 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="295839cb-96f7-4941-b138-ae1942f26d78" path="/var/lib/kubelet/pods/295839cb-96f7-4941-b138-ae1942f26d78/volumes" Jul 30 10:37:02.137769 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.137736 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:47122->10.134.0.66:15021: read: connection reset by peer" start-of-body= Jul 30 10:37:02.138176 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.137806 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": read tcp 10.134.0.2:47122->10.134.0.66:15021: read: connection reset by peer" Jul 30 10:37:02.434795 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.434709 2576 generic.go:356] "Generic (PLEG): container finished" podID="6135593f-e02a-48e4-a891-beab1c8d1333" containerID="8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d" exitCode=0 Jul 30 10:37:02.434795 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.434771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerDied","Data":"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d"} Jul 30 10:37:02.435182 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.435168 2576 scope.go:117] "RemoveContainer" containerID="8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d" Jul 30 10:37:02.436279 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.436253 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:02.436358 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.436329 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:02.436396 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:02.436364 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:03.444088 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:03.444020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerStarted","Data":"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca"} Jul 30 10:37:03.476713 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:03.476670 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:37:03.476960 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:03.476931 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body= Jul 30 10:37:03.477089 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:03.476986 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" Jul 30 10:37:04.476394 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:04.476348 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body= Jul 30 10:37:04.476966 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:04.476413 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" Jul 30 10:37:05.476721 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:05.476690 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body= Jul 30 10:37:05.477125 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:05.476744 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" Jul 30 10:37:06.477060 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:06.477012 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body= Jul 30 10:37:06.477437 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:06.477078 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" Jul 30 10:37:07.476240 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:07.476202 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body= Jul 30 10:37:07.476467 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:07.476262 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" Jul 30 10:37:08.480409 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:08.480377 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:37:08.480857 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:08.480829 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:37:08.481659 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:08.481639 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:37:13.099526 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.099486 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:37:13.099917 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.099895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:37:13.099917 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.099908 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:37:13.099994 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.099919 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:37:13.099994 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.099925 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="360791c5-d244-485f-9ddf-72b109458de1" containerName="istio-proxy" Jul 30 10:37:13.100079 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.100009 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:37:13.100079 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.100017 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:37:13.102770 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.102734 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.105621 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.105601 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-220161-openshift-default-dockercfg-hsbkj\"" Jul 30 10:37:13.114995 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.114970 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:37:13.186950 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.186920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.186983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187148 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187085 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vls4x\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.187323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.187269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288060 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.287994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vls4x\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288540 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288493 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288540 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288507 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288659 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288659 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288770 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288770 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288956 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.288956 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.288950 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.289152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.289132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.290707 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.290689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.291165 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.291149 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.300785 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.299342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vls4x\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.302427 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.302404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token\") pod \"e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.416207 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.416163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:13.569857 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.569825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:37:13.571625 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:37:13.571600 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85262633_16e1_4d03_9a68_4f50e3686bdd.slice/crio-af0140e85dd289244ae279b070cd295f16f928ddb0ac38b5fff9c55e925695fe WatchSource:0}: Error finding container af0140e85dd289244ae279b070cd295f16f928ddb0ac38b5fff9c55e925695fe: Status 404 returned error can't find the container with id af0140e85dd289244ae279b070cd295f16f928ddb0ac38b5fff9c55e925695fe Jul 30 10:37:13.573820 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.573789 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:13.573905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.573856 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:13.573905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:13.573884 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:14.514412 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:14.514375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerStarted","Data":"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b"} Jul 30 10:37:14.514811 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:14.514436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerStarted","Data":"af0140e85dd289244ae279b070cd295f16f928ddb0ac38b5fff9c55e925695fe"} Jul 30 10:37:14.534343 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:14.534291 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podStartSLOduration=1.5342765360000001 podStartE2EDuration="1.534276536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:37:14.532186994 +0000 UTC m=+2850.058614332" watchObservedRunningTime="2026-07-30 10:37:14.534276536 +0000 UTC m=+2850.060703864" Jul 30 10:37:15.416598 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:15.416566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:15.421625 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:15.421597 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:15.520670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:15.520636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:15.521642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:15.521621 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:31.562226 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:31.562185 2576 patch_prober.go:28] interesting pod/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 30 10:37:31.562626 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:31.562255 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 30 10:37:32.626277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.626245 2576 generic.go:356] "Generic (PLEG): container finished" podID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerID="48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b" exitCode=0 Jul 30 10:37:32.626716 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.626319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerDied","Data":"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b"} Jul 30 10:37:32.626831 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.626817 2576 scope.go:117] "RemoveContainer" containerID="48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b" Jul 30 10:37:32.627900 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.627870 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:32.628000 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.627955 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:32.628106 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:32.628005 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:37:33.633999 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:33.633964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerStarted","Data":"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94"} Jul 30 10:37:34.416757 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:34.416718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:34.417014 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:34.416993 2576 patch_prober.go:28] interesting pod/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Jul 30 10:37:34.417097 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:34.417069 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Jul 30 10:37:35.417533 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:35.417493 2576 patch_prober.go:28] interesting pod/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Jul 30 10:37:35.417998 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:35.417551 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Jul 30 10:37:36.417098 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:36.417063 2576 patch_prober.go:28] interesting pod/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Jul 30 10:37:36.417307 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:36.417129 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Jul 30 10:37:37.416979 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:37.416940 2576 patch_prober.go:28] interesting pod/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Jul 30 10:37:37.417419 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:37.417021 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Jul 30 10:37:38.421267 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:38.421235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:38.421647 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:38.421493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:37:38.422200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:37:38.422182 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:38:06.974800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:06.974762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:38:06.975759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:06.975702 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" containerID="cri-o://c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca" gracePeriod=30 Jul 30 10:38:08.483457 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:08.483420 2576 patch_prober.go:28] interesting pod/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:38:08.483839 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:08.483490 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:38:12.237472 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.237411 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:38:12.261588 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261557 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.261761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261601 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.261761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261627 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.261761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261671 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.261761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.261761 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261740 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.262051 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261791 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lngsl\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.262051 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261836 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:12.262051 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261867 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.262051 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.261899 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo\") pod \"6135593f-e02a-48e4-a891-beab1c8d1333\" (UID: \"6135593f-e02a-48e4-a891-beab1c8d1333\") " Jul 30 10:38:12.262257 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262211 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:12.262335 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:38:12.262399 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262320 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.262399 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262367 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.262920 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262876 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data" (OuterVolumeSpecName: "istio-data") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:12.263077 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.262921 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:12.264165 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.264134 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl" (OuterVolumeSpecName: "kube-api-access-lngsl") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "kube-api-access-lngsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:38:12.264378 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.264351 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:12.264588 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.264568 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:38:12.264725 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.264703 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token" (OuterVolumeSpecName: "istio-token") pod "6135593f-e02a-48e4-a891-beab1c8d1333" (UID: "6135593f-e02a-48e4-a891-beab1c8d1333"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:38:12.363249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363216 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6135593f-e02a-48e4-a891-beab1c8d1333-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363245 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6135593f-e02a-48e4-a891-beab1c8d1333-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363254 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363262 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363271 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363279 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6135593f-e02a-48e4-a891-beab1c8d1333-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.363486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.363287 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lngsl\" (UniqueName: \"kubernetes.io/projected/6135593f-e02a-48e4-a891-beab1c8d1333-kube-api-access-lngsl\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:12.874194 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.874157 2576 generic.go:356] "Generic (PLEG): container finished" podID="6135593f-e02a-48e4-a891-beab1c8d1333" containerID="c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca" exitCode=0 Jul 30 10:38:12.874374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.874214 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" Jul 30 10:38:12.874374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.874240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerDied","Data":"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca"} Jul 30 10:38:12.874374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.874292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd" event={"ID":"6135593f-e02a-48e4-a891-beab1c8d1333","Type":"ContainerDied","Data":"ed0438b9ccc400690c43d3de68028c442e5a58c89a22fee0d8b457dda0c6357b"} Jul 30 10:38:12.874374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.874314 2576 scope.go:117] "RemoveContainer" containerID="c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca" Jul 30 10:38:12.888265 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.888238 2576 scope.go:117] "RemoveContainer" containerID="8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d" Jul 30 10:38:12.897152 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.896979 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:38:12.897226 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.897172 2576 scope.go:117] "RemoveContainer" containerID="c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca" Jul 30 10:38:12.897503 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:38:12.897484 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca\": container with ID starting with c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca not found: ID does not exist" containerID="c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca" Jul 30 10:38:12.897577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.897510 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca"} err="failed to get container status \"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca\": rpc error: code = NotFound desc = could not find container \"c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca\": container with ID starting with c5342ece1702b7df9f91e19960920234a77c581ca9c39abe50cd4efba89993ca not found: ID does not exist" Jul 30 10:38:12.897577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.897529 2576 scope.go:117] "RemoveContainer" containerID="8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d" Jul 30 10:38:12.897770 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:38:12.897754 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d\": container with ID starting with 8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d not found: ID does not exist" containerID="8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d" Jul 30 10:38:12.897812 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.897776 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d"} err="failed to get container status \"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d\": rpc error: code = NotFound desc = could not find container \"8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d\": container with ID starting with 8b5666dab67997f1a64c844f414da86d561aacbbe14a6b3ed13e402a0726045d not found: ID does not exist" Jul 30 10:38:12.903128 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.903100 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b89f96-openshift-default-86759d5db4-cl7cd"] Jul 30 10:38:12.931746 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:12.931711 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" path="/var/lib/kubelet/pods/6135593f-e02a-48e4-a891-beab1c8d1333/volumes" Jul 30 10:38:29.430334 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:29.430294 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:38:29.430752 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:29.430527 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" containerID="cri-o://b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94" gracePeriod=30 Jul 30 10:38:30.354221 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354185 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:38:30.354596 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354584 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:30.354642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354597 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:30.354642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354612 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:30.354642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354617 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:30.354642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354628 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:38:30.354642 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354633 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="295839cb-96f7-4941-b138-ae1942f26d78" containerName="istio-proxy" Jul 30 10:38:30.354800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.354695 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:30.357709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.357694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.359899 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.359877 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-b75946-openshift-default-dockercfg-rpkbb\"" Jul 30 10:38:30.367771 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.367744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:38:30.437904 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.437856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.437931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.437972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.438447 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.438290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzvfl\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539546 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.539743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540084 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540084 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540084 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.539879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzvfl\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540248 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.540070 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540376 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.540348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540499 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.540375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540499 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.540425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.540975 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.540949 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.542070 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.542049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.542155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.542142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.547828 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.547806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzvfl\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.547926 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.547851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token\") pod \"e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.670232 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.670132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:30.815839 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.815809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:38:30.817411 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:38:30.817385 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd531906b_8c3d_4691_8959_f8b26ccd102e.slice/crio-f22bb7ea0131034bca21827e4abda1fb6df775378244b5c2b164dbc2c51af87b WatchSource:0}: Error finding container f22bb7ea0131034bca21827e4abda1fb6df775378244b5c2b164dbc2c51af87b: Status 404 returned error can't find the container with id f22bb7ea0131034bca21827e4abda1fb6df775378244b5c2b164dbc2c51af87b Jul 30 10:38:30.819422 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.819394 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:30.819495 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.819459 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:30.819534 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.819507 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:30.975815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.975722 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerStarted","Data":"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a"} Jul 30 10:38:30.975815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.975779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerStarted","Data":"f22bb7ea0131034bca21827e4abda1fb6df775378244b5c2b164dbc2c51af87b"} Jul 30 10:38:30.996380 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:30.996317 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podStartSLOduration=0.996295837 podStartE2EDuration="996.295837ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:38:30.992728521 +0000 UTC m=+2926.519155872" watchObservedRunningTime="2026-07-30 10:38:30.996295837 +0000 UTC m=+2926.522723166" Jul 30 10:38:31.671365 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:31.671326 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:31.676323 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:31.676296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:31.982430 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:31.982317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:31.983131 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:31.983114 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:34.706430 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.706361 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:38:34.885007 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.884950 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vls4x\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885007 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885072 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885171 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885226 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885293 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.885628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885364 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket\") pod \"85262633-16e1-4d03-9a68-4f50e3686bdd\" (UID: \"85262633-16e1-4d03-9a68-4f50e3686bdd\") " Jul 30 10:38:34.886606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.885919 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:34.886606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.886112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:34.886606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.886191 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:38:34.886606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.886362 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:34.886995 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.886970 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data" (OuterVolumeSpecName: "istio-data") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:34.888227 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.888202 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token" (OuterVolumeSpecName: "istio-token") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:38:34.888328 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.888254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:38:34.888481 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.888456 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x" (OuterVolumeSpecName: "kube-api-access-vls4x") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "kube-api-access-vls4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:38:34.888648 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.888628 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85262633-16e1-4d03-9a68-4f50e3686bdd" (UID: "85262633-16e1-4d03-9a68-4f50e3686bdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986596 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986628 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vls4x\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-kube-api-access-vls4x\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986639 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85262633-16e1-4d03-9a68-4f50e3686bdd-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986647 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986656 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986664 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986671 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986678 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:34.986686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:34.986689 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85262633-16e1-4d03-9a68-4f50e3686bdd-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:38:35.002775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.002745 2576 generic.go:356] "Generic (PLEG): container finished" podID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerID="b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94" exitCode=0 Jul 30 10:38:35.002910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.002800 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" Jul 30 10:38:35.002910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.002832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerDied","Data":"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94"} Jul 30 10:38:35.002910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.002889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv" event={"ID":"85262633-16e1-4d03-9a68-4f50e3686bdd","Type":"ContainerDied","Data":"af0140e85dd289244ae279b070cd295f16f928ddb0ac38b5fff9c55e925695fe"} Jul 30 10:38:35.003014 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.002914 2576 scope.go:117] "RemoveContainer" containerID="b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94" Jul 30 10:38:35.011881 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.011861 2576 scope.go:117] "RemoveContainer" containerID="48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b" Jul 30 10:38:35.019054 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.019019 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:38:35.020999 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.020979 2576 scope.go:117] "RemoveContainer" containerID="b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94" Jul 30 10:38:35.021307 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:38:35.021284 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94\": container with ID starting with b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94 not found: ID does not exist" containerID="b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94" Jul 30 10:38:35.021362 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.021316 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94"} err="failed to get container status \"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94\": rpc error: code = NotFound desc = could not find container \"b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94\": container with ID starting with b74d81e56b4d5aeb4992a244485138171435674a140a039e4fd8793a8489ef94 not found: ID does not exist" Jul 30 10:38:35.021362 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.021336 2576 scope.go:117] "RemoveContainer" containerID="48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b" Jul 30 10:38:35.021609 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:38:35.021585 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b\": container with ID starting with 48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b not found: ID does not exist" containerID="48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b" Jul 30 10:38:35.021648 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.021618 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b"} err="failed to get container status \"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b\": rpc error: code = NotFound desc = could not find container \"48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b\": container with ID starting with 48fbadb33c89f1006363cc3e80e1157fb5fed7a784c9c387835161991d59c82b not found: ID does not exist" Jul 30 10:38:35.023327 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:35.023308 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-220161-openshift-default-5bf996c57d-c5wfv"] Jul 30 10:38:36.931835 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:36.931797 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" path="/var/lib/kubelet/pods/85262633-16e1-4d03-9a68-4f50e3686bdd/volumes" Jul 30 10:38:47.692629 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:47.692238 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": read tcp 10.134.0.2:41604->10.134.0.68:15021: read: connection reset by peer" start-of-body= Jul 30 10:38:47.692629 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:47.692312 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": read tcp 10.134.0.2:41604->10.134.0.68:15021: read: connection reset by peer" Jul 30 10:38:48.098969 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.098873 2576 generic.go:356] "Generic (PLEG): container finished" podID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerID="6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a" exitCode=0 Jul 30 10:38:48.098969 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.098942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerDied","Data":"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a"} Jul 30 10:38:48.099406 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.099390 2576 scope.go:117] "RemoveContainer" containerID="6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a" Jul 30 10:38:48.100501 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.100474 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:48.100562 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.100538 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:48.100602 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:48.100569 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:49.107444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:49.107408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerStarted","Data":"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30"} Jul 30 10:38:49.670289 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:49.670246 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:49.670607 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:49.670581 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Jul 30 10:38:49.670709 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:49.670639 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Jul 30 10:38:50.671013 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:50.670973 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Jul 30 10:38:50.671423 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:50.671047 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Jul 30 10:38:51.670536 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:51.670495 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Jul 30 10:38:51.670722 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:51.670557 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Jul 30 10:38:52.670685 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:52.670647 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Jul 30 10:38:52.671099 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:52.670728 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Jul 30 10:38:53.674713 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:53.674679 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:53.675186 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:53.674956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:53.675743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:53.675723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:38:58.566511 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.566472 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:38:58.566919 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.566908 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.566976 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.566921 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.566976 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.566933 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.566976 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.566939 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.567103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.567017 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.567103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.567038 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6135593f-e02a-48e4-a891-beab1c8d1333" containerName="istio-proxy" Jul 30 10:38:58.567103 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.567048 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85262633-16e1-4d03-9a68-4f50e3686bdd" containerName="istio-proxy" Jul 30 10:38:58.570178 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.570156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.572448 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.572417 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bdf164-openshift-default-dockercfg-v4khp\"" Jul 30 10:38:58.581212 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.581176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:38:58.640358 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rft4w\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640767 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640767 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640767 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640914 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.640914 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.640812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741489 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rft4w\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741690 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741690 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741690 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741690 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741690 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741953 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741953 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.741953 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.741762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.742245 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.742218 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.742365 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.742268 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.742365 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.742295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.742605 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.742581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.742691 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.742670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.744405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.744374 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.744405 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.744389 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.749153 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.749128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.749261 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.749233 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rft4w\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w\") pod \"e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:58.882951 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:58.882911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:38:59.057281 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.057249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:38:59.059088 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:38:59.059051 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8447a6c2_db0f_4f97_a9f6_194e7ded5f51.slice/crio-093b765421a702e3ceb8505b18a2ee12c4d97eebbe7e5fff675fac618df3bbaf WatchSource:0}: Error finding container 093b765421a702e3ceb8505b18a2ee12c4d97eebbe7e5fff675fac618df3bbaf: Status 404 returned error can't find the container with id 093b765421a702e3ceb8505b18a2ee12c4d97eebbe7e5fff675fac618df3bbaf Jul 30 10:38:59.061348 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.061311 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:59.061477 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.061381 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:59.061477 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.061410 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:38:59.167134 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.167003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerStarted","Data":"3e78cbd51c481e71e062ddc15830562bfaabc99eaad3625385a2ee2f8982950a"} Jul 30 10:38:59.167134 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.167093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerStarted","Data":"093b765421a702e3ceb8505b18a2ee12c4d97eebbe7e5fff675fac618df3bbaf"} Jul 30 10:38:59.187932 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.187876 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podStartSLOduration=1.187859346 podStartE2EDuration="1.187859346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:38:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:38:59.185584263 +0000 UTC m=+2954.712011592" watchObservedRunningTime="2026-07-30 10:38:59.187859346 +0000 UTC m=+2954.714286673" Jul 30 10:38:59.883937 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:38:59.883884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:00.888868 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:00.888840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:01.178817 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:01.178788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:01.179685 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:01.179665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:15.260797 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.260765 2576 generic.go:356] "Generic (PLEG): container finished" podID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerID="3e78cbd51c481e71e062ddc15830562bfaabc99eaad3625385a2ee2f8982950a" exitCode=0 Jul 30 10:39:15.261336 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.260838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerDied","Data":"3e78cbd51c481e71e062ddc15830562bfaabc99eaad3625385a2ee2f8982950a"} Jul 30 10:39:15.261336 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.261297 2576 scope.go:117] "RemoveContainer" containerID="3e78cbd51c481e71e062ddc15830562bfaabc99eaad3625385a2ee2f8982950a" Jul 30 10:39:15.262359 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.262331 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:39:15.262471 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.262410 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:39:15.262471 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:15.262455 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:39:16.179070 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:16.179024 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:16.267987 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:16.267950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerStarted","Data":"13e349490bbe202c67066e613d9cff98bc52fd6d5affe67859968790edcd540e"} Jul 30 10:39:16.883875 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:16.883840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:16.885154 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:16.885128 2576 patch_prober.go:28] interesting pod/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Jul 30 10:39:16.885281 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:16.885189 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Jul 30 10:39:17.884219 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:17.884185 2576 patch_prober.go:28] interesting pod/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Jul 30 10:39:17.884581 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:17.884248 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Jul 30 10:39:18.884056 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:18.883984 2576 patch_prober.go:28] interesting pod/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Jul 30 10:39:18.884255 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:18.884080 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Jul 30 10:39:19.883494 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:19.883460 2576 patch_prober.go:28] interesting pod/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Jul 30 10:39:19.883678 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:19.883515 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Jul 30 10:39:20.887106 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:20.887075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:20.887481 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:20.887452 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:39:20.888238 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:39:20.888218 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:42:21.670101 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.670006 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:21.673578 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.673557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:21.688578 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.688548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:21.849910 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.849874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgkb5\" (UniqueName: \"kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5\") pod \"kuadrant-operator-catalog-tfbdf\" (UID: \"1039c58c-2059-4086-81d4-39b55cb99740\") " pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:21.951051 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.950949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgkb5\" (UniqueName: \"kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5\") pod \"kuadrant-operator-catalog-tfbdf\" (UID: \"1039c58c-2059-4086-81d4-39b55cb99740\") " pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:21.959508 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.959481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgkb5\" (UniqueName: \"kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5\") pod \"kuadrant-operator-catalog-tfbdf\" (UID: \"1039c58c-2059-4086-81d4-39b55cb99740\") " pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:21.983758 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:21.983734 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:22.122495 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:22.122467 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:22.124231 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:42:22.124203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1039c58c_2059_4086_81d4_39b55cb99740.slice/crio-ff10cb7a645b6a4fecb46a51285daeddb656f18bf1595f6b03e3a9bd69ade608 WatchSource:0}: Error finding container ff10cb7a645b6a4fecb46a51285daeddb656f18bf1595f6b03e3a9bd69ade608: Status 404 returned error can't find the container with id ff10cb7a645b6a4fecb46a51285daeddb656f18bf1595f6b03e3a9bd69ade608 Jul 30 10:42:22.125987 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:22.125971 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 10:42:22.325122 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:22.325019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" event={"ID":"1039c58c-2059-4086-81d4-39b55cb99740","Type":"ContainerStarted","Data":"ff10cb7a645b6a4fecb46a51285daeddb656f18bf1595f6b03e3a9bd69ade608"} Jul 30 10:42:24.339777 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:24.339682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" event={"ID":"1039c58c-2059-4086-81d4-39b55cb99740","Type":"ContainerStarted","Data":"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979"} Jul 30 10:42:24.354663 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:24.354601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" podStartSLOduration=1.529516415 podStartE2EDuration="3.3545846s" totalImagesPullingTime="1.825068185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:42:24.353920979 +0000 UTC m=+3159.880348307" watchObservedRunningTime="2026-07-30 10:42:24.3545846 +0000 UTC m=+3159.881011960" Jul 30 10:42:31.984303 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:31.984230 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:31.984303 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:31.984292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:32.005136 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:32.005106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:32.412507 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:32.412480 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:32.452961 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:32.452928 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:34.402109 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:34.402066 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" podUID="1039c58c-2059-4086-81d4-39b55cb99740" containerName="registry-server" containerID="cri-o://ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979" gracePeriod=2 Jul 30 10:42:34.647775 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:34.647746 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:34.674173 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:34.674097 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgkb5\" (UniqueName: \"kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5\") pod \"1039c58c-2059-4086-81d4-39b55cb99740\" (UID: \"1039c58c-2059-4086-81d4-39b55cb99740\") " Jul 30 10:42:34.676164 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:34.676142 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5" (OuterVolumeSpecName: "kube-api-access-rgkb5") pod "1039c58c-2059-4086-81d4-39b55cb99740" (UID: "1039c58c-2059-4086-81d4-39b55cb99740"). InnerVolumeSpecName "kube-api-access-rgkb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:42:34.775905 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:34.775869 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgkb5\" (UniqueName: \"kubernetes.io/projected/1039c58c-2059-4086-81d4-39b55cb99740-kube-api-access-rgkb5\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:42:35.408550 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.408518 2576 generic.go:356] "Generic (PLEG): container finished" podID="1039c58c-2059-4086-81d4-39b55cb99740" containerID="ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979" exitCode=0 Jul 30 10:42:35.408945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.408561 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" Jul 30 10:42:35.408945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.408608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" event={"ID":"1039c58c-2059-4086-81d4-39b55cb99740","Type":"ContainerDied","Data":"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979"} Jul 30 10:42:35.408945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.408658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfbdf" event={"ID":"1039c58c-2059-4086-81d4-39b55cb99740","Type":"ContainerDied","Data":"ff10cb7a645b6a4fecb46a51285daeddb656f18bf1595f6b03e3a9bd69ade608"} Jul 30 10:42:35.408945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.408683 2576 scope.go:117] "RemoveContainer" containerID="ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979" Jul 30 10:42:35.418303 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.418282 2576 scope.go:117] "RemoveContainer" containerID="ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979" Jul 30 10:42:35.418556 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:42:35.418534 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979\": container with ID starting with ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979 not found: ID does not exist" containerID="ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979" Jul 30 10:42:35.418628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.418567 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979"} err="failed to get container status \"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979\": rpc error: code = NotFound desc = could not find container \"ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979\": container with ID starting with ff4fd61b48993a5c204bb03c2ee76a02535bc79da5b64a7a3d23aa87bd5e3979 not found: ID does not exist" Jul 30 10:42:35.424457 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.424435 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:35.426784 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:35.426765 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfbdf"] Jul 30 10:42:36.930723 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:42:36.930691 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1039c58c-2059-4086-81d4-39b55cb99740" path="/var/lib/kubelet/pods/1039c58c-2059-4086-81d4-39b55cb99740/volumes" Jul 30 10:50:53.422565 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.422528 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:50:53.423013 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.422928 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1039c58c-2059-4086-81d4-39b55cb99740" containerName="registry-server" Jul 30 10:50:53.423013 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.422940 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1039c58c-2059-4086-81d4-39b55cb99740" containerName="registry-server" Jul 30 10:50:53.423116 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.423016 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1039c58c-2059-4086-81d4-39b55cb99740" containerName="registry-server" Jul 30 10:50:53.426230 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.426207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.428589 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.428561 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-78eb1c\"" Jul 30 10:50:53.428823 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.428807 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-78eb1c-dockercfg-b7b5s\"" Jul 30 10:50:53.440238 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.440203 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:50:53.538485 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.538451 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpgkv\" (UniqueName: \"kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.538676 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.538627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.640281 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.640239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.640481 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.640341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpgkv\" (UniqueName: \"kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.641006 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.640979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.648708 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.648684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpgkv\" (UniqueName: \"kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv\") pod \"payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:53.737701 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:53.737614 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:54.085737 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:54.085713 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:50:54.087614 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:50:54.087586 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e1c0c8_db69_47a8_ba12_025e06800546.slice/crio-d352e1f968df8184013c36f009ef6aa38655bc2cb755b61b41b50e5a4c30f4f9 WatchSource:0}: Error finding container d352e1f968df8184013c36f009ef6aa38655bc2cb755b61b41b50e5a4c30f4f9: Status 404 returned error can't find the container with id d352e1f968df8184013c36f009ef6aa38655bc2cb755b61b41b50e5a4c30f4f9 Jul 30 10:50:54.226187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:54.226153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" event={"ID":"f9e1c0c8-db69-47a8-ba12-025e06800546","Type":"ContainerStarted","Data":"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd"} Jul 30 10:50:54.226322 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:54.226214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" event={"ID":"f9e1c0c8-db69-47a8-ba12-025e06800546","Type":"ContainerStarted","Data":"d352e1f968df8184013c36f009ef6aa38655bc2cb755b61b41b50e5a4c30f4f9"} Jul 30 10:50:54.226381 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:54.226366 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:50:54.244838 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:50:54.244793 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" podStartSLOduration=1.244773864 podStartE2EDuration="1.244773864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:50:54.242335327 +0000 UTC m=+3669.768762667" watchObservedRunningTime="2026-07-30 10:50:54.244773864 +0000 UTC m=+3669.771201197" Jul 30 10:51:05.233591 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:05.233560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:51:22.511303 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.511225 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:51:22.514653 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.514635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.516891 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.516870 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2aadf4-dockercfg-n7jlz\"" Jul 30 10:51:22.516891 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.516887 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2aadf4\"" Jul 30 10:51:22.523484 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.523462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:51:22.536519 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.536496 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:51:22.539949 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.539928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.550828 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.550799 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:51:22.639078 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.639016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lng79\" (UniqueName: \"kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.639249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.639121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm5q8\" (UniqueName: \"kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.639249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.639150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.639249 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.639182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.739870 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.739834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm5q8\" (UniqueName: \"kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.739870 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.739874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.740155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.739903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.740155 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.740003 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lng79\" (UniqueName: \"kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.740661 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.740643 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.740708 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.740669 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.748495 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.748473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lng79\" (UniqueName: \"kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79\") pod \"payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.748704 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.748683 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm5q8\" (UniqueName: \"kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8\") pod \"payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.827875 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.827799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:22.852178 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.852148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:22.975603 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:22.975562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:51:22.976472 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:51:22.976421 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac53818_3d11_43c6_a1d8_aed54fd42357.slice/crio-966146a66dfd7400c604a2daa7ca179d47fbfe09ed1c2962e15a997d8481b9f2 WatchSource:0}: Error finding container 966146a66dfd7400c604a2daa7ca179d47fbfe09ed1c2962e15a997d8481b9f2: Status 404 returned error can't find the container with id 966146a66dfd7400c604a2daa7ca179d47fbfe09ed1c2962e15a997d8481b9f2 Jul 30 10:51:23.013090 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.013063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:51:23.017269 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:51:23.017246 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e5ba91_edbf_498f_858f_f1b1b8be9623.slice/crio-9decfb2047a42e3094dfe3e13989b68e1b7979216c71c7095600316e2da2dd6a WatchSource:0}: Error finding container 9decfb2047a42e3094dfe3e13989b68e1b7979216c71c7095600316e2da2dd6a: Status 404 returned error can't find the container with id 9decfb2047a42e3094dfe3e13989b68e1b7979216c71c7095600316e2da2dd6a Jul 30 10:51:23.396621 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.396584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" event={"ID":"04e5ba91-edbf-498f-858f-f1b1b8be9623","Type":"ContainerStarted","Data":"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e"} Jul 30 10:51:23.396800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.396643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" event={"ID":"04e5ba91-edbf-498f-858f-f1b1b8be9623","Type":"ContainerStarted","Data":"9decfb2047a42e3094dfe3e13989b68e1b7979216c71c7095600316e2da2dd6a"} Jul 30 10:51:23.396800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.396774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:23.398154 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.398133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" event={"ID":"4ac53818-3d11-43c6-a1d8-aed54fd42357","Type":"ContainerStarted","Data":"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961"} Jul 30 10:51:23.398280 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.398170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" event={"ID":"4ac53818-3d11-43c6-a1d8-aed54fd42357","Type":"ContainerStarted","Data":"966146a66dfd7400c604a2daa7ca179d47fbfe09ed1c2962e15a997d8481b9f2"} Jul 30 10:51:23.398280 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.398189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:23.413352 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.413312 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" podStartSLOduration=1.413301294 podStartE2EDuration="1.413301294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:51:23.410708121 +0000 UTC m=+3698.937135462" watchObservedRunningTime="2026-07-30 10:51:23.413301294 +0000 UTC m=+3698.939728664" Jul 30 10:51:23.428040 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:23.427997 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" podStartSLOduration=1.427985509 podStartE2EDuration="1.427985509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:51:23.425390492 +0000 UTC m=+3698.951817820" watchObservedRunningTime="2026-07-30 10:51:23.427985509 +0000 UTC m=+3698.954412836" Jul 30 10:51:34.406119 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:34.406088 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:51:34.406490 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:34.406158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:51:52.734467 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:52.734437 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log" Jul 30 10:51:52.863214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:51:52.863185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk_4ac53818-3d11-43c6-a1d8-aed54fd42357/payload-processing/0.log" Jul 30 10:52:53.263161 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:53.263086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log" Jul 30 10:52:53.396422 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:53.396394 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk_4ac53818-3d11-43c6-a1d8-aed54fd42357/payload-processing/0.log" Jul 30 10:52:53.982352 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:53.982318 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:52:53.986106 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:53.986084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:53.988686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:53.988667 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8cd2f5-openshift-default-dockercfg-qck2r\"" Jul 30 10:52:54.003108 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.003082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:52:54.154445 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154606 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrjz\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154686 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154752 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154752 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154819 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.154819 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.154791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256430 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256430 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrjz\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256430 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256672 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256672 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256759 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256870 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256870 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.256870 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.257059 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256888 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.257059 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.256991 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.257194 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.257154 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.257444 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.257425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.258766 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.258748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.258914 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.258898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.266241 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.266215 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrjz\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.266960 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.266940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token\") pod \"e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.296926 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.296904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:54.652564 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.652540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:52:54.655478 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:52:54.655445 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8660aa86_6c15_4ede_be4e_6318dd4b233b.slice/crio-7c5e117311f0305172f1f8f54a095c0fe462e4249bc7bc48c8767ab9a7db6141 WatchSource:0}: Error finding container 7c5e117311f0305172f1f8f54a095c0fe462e4249bc7bc48c8767ab9a7db6141: Status 404 returned error can't find the container with id 7c5e117311f0305172f1f8f54a095c0fe462e4249bc7bc48c8767ab9a7db6141 Jul 30 10:52:54.658084 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.658055 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:52:54.658151 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.658121 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:52:54.658189 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.658147 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:52:54.933646 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.933551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerStarted","Data":"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc"} Jul 30 10:52:54.933646 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.933606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerStarted","Data":"7c5e117311f0305172f1f8f54a095c0fe462e4249bc7bc48c8767ab9a7db6141"} Jul 30 10:52:54.952575 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:54.952509 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podStartSLOduration=1.9524931410000002 podStartE2EDuration="1.952493141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:52:54.949864482 +0000 UTC m=+3790.476291809" watchObservedRunningTime="2026-07-30 10:52:54.952493141 +0000 UTC m=+3790.478920469" Jul 30 10:52:55.297449 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:55.297359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:55.303212 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:55.303177 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:55.939335 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:55.939301 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:52:55.940304 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:52:55.940285 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:10.022863 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.022830 2576 generic.go:356] "Generic (PLEG): container finished" podID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerID="6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc" exitCode=0 Jul 30 10:53:10.023442 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.022910 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerDied","Data":"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc"} Jul 30 10:53:10.023576 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.023557 2576 scope.go:117] "RemoveContainer" containerID="6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc" Jul 30 10:53:10.024782 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.024757 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:53:10.024851 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.024824 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:53:10.024895 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.024856 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 30 10:53:10.939742 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:10.939706 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:11.031047 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:11.030987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerStarted","Data":"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d"} Jul 30 10:53:11.297345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:11.297242 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:11.298592 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:11.298563 2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Jul 30 10:53:11.298706 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:11.298625 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Jul 30 10:53:12.297570 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:12.297532 2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Jul 30 10:53:12.297960 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:12.297584 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Jul 30 10:53:13.297613 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:13.297579 2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Jul 30 10:53:13.297992 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:13.297631 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Jul 30 10:53:14.298072 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:14.298014 2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body= Jul 30 10:53:14.298454 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:14.298090 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" Jul 30 10:53:15.301517 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:15.301483 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:15.301965 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:15.301769 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:15.302445 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:15.302425 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:35.401917 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:35.401876 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:53:35.402532 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:35.402173 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" containerID="cri-o://39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d" gracePeriod=30 Jul 30 10:53:40.666095 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.666001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:40.726021 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.725985 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrjz\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726214 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726419 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726487 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726440 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726502 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:53:40.726547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726507 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726656 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726568 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket\") pod \"8660aa86-6c15-4ede-be4e-6318dd4b233b\" (UID: \"8660aa86-6c15-4ede-be4e-6318dd4b233b\") " Jul 30 10:53:40.726766 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726735 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:53:40.726766 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726733 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:53:40.726966 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.726944 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:53:40.727124 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.727109 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8660aa86-6c15-4ede-be4e-6318dd4b233b-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.727169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.727134 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.727169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.727148 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.727169 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.727163 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.727565 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.727532 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:53:40.728404 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.728381 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:53:40.728510 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.728416 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz" (OuterVolumeSpecName: "kube-api-access-hrrjz") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "kube-api-access-hrrjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:53:40.728510 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.728431 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:53:40.728862 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.728842 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8660aa86-6c15-4ede-be4e-6318dd4b233b" (UID: "8660aa86-6c15-4ede-be4e-6318dd4b233b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:53:40.828539 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.828488 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.828539 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.828536 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrjz\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-kube-api-access-hrrjz\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.828539 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.828549 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.828539 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.828558 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:40.828833 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:40.828566 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8660aa86-6c15-4ede-be4e-6318dd4b233b-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:41.220438 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.220343 2576 generic.go:356] "Generic (PLEG): container finished" podID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerID="39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d" exitCode=0 Jul 30 10:53:41.220438 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.220386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerDied","Data":"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d"} Jul 30 10:53:41.220438 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.220398 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" Jul 30 10:53:41.220438 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.220434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4" event={"ID":"8660aa86-6c15-4ede-be4e-6318dd4b233b","Type":"ContainerDied","Data":"7c5e117311f0305172f1f8f54a095c0fe462e4249bc7bc48c8767ab9a7db6141"} Jul 30 10:53:41.220755 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.220458 2576 scope.go:117] "RemoveContainer" containerID="39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d" Jul 30 10:53:41.232840 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.232814 2576 scope.go:117] "RemoveContainer" containerID="6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc" Jul 30 10:53:41.239295 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.239262 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:53:41.242281 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.242254 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8cd2f5-openshift-default-5cfb87f6cb-wgrv4"] Jul 30 10:53:41.244013 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.243955 2576 scope.go:117] "RemoveContainer" containerID="39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d" Jul 30 10:53:41.244323 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:53:41.244302 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d\": container with ID starting with 39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d not found: ID does not exist" containerID="39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d" Jul 30 10:53:41.244388 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.244333 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d"} err="failed to get container status \"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d\": rpc error: code = NotFound desc = could not find container \"39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d\": container with ID starting with 39883f817b31e27c2ceef601e34fac87a96286453aeddd0ecab76fde3a7b588d not found: ID does not exist" Jul 30 10:53:41.244388 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.244355 2576 scope.go:117] "RemoveContainer" containerID="6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc" Jul 30 10:53:41.244697 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:53:41.244665 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc\": container with ID starting with 6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc not found: ID does not exist" containerID="6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc" Jul 30 10:53:41.244760 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:41.244706 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc"} err="failed to get container status \"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc\": rpc error: code = NotFound desc = could not find container \"6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc\": container with ID starting with 6b457d3e96d81cdc6cf48700a09ad34713ddf2f6cc4b0f84e399380fd7c611cc not found: ID does not exist" Jul 30 10:53:42.931224 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:42.931192 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" path="/var/lib/kubelet/pods/8660aa86-6c15-4ede-be4e-6318dd4b233b/volumes" Jul 30 10:53:54.879800 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:54.879760 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:53:54.880370 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:54.880003 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" podUID="f9e1c0c8-db69-47a8-ba12-025e06800546" containerName="payload-pre-processing" containerID="cri-o://1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd" gracePeriod=30 Jul 30 10:53:55.175577 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.175541 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:53:55.281953 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.281909 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume\") pod \"f9e1c0c8-db69-47a8-ba12-025e06800546\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " Jul 30 10:53:55.282141 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.282075 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpgkv\" (UniqueName: \"kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv\") pod \"f9e1c0c8-db69-47a8-ba12-025e06800546\" (UID: \"f9e1c0c8-db69-47a8-ba12-025e06800546\") " Jul 30 10:53:55.282443 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.282417 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9e1c0c8-db69-47a8-ba12-025e06800546" (UID: "f9e1c0c8-db69-47a8-ba12-025e06800546"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:53:55.284146 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.284120 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv" (OuterVolumeSpecName: "kube-api-access-kpgkv") pod "f9e1c0c8-db69-47a8-ba12-025e06800546" (UID: "f9e1c0c8-db69-47a8-ba12-025e06800546"). InnerVolumeSpecName "kube-api-access-kpgkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:53:55.305571 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.305530 2576 generic.go:356] "Generic (PLEG): container finished" podID="f9e1c0c8-db69-47a8-ba12-025e06800546" containerID="1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd" exitCode=0 Jul 30 10:53:55.305757 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.305581 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" Jul 30 10:53:55.305757 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.305609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" event={"ID":"f9e1c0c8-db69-47a8-ba12-025e06800546","Type":"ContainerDied","Data":"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd"} Jul 30 10:53:55.305757 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.305663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk" event={"ID":"f9e1c0c8-db69-47a8-ba12-025e06800546","Type":"ContainerDied","Data":"d352e1f968df8184013c36f009ef6aa38655bc2cb755b61b41b50e5a4c30f4f9"} Jul 30 10:53:55.305757 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.305685 2576 scope.go:117] "RemoveContainer" containerID="1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd" Jul 30 10:53:55.315142 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.315092 2576 scope.go:117] "RemoveContainer" containerID="1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd" Jul 30 10:53:55.315408 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:53:55.315387 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd\": container with ID starting with 1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd not found: ID does not exist" containerID="1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd" Jul 30 10:53:55.315486 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.315419 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd"} err="failed to get container status \"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd\": rpc error: code = NotFound desc = could not find container \"1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd\": container with ID starting with 1c078e95e2a7264b104fc2ae05adfd6570cfa49deeb17bb293945f22775133dd not found: ID does not exist" Jul 30 10:53:55.326657 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.326630 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:53:55.332869 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.332846 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78eb1c-7699c6bbb4-plxkk"] Jul 30 10:53:55.382857 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.382821 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e1c0c8-db69-47a8-ba12-025e06800546-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:55.382857 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:55.382853 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpgkv\" (UniqueName: \"kubernetes.io/projected/f9e1c0c8-db69-47a8-ba12-025e06800546-kube-api-access-kpgkv\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:53:56.931696 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:53:56.931661 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e1c0c8-db69-47a8-ba12-025e06800546" path="/var/lib/kubelet/pods/f9e1c0c8-db69-47a8-ba12-025e06800546/volumes" Jul 30 10:54:54.536684 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.535781 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:54:54.536684 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.536020 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" podUID="4ac53818-3d11-43c6-a1d8-aed54fd42357" containerName="payload-processing" containerID="cri-o://a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961" gracePeriod=30 Jul 30 10:54:54.550329 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.550299 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:54:54.550723 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.550693 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" podUID="04e5ba91-edbf-498f-858f-f1b1b8be9623" containerName="payload-pre-processing" containerID="cri-o://37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e" gracePeriod=30 Jul 30 10:54:54.829296 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.829269 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:54:54.858574 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.858542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume\") pod \"4ac53818-3d11-43c6-a1d8-aed54fd42357\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " Jul 30 10:54:54.858743 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.858605 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm5q8\" (UniqueName: \"kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8\") pod \"4ac53818-3d11-43c6-a1d8-aed54fd42357\" (UID: \"4ac53818-3d11-43c6-a1d8-aed54fd42357\") " Jul 30 10:54:54.859017 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.858973 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ac53818-3d11-43c6-a1d8-aed54fd42357" (UID: "4ac53818-3d11-43c6-a1d8-aed54fd42357"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:54:54.860986 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.860964 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8" (OuterVolumeSpecName: "kube-api-access-hm5q8") pod "4ac53818-3d11-43c6-a1d8-aed54fd42357" (UID: "4ac53818-3d11-43c6-a1d8-aed54fd42357"). InnerVolumeSpecName "kube-api-access-hm5q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:54:54.862127 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.862106 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:54:54.960206 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.960170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lng79\" (UniqueName: \"kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79\") pod \"04e5ba91-edbf-498f-858f-f1b1b8be9623\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " Jul 30 10:54:54.960374 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.960268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume\") pod \"04e5ba91-edbf-498f-858f-f1b1b8be9623\" (UID: \"04e5ba91-edbf-498f-858f-f1b1b8be9623\") " Jul 30 10:54:54.960611 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.960594 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac53818-3d11-43c6-a1d8-aed54fd42357-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:54:54.960655 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.960620 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm5q8\" (UniqueName: \"kubernetes.io/projected/4ac53818-3d11-43c6-a1d8-aed54fd42357-kube-api-access-hm5q8\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:54:54.960655 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.960631 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04e5ba91-edbf-498f-858f-f1b1b8be9623" (UID: "04e5ba91-edbf-498f-858f-f1b1b8be9623"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:54:54.962282 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:54.962260 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79" (OuterVolumeSpecName: "kube-api-access-lng79") pod "04e5ba91-edbf-498f-858f-f1b1b8be9623" (UID: "04e5ba91-edbf-498f-858f-f1b1b8be9623"). InnerVolumeSpecName "kube-api-access-lng79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:54:55.061392 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.061300 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04e5ba91-edbf-498f-858f-f1b1b8be9623-plugins-config-volume\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:54:55.061392 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.061335 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lng79\" (UniqueName: \"kubernetes.io/projected/04e5ba91-edbf-498f-858f-f1b1b8be9623-kube-api-access-lng79\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:54:55.661701 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.661665 2576 generic.go:356] "Generic (PLEG): container finished" podID="04e5ba91-edbf-498f-858f-f1b1b8be9623" containerID="37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e" exitCode=0 Jul 30 10:54:55.662181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.661741 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" Jul 30 10:54:55.662181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.661758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" event={"ID":"04e5ba91-edbf-498f-858f-f1b1b8be9623","Type":"ContainerDied","Data":"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e"} Jul 30 10:54:55.662181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.661825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n" event={"ID":"04e5ba91-edbf-498f-858f-f1b1b8be9623","Type":"ContainerDied","Data":"9decfb2047a42e3094dfe3e13989b68e1b7979216c71c7095600316e2da2dd6a"} Jul 30 10:54:55.662181 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.661858 2576 scope.go:117] "RemoveContainer" containerID="37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e" Jul 30 10:54:55.663352 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.663259 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ac53818-3d11-43c6-a1d8-aed54fd42357" containerID="a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961" exitCode=0 Jul 30 10:54:55.663352 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.663306 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" Jul 30 10:54:55.663352 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.663315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" event={"ID":"4ac53818-3d11-43c6-a1d8-aed54fd42357","Type":"ContainerDied","Data":"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961"} Jul 30 10:54:55.663478 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.663369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk" event={"ID":"4ac53818-3d11-43c6-a1d8-aed54fd42357","Type":"ContainerDied","Data":"966146a66dfd7400c604a2daa7ca179d47fbfe09ed1c2962e15a997d8481b9f2"} Jul 30 10:54:55.672679 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.672659 2576 scope.go:117] "RemoveContainer" containerID="37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e" Jul 30 10:54:55.672960 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:54:55.672939 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e\": container with ID starting with 37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e not found: ID does not exist" containerID="37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e" Jul 30 10:54:55.673005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.672970 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e"} err="failed to get container status \"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e\": rpc error: code = NotFound desc = could not find container \"37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e\": container with ID starting with 37a8763744f03e7effe8bc468666ee87ffeb5d2783b1e11ab7e49ea4a9e0cb3e not found: ID does not exist" Jul 30 10:54:55.673005 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.672988 2576 scope.go:117] "RemoveContainer" containerID="a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961" Jul 30 10:54:55.681547 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.681518 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:54:55.682038 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.682014 2576 scope.go:117] "RemoveContainer" containerID="a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961" Jul 30 10:54:55.682334 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:54:55.682315 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961\": container with ID starting with a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961 not found: ID does not exist" containerID="a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961" Jul 30 10:54:55.682378 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.682342 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961"} err="failed to get container status \"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961\": rpc error: code = NotFound desc = could not find container \"a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961\": container with ID starting with a7f3435daee9cc50b6ca540fa55391476b5c3db22e15c12c6cd652a217085961 not found: ID does not exist" Jul 30 10:54:55.688843 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.688816 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2aadf4-db6bbfcb8-2sfbk"] Jul 30 10:54:55.701271 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.701237 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:54:55.707345 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:55.707316 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-2aadf4-84b65858b4-zh98n"] Jul 30 10:54:56.931815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:56.931771 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e5ba91-edbf-498f-858f-f1b1b8be9623" path="/var/lib/kubelet/pods/04e5ba91-edbf-498f-858f-f1b1b8be9623/volumes" Jul 30 10:54:56.932375 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:54:56.932355 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac53818-3d11-43c6-a1d8-aed54fd42357" path="/var/lib/kubelet/pods/4ac53818-3d11-43c6-a1d8-aed54fd42357/volumes" Jul 30 10:55:19.928110 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:19.928072 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:55:19.928703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:19.928338 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" containerID="cri-o://c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30" gracePeriod=30 Jul 30 10:55:23.677369 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:23.677335 2576 patch_prober.go:28] interesting pod/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:55:23.677734 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:23.677400 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:55:25.191678 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.191616 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:55:25.363136 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363104 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363327 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363168 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363327 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363459 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363341 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363459 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363391 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363459 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzvfl\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363441 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:25.363670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363473 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363513 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:25.363670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363521 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363670 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363582 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs\") pod \"d531906b-8c3d-4691-8959-f8b26ccd102e\" (UID: \"d531906b-8c3d-4691-8959-f8b26ccd102e\") " Jul 30 10:55:25.363938 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.363814 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:55:25.364129 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.364095 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:25.364210 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.364179 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.364210 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.364203 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.364317 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.364218 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d531906b-8c3d-4691-8959-f8b26ccd102e-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.364528 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.364499 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:25.365596 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.365564 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:55:25.365708 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.365632 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl" (OuterVolumeSpecName: "kube-api-access-gzvfl") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "kube-api-access-gzvfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:55:25.365770 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.365737 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:55:25.365770 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.365737 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d531906b-8c3d-4691-8959-f8b26ccd102e" (UID: "d531906b-8c3d-4691-8959-f8b26ccd102e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465223 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465247 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465256 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465264 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465271 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d531906b-8c3d-4691-8959-f8b26ccd102e-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.465297 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.465279 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzvfl\" (UniqueName: \"kubernetes.io/projected/d531906b-8c3d-4691-8959-f8b26ccd102e-kube-api-access-gzvfl\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:25.841011 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.840910 2576 generic.go:356] "Generic (PLEG): container finished" podID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerID="c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30" exitCode=0 Jul 30 10:55:25.841011 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.840961 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" Jul 30 10:55:25.841011 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.841002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerDied","Data":"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30"} Jul 30 10:55:25.841334 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.841069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg" event={"ID":"d531906b-8c3d-4691-8959-f8b26ccd102e","Type":"ContainerDied","Data":"f22bb7ea0131034bca21827e4abda1fb6df775378244b5c2b164dbc2c51af87b"} Jul 30 10:55:25.841334 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.841093 2576 scope.go:117] "RemoveContainer" containerID="c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30" Jul 30 10:55:25.851211 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.851195 2576 scope.go:117] "RemoveContainer" containerID="6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a" Jul 30 10:55:25.859723 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.859707 2576 scope.go:117] "RemoveContainer" containerID="c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30" Jul 30 10:55:25.859977 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:55:25.859959 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30\": container with ID starting with c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30 not found: ID does not exist" containerID="c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30" Jul 30 10:55:25.860041 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.859986 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30"} err="failed to get container status \"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30\": rpc error: code = NotFound desc = could not find container \"c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30\": container with ID starting with c21a7a88fb7655ca599650be71174a07afba68d677409569f0dcaaa555915f30 not found: ID does not exist" Jul 30 10:55:25.860041 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.860006 2576 scope.go:117] "RemoveContainer" containerID="6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a" Jul 30 10:55:25.860240 ip-10-0-130-75 kubenswrapper[2576]: E0730 10:55:25.860225 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a\": container with ID starting with 6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a not found: ID does not exist" containerID="6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a" Jul 30 10:55:25.860290 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.860244 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a"} err="failed to get container status \"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a\": rpc error: code = NotFound desc = could not find container \"6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a\": container with ID starting with 6af4a7d2b9f97c769c06d5f550d9cdb48a5680bca1beb078462c9d49aeac4b2a not found: ID does not exist" Jul 30 10:55:25.864717 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.864696 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:55:25.867019 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:25.866998 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-b75946-openshift-default-7ddbc54776-v7mtg"] Jul 30 10:55:26.932548 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:26.932504 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" path="/var/lib/kubelet/pods/d531906b-8c3d-4691-8959-f8b26ccd102e/volumes" Jul 30 10:55:33.717995 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:33.717961 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:55:33.718435 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:33.718239 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" containerID="cri-o://13e349490bbe202c67066e613d9cff98bc52fd6d5affe67859968790edcd540e" gracePeriod=30 Jul 30 10:55:34.403892 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:34.403842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c7d786c6-nbzg2_1c715ed6-ba5d-4665-a113-e1562538bee0/authorino/0.log" Jul 30 10:55:35.889881 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:35.889836 2576 patch_prober.go:28] interesting pod/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 10:55:35.890286 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:35.889896 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 10:55:38.918660 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:38.918627 2576 generic.go:356] "Generic (PLEG): container finished" podID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerID="13e349490bbe202c67066e613d9cff98bc52fd6d5affe67859968790edcd540e" exitCode=0 Jul 30 10:55:38.919022 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:38.918679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerDied","Data":"13e349490bbe202c67066e613d9cff98bc52fd6d5affe67859968790edcd540e"} Jul 30 10:55:38.919022 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:38.918757 2576 scope.go:117] "RemoveContainer" containerID="3e78cbd51c481e71e062ddc15830562bfaabc99eaad3625385a2ee2f8982950a" Jul 30 10:55:38.977062 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:38.977039 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:55:39.100200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100140 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100181 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rft4w\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100200 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100205 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100259 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100277 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100319 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100386 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket\") pod \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\" (UID: \"8447a6c2-db0f-4f97-a9f6-194e7ded5f51\") " Jul 30 10:55:39.100544 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100420 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:39.100850 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100673 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-credential-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.100850 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100728 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 10:55:39.100958 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100871 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:39.100958 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.100905 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:39.101332 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.101310 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data" (OuterVolumeSpecName: "istio-data") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:39.102521 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.102497 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 10:55:39.102628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.102537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 10:55:39.102762 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.102743 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token" (OuterVolumeSpecName: "istio-token") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:55:39.102813 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.102765 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w" (OuterVolumeSpecName: "kube-api-access-rft4w") pod "8447a6c2-db0f-4f97-a9f6-194e7ded5f51" (UID: "8447a6c2-db0f-4f97-a9f6-194e7ded5f51"). InnerVolumeSpecName "kube-api-access-rft4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 10:55:39.201455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201411 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rft4w\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-kube-api-access-rft4w\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201448 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istiod-ca-cert\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201463 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-token\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201475 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-envoy\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201485 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-data\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201496 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-certs\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201507 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-workload-socket\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.201703 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.201517 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8447a6c2-db0f-4f97-a9f6-194e7ded5f51-istio-podinfo\") on node \"ip-10-0-130-75.ec2.internal\" DevicePath \"\"" Jul 30 10:55:39.925647 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.925617 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" Jul 30 10:55:39.925647 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.925642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6" event={"ID":"8447a6c2-db0f-4f97-a9f6-194e7ded5f51","Type":"ContainerDied","Data":"093b765421a702e3ceb8505b18a2ee12c4d97eebbe7e5fff675fac618df3bbaf"} Jul 30 10:55:39.926187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.925691 2576 scope.go:117] "RemoveContainer" containerID="13e349490bbe202c67066e613d9cff98bc52fd6d5affe67859968790edcd540e" Jul 30 10:55:39.957233 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.957201 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:55:39.959506 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:39.959469 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bdf164-openshift-default-7c4d6cfd88-f7wv6"] Jul 30 10:55:40.418732 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:40.418699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bmft4_fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae/manager/0.log" Jul 30 10:55:40.665231 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:40.665203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ps7fx_fa4ccb44-020c-441d-a0a3-03efdada283c/copy-manifests/0.log" Jul 30 10:55:40.672080 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:40.672005 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ps7fx_fa4ccb44-020c-441d-a0a3-03efdada283c/manager/0.log" Jul 30 10:55:40.930993 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:40.930914 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" path="/var/lib/kubelet/pods/8447a6c2-db0f-4f97-a9f6-194e7ded5f51/volumes" Jul 30 10:55:42.433459 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.433427 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/pull/0.log" Jul 30 10:55:42.439654 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.439637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/extract/0.log" Jul 30 10:55:42.447626 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.447604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/util/0.log" Jul 30 10:55:42.565937 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.565907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/util/0.log" Jul 30 10:55:42.572218 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.572195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/pull/0.log" Jul 30 10:55:42.577945 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.577915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/extract/0.log" Jul 30 10:55:42.698555 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.698485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/util/0.log" Jul 30 10:55:42.705241 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.705218 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/pull/0.log" Jul 30 10:55:42.711407 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.711392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/extract/0.log" Jul 30 10:55:42.836628 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.836598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/pull/0.log" Jul 30 10:55:42.843723 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.843701 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/extract/0.log" Jul 30 10:55:42.849836 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.849812 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/util/0.log" Jul 30 10:55:42.975618 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:42.975522 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c7d786c6-nbzg2_1c715ed6-ba5d-4665-a113-e1562538bee0/authorino/0.log" Jul 30 10:55:43.096979 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:43.096955 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qw96q_52f03e01-deda-4308-b136-a09b0a5dc239/manager/0.log" Jul 30 10:55:43.213554 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:43.213523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-48zks_1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad/manager/0.log" Jul 30 10:55:43.455036 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:43.454994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d7h9q_5898e86e-a1ef-409e-8075-a733b9ce3873/registry-server/0.log" Jul 30 10:55:43.578199 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:43.578166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7plzd_c463b2f7-c075-4392-acf3-d030054790a9/manager/0.log" Jul 30 10:55:44.191788 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.191762 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm_4814d9fe-ca93-4e23-b370-fddd3a9036de/istio-proxy/0.log" Jul 30 10:55:44.320584 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.320556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qfnr9_68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba/discovery/0.log" Jul 30 10:55:44.543527 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.543446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-sd6jn_5ef80a82-be8c-40c0-9b15-da2e6ac976db/kube-auth-proxy/0.log" Jul 30 10:55:44.663773 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.663745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/1.log" Jul 30 10:55:44.791614 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.791581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-twjpn_d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e/payload-pre-processing/0.log" Jul 30 10:55:44.912216 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:44.912189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log" Jul 30 10:55:45.507522 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:45.507490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fjqff_b4a42aba-2354-4b15-b949-6f27db9cfae9/main/0.log" Jul 30 10:55:45.969907 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:45.969874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-2nk2p_9607f53c-647e-4314-8de0-c0d234ca74d7/main/0.log" Jul 30 10:55:56.297449 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:56.297417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j24lw_f4a228ab-95eb-44cc-94e5-e67aa7f761d4/global-pull-secret-syncer/0.log" Jul 30 10:55:56.482512 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:56.482476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zjczc_ee858e02-b84e-4f6f-b50d-96f28f172477/konnectivity-agent/0.log" Jul 30 10:55:56.526676 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:55:56.526644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-75.ec2.internal_cfe6536f353a8e0145bc66b1c5423231/haproxy/0.log" Jul 30 10:56:00.868314 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:00.868284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/extract/0.log" Jul 30 10:56:00.893328 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:00.893300 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/util/0.log" Jul 30 10:56:00.920367 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:00.920337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jlldh_102b57e3-c586-4198-b4cf-5fc41d6b13b4/pull/0.log" Jul 30 10:56:00.954236 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:00.954206 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/extract/0.log" Jul 30 10:56:00.978011 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:00.977976 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/util/0.log" Jul 30 10:56:01.003888 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.003862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pblft_09f1e662-07bd-4ebc-9e51-40f299103af9/pull/0.log" Jul 30 10:56:01.037819 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.037789 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/extract/0.log" Jul 30 10:56:01.078348 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.078318 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/util/0.log" Jul 30 10:56:01.109381 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.109352 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v9g4q_3bf12fb7-badf-40d3-a1eb-a4feacbf7f8c/pull/0.log" Jul 30 10:56:01.153251 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.153165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/extract/0.log" Jul 30 10:56:01.188836 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.188808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/util/0.log" Jul 30 10:56:01.225965 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.225939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1946kq_589dc390-65fe-4175-9fca-7ebc4ee654d1/pull/0.log" Jul 30 10:56:01.606844 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.606816 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66c7d786c6-nbzg2_1c715ed6-ba5d-4665-a113-e1562538bee0/authorino/0.log" Jul 30 10:56:01.665698 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.665668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qw96q_52f03e01-deda-4308-b136-a09b0a5dc239/manager/0.log" Jul 30 10:56:01.709218 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.709189 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-48zks_1a3b4eb8-8752-4d42-b4c3-20dbae4f7aad/manager/0.log" Jul 30 10:56:01.805455 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.805422 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-d7h9q_5898e86e-a1ef-409e-8075-a733b9ce3873/registry-server/0.log" Jul 30 10:56:01.895687 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:01.895593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7plzd_c463b2f7-c075-4392-acf3-d030054790a9/manager/0.log" Jul 30 10:56:04.183298 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.183270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dcf96bf5-hkhzf_b9ab96ae-2bde-4fcf-a96b-69909d53e939/metrics-server/0.log" Jul 30 10:56:04.216513 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.216486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-r7psv_79f7f9ad-6c12-43de-94ba-a983670aabbe/monitoring-plugin/0.log" Jul 30 10:56:04.262884 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.262855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6sbxg_63959dfc-fccf-44ac-b88d-fb1980a6dac9/node-exporter/0.log" Jul 30 10:56:04.293545 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.293517 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6sbxg_63959dfc-fccf-44ac-b88d-fb1980a6dac9/kube-rbac-proxy/0.log" Jul 30 10:56:04.314801 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.314775 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6sbxg_63959dfc-fccf-44ac-b88d-fb1980a6dac9/init-textfile/0.log" Jul 30 10:56:04.504587 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.504511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7cxwx_ac7ad486-7911-416d-a2ac-55102cdafc26/kube-rbac-proxy-main/0.log" Jul 30 10:56:04.525590 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.525561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7cxwx_ac7ad486-7911-416d-a2ac-55102cdafc26/kube-rbac-proxy-self/0.log" Jul 30 10:56:04.547277 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.547249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7cxwx_ac7ad486-7911-416d-a2ac-55102cdafc26/openshift-state-metrics/0.log" Jul 30 10:56:04.839104 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.839006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587d9f8479-dtt2k_131f5fd2-15e6-454b-bf2d-c6f812e29ff2/telemeter-client/0.log" Jul 30 10:56:04.858268 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.858241 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587d9f8479-dtt2k_131f5fd2-15e6-454b-bf2d-c6f812e29ff2/reload/0.log" Jul 30 10:56:04.878131 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.878104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587d9f8479-dtt2k_131f5fd2-15e6-454b-bf2d-c6f812e29ff2/kube-rbac-proxy/0.log" Jul 30 10:56:04.904776 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.904752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/thanos-query/0.log" Jul 30 10:56:04.922873 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.922848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/kube-rbac-proxy-web/0.log" Jul 30 10:56:04.941216 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.941185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/kube-rbac-proxy/0.log" Jul 30 10:56:04.967308 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.967288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/prom-label-proxy/0.log" Jul 30 10:56:04.986241 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:04.986223 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/kube-rbac-proxy-rules/0.log" Jul 30 10:56:05.009637 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:05.009607 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-688bb6cb8f-tncfm_a20ccf22-8443-49d7-9bf9-0c6f935cd7fc/kube-rbac-proxy-metrics/0.log" Jul 30 10:56:06.701639 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.701597 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f"] Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702090 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702113 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702127 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702136 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702144 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702150 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702171 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e5ba91-edbf-498f-858f-f1b1b8be9623" containerName="payload-pre-processing" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702180 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e5ba91-edbf-498f-858f-f1b1b8be9623" containerName="payload-pre-processing" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702194 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702202 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702228 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702236 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702246 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac53818-3d11-43c6-a1d8-aed54fd42357" containerName="payload-processing" Jul 30 10:56:06.702258 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702254 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac53818-3d11-43c6-a1d8-aed54fd42357" containerName="payload-processing" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702271 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e1c0c8-db69-47a8-ba12-025e06800546" containerName="payload-pre-processing" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702280 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e1c0c8-db69-47a8-ba12-025e06800546" containerName="payload-pre-processing" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702375 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d531906b-8c3d-4691-8959-f8b26ccd102e" containerName="istio-proxy" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702385 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e1c0c8-db69-47a8-ba12-025e06800546" containerName="payload-pre-processing" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702393 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702401 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702410 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8447a6c2-db0f-4f97-a9f6-194e7ded5f51" containerName="istio-proxy" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702416 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e5ba91-edbf-498f-858f-f1b1b8be9623" containerName="payload-pre-processing" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702426 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8660aa86-6c15-4ede-be4e-6318dd4b233b" containerName="istio-proxy" Jul 30 10:56:06.702787 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.702435 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac53818-3d11-43c6-a1d8-aed54fd42357" containerName="payload-processing" Jul 30 10:56:06.705610 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.705594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.707875 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.707850 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-94b2d\"/\"default-dockercfg-khmgf\"" Jul 30 10:56:06.708469 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.708447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-94b2d\"/\"openshift-service-ca.crt\"" Jul 30 10:56:06.709057 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.709041 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-94b2d\"/\"kube-root-ca.crt\"" Jul 30 10:56:06.715427 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.715401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f"] Jul 30 10:56:06.763462 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.763425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-sys\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.763675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.763495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-lib-modules\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.763675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.763523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-podres\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.763675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.763557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdnm\" (UniqueName: \"kubernetes.io/projected/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-kube-api-access-ksdnm\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.763675 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.763645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-proc\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864612 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-proc\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-sys\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-proc\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-lib-modules\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864760 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-sys\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.864815 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-podres\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.865115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdnm\" (UniqueName: \"kubernetes.io/projected/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-kube-api-access-ksdnm\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.865115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-lib-modules\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.865115 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.864928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-podres\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:06.874736 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:06.874702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdnm\" (UniqueName: \"kubernetes.io/projected/fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9-kube-api-access-ksdnm\") pod \"perf-node-gather-daemonset-6kt4f\" (UID: \"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9\") " pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:07.016167 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:07.016066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:07.161563 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:07.161534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f"] Jul 30 10:56:07.163260 ip-10-0-130-75 kubenswrapper[2576]: W0730 10:56:07.163233 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa5fc6e4_2efb_4ca4_80e0_c75c5a4049e9.slice/crio-4dc30590e6c5b083b052da93dd402163d5061c8e5963321c61eebee1e9f70901 WatchSource:0}: Error finding container 4dc30590e6c5b083b052da93dd402163d5061c8e5963321c61eebee1e9f70901: Status 404 returned error can't find the container with id 4dc30590e6c5b083b052da93dd402163d5061c8e5963321c61eebee1e9f70901 Jul 30 10:56:07.571559 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:07.571528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-848467f974-747pk_1202475c-e344-467f-9a40-050d97ca1819/console/0.log" Jul 30 10:56:08.082978 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:08.082938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" event={"ID":"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9","Type":"ContainerStarted","Data":"911a101a790e32aa23eac729b6a60b67370b5e5247ffc002b0a4f09f51b6f695"} Jul 30 10:56:08.083372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:08.082998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" event={"ID":"fa5fc6e4-2efb-4ca4-80e0-c75c5a4049e9","Type":"ContainerStarted","Data":"4dc30590e6c5b083b052da93dd402163d5061c8e5963321c61eebee1e9f70901"} Jul 30 10:56:08.083372 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:08.083023 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:08.099388 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:08.099341 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" podStartSLOduration=2.099325989 podStartE2EDuration="2.099325989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:56:08.097123336 +0000 UTC m=+3983.623550664" watchObservedRunningTime="2026-07-30 10:56:08.099325989 +0000 UTC m=+3983.625753317" Jul 30 10:56:09.258187 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:09.258149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ctlg_f367437a-d53f-4047-9a61-624b0f08eaca/dns/0.log" Jul 30 10:56:09.279791 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:09.279761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ctlg_f367437a-d53f-4047-9a61-624b0f08eaca/kube-rbac-proxy/0.log" Jul 30 10:56:09.441209 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:09.441181 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h82g8_6115eb50-b6f1-47d6-b97c-688be9838f2c/dns-node-resolver/0.log" Jul 30 10:56:09.997234 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:09.997196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85876df6b7-5z8xf_d4b30182-67b9-400b-9d89-b8b49022fdf1/registry/0.log" Jul 30 10:56:10.070586 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:10.070560 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrhqz_ba76faf9-4a95-4daf-932c-e86c7ee83388/node-ca/0.log" Jul 30 10:56:11.064583 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.064553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm_4814d9fe-ca93-4e23-b370-fddd3a9036de/istio-proxy/0.log" Jul 30 10:56:11.224837 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.224796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qfnr9_68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba/discovery/0.log" Jul 30 10:56:11.272799 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.272772 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-sd6jn_5ef80a82-be8c-40c0-9b15-da2e6ac976db/kube-auth-proxy/0.log" Jul 30 10:56:11.299433 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.299398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/0.log" Jul 30 10:56:11.326874 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.326780 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/1.log" Jul 30 10:56:11.365427 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.365397 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-twjpn_d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e/payload-pre-processing/0.log" Jul 30 10:56:11.396134 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:11.396098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log" Jul 30 10:56:12.222191 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:12.222150 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dbbjn_8fd9021c-3527-4001-a647-8cb468b7c1f4/serve-healthcheck-canary/0.log" Jul 30 10:56:12.920505 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:12.920474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s6srk_84ed3fd4-b919-494b-a6eb-c80f1bb279d9/kube-rbac-proxy/0.log" Jul 30 10:56:12.945572 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:12.945552 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s6srk_84ed3fd4-b919-494b-a6eb-c80f1bb279d9/exporter/0.log" Jul 30 10:56:12.970019 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:12.969988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s6srk_84ed3fd4-b919-494b-a6eb-c80f1bb279d9/extractor/0.log" Jul 30 10:56:14.104978 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:14.104953 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-94b2d/perf-node-gather-daemonset-6kt4f" Jul 30 10:56:15.746528 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:15.746498 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bmft4_fabfeda4-f2f2-4e27-84c3-b6ed3592e9ae/manager/0.log" Jul 30 10:56:15.915649 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:15.915620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ps7fx_fa4ccb44-020c-441d-a0a3-03efdada283c/manager/0.log" Jul 30 10:56:15.938608 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:15.938583 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d74749788-ps7fx_fa4ccb44-020c-441d-a0a3-03efdada283c/copy-manifests/0.log" Jul 30 10:56:17.501751 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.501726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm_4814d9fe-ca93-4e23-b370-fddd3a9036de/istio-proxy/0.log" Jul 30 10:56:17.654886 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.654844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qfnr9_68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba/discovery/0.log" Jul 30 10:56:17.690409 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.690376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-sd6jn_5ef80a82-be8c-40c0-9b15-da2e6ac976db/kube-auth-proxy/0.log" Jul 30 10:56:17.716480 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.716449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/0.log" Jul 30 10:56:17.744932 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.744898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/1.log" Jul 30 10:56:17.769319 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.769224 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-twjpn_d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e/payload-pre-processing/0.log" Jul 30 10:56:17.792648 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:17.792605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log" Jul 30 10:56:19.175773 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.175726 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tdgrm_4814d9fe-ca93-4e23-b370-fddd3a9036de/istio-proxy/0.log" Jul 30 10:56:19.320909 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.320877 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qfnr9_68fcdf9e-5cf3-4c6f-a1fd-a2e4340b39ba/discovery/0.log" Jul 30 10:56:19.353183 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.353157 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d4fcfdb4d-sd6jn_5ef80a82-be8c-40c0-9b15-da2e6ac976db/kube-auth-proxy/0.log" Jul 30 10:56:19.371383 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.371355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/0.log" Jul 30 10:56:19.398666 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.398628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-54zf6_5ce966a0-7957-4e2b-b324-88027e3f9115/istio-proxy/1.log" Jul 30 10:56:19.417806 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.417776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-twjpn_d4ebcb7c-2f9a-4aff-8bd3-3946e15b5c5e/payload-pre-processing/0.log" Jul 30 10:56:19.438330 ip-10-0-130-75 kubenswrapper[2576]: I0730 10:56:19.438253 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-fswzf_b50d7de9-4e61-451d-ac8f-4a7587efa3c8/payload-processing/0.log"