Jul 24 16:05:53.611526 ip-10-0-130-189 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 16:05:53.932568 ip-10-0-130-189 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:05:53.932568 ip-10-0-130-189 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 16:05:53.932568 ip-10-0-130-189 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:05:53.932568 ip-10-0-130-189 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 16:05:53.932568 ip-10-0-130-189 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 16:05:53.933371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.933275    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 16:05:53.937477 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937457    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.937477 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937474    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.937477 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937479    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937491    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937496    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937499    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937504    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937507    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937511    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937515    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937519    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937523    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937527    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937530    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937536    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937540    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937543    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937548    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937554    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937560    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937564    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.937670 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937568    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937573    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937577    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937584    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937590    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937594    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937598    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937604    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937609    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937614    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937619    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937623    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937628    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937633    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937638    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937645    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937650    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937654    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937658    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.938469 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937663    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937667    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937671    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937675    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937680    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937684    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937689    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937693    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937698    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937702    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937707    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937711    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937716    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937720    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937725    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937729    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937734    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937738    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937744    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937748    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.938976 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937753    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937757    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937762    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937766    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937771    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937775    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937780    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937785    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937790    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937796    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937801    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937807    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937814    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937819    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937825    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937830    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937834    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937838    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937843    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937847    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.939608 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937852    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937856    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937861    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937865    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937870    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937874    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937878    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937883    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937887    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937891    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937896    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937900    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937904    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937909    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937913    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937917    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937922    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937926    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.937930    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940109    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.940448 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940120    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940126    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940132    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940137    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940142    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940147    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940152    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940156    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940160    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940165    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940169    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940173    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940177    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940182    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940186    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940191    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940195    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940200    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940204    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.941058 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940209    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940213    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940217    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940221    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940226    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940230    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940235    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940239    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940262    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940266    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940271    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940276    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940281    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940285    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940289    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940294    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940299    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940304    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940313    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.941618 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940318    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940322    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940327    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940331    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940335    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940340    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940344    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940350    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940355    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940359    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940364    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940369    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940373    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940378    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940382    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940386    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940391    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940396    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940400    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940404    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.942490 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940408    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940412    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940417    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940421    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940426    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940433    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940440    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940444    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940451    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940457    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940462    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940467    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940471    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940476    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940480    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940484    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940488    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940493    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940497    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.943386 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940501    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940506    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940510    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940516    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940521    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940525    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940530    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940534    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940538    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940542    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940549    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940554    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940559    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940563    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940568    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940572    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940576    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940581    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940586    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.944152 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.940590    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.941983    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.941992    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942001    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942005    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942010    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942015    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942020    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942024    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942028    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942034    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942038    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942043    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942047    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942051    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942056    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942061    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942065    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942069    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.944676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942073    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942078    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942082    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942086    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942090    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942095    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942099    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942104    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942108    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942112    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942116    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942122    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942126    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942130    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942134    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942139    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942144    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942149    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942153    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942158    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.945205 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942162    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942166    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942170    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942174    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942178    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942183    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942187    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942191    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942196    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942200    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942204    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942208    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942212    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942224    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942229    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942233    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942237    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942257    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942265    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942271    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.945947 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942276    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942281    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942285    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942291    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942295    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942299    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942304    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942308    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942312    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942319    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942325    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942330    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942335    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942340    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942344    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942351    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942358    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942364    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942368    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.946732 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942373    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942378    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942383    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942387    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942391    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942396    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942400    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942405    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942409    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942413    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942417    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942421    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942426    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942431    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942435    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942439    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942444    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942448    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942452    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942456    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.947276 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942460    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.942465    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942564    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942580    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942595    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942601    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942608    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942613    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942619    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942626    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942631    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942636    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942642    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942647    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942652    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942656    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942661    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942666    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942671    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942676    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942682    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942687    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942692    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942697    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 16:05:53.947854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942703    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942709    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942714    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942719    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942725    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942729    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942734    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942739    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942744    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942749    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942755    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942760    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942765    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942770    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942775    2581 flags.go:64] FLAG: --enable-server="true"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942780    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942788    2581 flags.go:64] FLAG: --event-burst="100"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942793    2581 flags.go:64] FLAG: --event-qps="50"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942798    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942803    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942808    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942815    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942819    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942824    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942830    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 24 16:05:53.948492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942835    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942842    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942846    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942851    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942856    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942861    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942866    2581 flags.go:64] FLAG: --feature-gates=""
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942872    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942877    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942882    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942887    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942892    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942898    2581 flags.go:64] FLAG: --help="false"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942902    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-189.ec2.internal"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942908    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942913    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942918    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942924    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942930    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942934    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942939    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942944    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942949    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 16:05:53.949100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942954    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942961    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942966    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942971    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942976    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942981    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942985    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942990    2581 flags.go:64] FLAG: --lock-file=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.942995    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943000    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943009    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943018    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943022    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943027    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943032    2581 flags.go:64] FLAG: --logging-format="text"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943037    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943042    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943047    2581 flags.go:64] FLAG: --manifest-url=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943052    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943058    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943063    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943069    2581 flags.go:64] FLAG: --max-pods="110"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943074    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943080    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943084    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 16:05:53.949699 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943089    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943094    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943099    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943104    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943115    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943120    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943126    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943132    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943138    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943148    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943152    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943157    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943162    2581 flags.go:64] FLAG: --port="10250"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943167    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943172    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0beb470414956fb8d"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943177    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943182    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943187    2581 flags.go:64] FLAG: --register-node="true"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943193    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943199    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943204    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943209    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943213    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943220    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943225    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 16:05:53.950334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943230    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943235    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943239    2581 flags.go:64] FLAG: --runonce="false"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943260    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943265    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943271    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943275    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943280    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943285    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943290    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943295    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943300    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943304    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943309    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943315    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943323    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943328    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943332    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943341    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943346    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943351    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943358    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943363    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943368    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943372    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 16:05:53.951042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943379    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943384    2581 flags.go:64] FLAG: --v="2"
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943390    2581 flags.go:64] FLAG: --version="false"
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943395    2581 flags.go:64] FLAG: --vmodule=""
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943401    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.943406    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943586    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943593    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943598    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943603    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943607    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943611    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943615    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943619    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943623    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943628    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943633    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943637    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943641    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943645    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943650    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.951697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943654    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943661    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943666    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943670    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943674    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943679    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943683    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943687    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943691    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943695    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943700    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943704    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943708    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943712    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943716    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943721    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943726    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943730    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943734    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943738    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.952212 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943743    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943747    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943751    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943756    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943760    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943764    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943769    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943773    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943777    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943781    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943785    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943789    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943794    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943800    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943806    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943811    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943815    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943820    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943824    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943828    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.952719 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943832    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943836    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943840    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943847    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943854    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943859    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943863    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943867    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943872    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943876    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943880    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943885    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943889    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943893    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943900    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943905    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943910    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943914    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943919    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.953192 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943923    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943927    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943932    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943936    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943940    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943944    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943950    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943954    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943960    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943964    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943971    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943977    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943982    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943987    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943991    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.943995    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944000    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944004    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944008    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.953666 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944013    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944017    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944021    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944025    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944030    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.944034    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.944692    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.952315    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.952331    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.952351    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.952357    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952410    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952415    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952419    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952422    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.954238 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952425    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952428    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952432    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952435    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952438    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952441    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952443    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952446    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952449    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952459    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952464    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952467    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952470    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952473    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952476    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952479    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952481    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952484    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952487    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952490    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.954647 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952492    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952495    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952498    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952501    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952504    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952508    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952510    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952514    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952518    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952521    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952524    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952527    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952529    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952532    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952535    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952537    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952540    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952542    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952545    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.955124 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952548    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952550    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952552    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952556    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952560    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952563    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952566    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952569    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952572    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952576    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952578    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952581    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952584    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952587    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952589    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952592    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952595    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952598    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952601    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952604    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.955599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952606    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952609    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952612    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952614    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952617    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952620    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952622    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952625    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952627    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952630    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952632    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952635    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952638    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952640    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952643    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952645    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952649    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952651    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952654    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952657    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.956094 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952659    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952662    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952665    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952667    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952670    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952672    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952675    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952678    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952681    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952683    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952686    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952689    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952691    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952694    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952696    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.956599 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952699    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.952704    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952814    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952819    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952822    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952825    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952828    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952831    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952834    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952836    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952839    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952842    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952844    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952847    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952851    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 16:05:53.956953 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952853    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952856    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952860    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952864    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952867    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952870    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952873    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952876    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952878    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952881    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952884    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952886    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952889    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952892    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952894    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952897    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952900    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952902    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952905    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952907    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 16:05:53.957444 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952910    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952912    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952915    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952917    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952920    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952923    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952925    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952928    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952931    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952933    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952936    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952938    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952941    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952944    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952947    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952950    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952952    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952955    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952957    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952960    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 16:05:53.957920 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952964    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952967    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952970    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952973    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952975    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952978    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952980    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952983    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952985    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952988    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952991    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952993    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952996    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.952998    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953001    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953003    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953006    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953009    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953011    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 16:05:53.958431 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953014    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953018    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953021    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953024    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953027    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953030    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953034    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953039    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953042    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953045    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953048    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953051    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953054    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953057    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953059    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953062    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953065    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953067    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 16:05:53.958887 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953070    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953072    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953075    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953077    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953080    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953082    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953085    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:53.953087    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.953092    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 16:05:53.959377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.953187    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 16:05:53.972604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.972589    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 16:05:53.974283 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.974270    2581 server.go:1019] "Starting client certificate rotation"
Jul 24 16:05:53.974393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.974379    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:05:53.974422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.974412    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 16:05:53.976518 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.976504    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:05:53.977967 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.977951    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 16:05:53.986673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.986654    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 24 16:05:53.988675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.988661    2581 log.go:25] "Validated CRI v1 image API"
Jul 24 16:05:53.991133 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.990764    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 16:05:53.995050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.995027    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 970a9359-ee54-4b37-ba86-4c7436aa07d4:/dev/nvme0n1p3 d31f6d67-92f4-45c7-b162-7ebc5f5a4d95:/dev/nvme0n1p4]
Jul 24 16:05:53.995128 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:53.995048    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 16:05:54.000902 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.000789    2581 manager.go:216] Machine: {Timestamp:2026-07-24 16:05:53.999106653 +0000 UTC m=+0.289865640 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099349 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256f71ff96ecf4b1c902d578f35d29 SystemUUID:ec256f71-ff96-ecf4-b1c9-02d578f35d29 BootID:7e3f25fd-d0ff-422c-87b8-483e276ab8f5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6a:29:88:81:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6a:29:88:81:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:4f:03:18:90:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 16:05:54.000902 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.000889    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 16:05:54.001054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.001033    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 16:05:54.002034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.002008    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 16:05:54.002159 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.002037    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 16:05:54.002731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.002719    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 16:05:54.002771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.002732    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 16:05:54.002771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.002740    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:05:54.003478 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.003467    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 16:05:54.004311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.004299    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 16:05:54.006772 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.006754    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:05:54.006996 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.006985    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:05:54.007120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007110    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 16:05:54.007156 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007147    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 16:05:54.007185 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007161    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 16:05:54.007185 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007175    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 16:05:54.007264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007189    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 24 16:05:54.007264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007199    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 16:05:54.007570 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007558    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:05:54.007628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.007576    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 16:05:54.009337 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.009321    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 16:05:54.011220 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.011206    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 16:05:54.011286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.011238    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 16:05:54.012634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012622    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 16:05:54.012673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012649    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 16:05:54.012673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012665    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 16:05:54.012732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012677    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 16:05:54.012732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012698    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 16:05:54.012732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012710    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 16:05:54.012732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012728    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 16:05:54.012830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012742    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 16:05:54.012830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012753    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 16:05:54.012830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012759    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 16:05:54.012830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012768    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 16:05:54.012830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.012773    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 16:05:54.013930 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.013919    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 16:05:54.013976 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.013934    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 16:05:54.017138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.017124    2581 server.go:1268] "Started kubelet"
Jul 24 16:05:54.017327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.017274    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 16:05:54.017400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.017352    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 16:05:54.017851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.017654    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 16:05:54.018031 ip-10-0-130-189 systemd[1]: Started Kubernetes Kubelet.
Jul 24 16:05:54.019405 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.019140    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 16:05:54.019405 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.019373    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 16:05:54.019589 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.019452    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 16:05:54.019589 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.019491    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 16:05:54.019881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.019869    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 16:05:54.021339 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.021299    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 16:05:54.027039 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.027025    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 16:05:54.027446 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.027219    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 16:05:54.028376 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.028215    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:54.028469 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.028455    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 16:05:54.028547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.028538    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 16:05:54.028765 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.028747    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 16:05:54.028834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.028816    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 16:05:54.028834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.028824    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 16:05:54.029381 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029358    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 16:05:54.029381 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029382    2581 factory.go:55] Registering systemd factory
Jul 24 16:05:54.029494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029392    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 24 16:05:54.029669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029639    2581 factory.go:153] Registering CRI-O factory
Jul 24 16:05:54.029742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029663    2581 factory.go:223] Registration of the crio container factory successfully
Jul 24 16:05:54.029742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029738    2581 factory.go:103] Registering Raw factory
Jul 24 16:05:54.029876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.029755    2581 manager.go:1196] Started watching for new ooms in manager
Jul 24 16:05:54.030569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.030551    2581 manager.go:349] Starting recovery of all containers
Jul 24 16:05:54.031212 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.030330    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-189.ec2.internal.18c5456b31881475  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-189.ec2.internal,UID:ip-10-0-130-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-189.ec2.internal,},FirstTimestamp:2026-07-24 16:05:54.017088629 +0000 UTC m=+0.307847617,LastTimestamp:2026-07-24 16:05:54.017088629 +0000 UTC m=+0.307847617,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-189.ec2.internal,}"
Jul 24 16:05:54.039011 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.038979    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 16:05:54.039011 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.038995    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 16:05:54.039598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.039558    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 16:05:54.042795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.042765    2581 manager.go:354] Recovery completed
Jul 24 16:05:54.047157 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.047143    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.048989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.048966    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.049050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049002    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.049050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049012    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.049577 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049557    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 16:05:54.049577 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049569    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 16:05:54.049577 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049577    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.049711 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.049586    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 16:05:54.050271 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.050256    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.050324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.050284    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.050324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.050297    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.051218 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.051135    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-189.ec2.internal.18c5456b336ed6b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-189.ec2.internal,UID:ip-10-0-130-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-189.ec2.internal,},FirstTimestamp:2026-07-24 16:05:54.048988854 +0000 UTC m=+0.339747840,LastTimestamp:2026-07-24 16:05:54.048988854 +0000 UTC m=+0.339747840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-189.ec2.internal,}"
Jul 24 16:05:54.052220 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.052209    2581 policy_none.go:49] "None policy: Start"
Jul 24 16:05:54.052285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.052224    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 16:05:54.052285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.052235    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 16:05:54.054212 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.054200    2581 policy_none.go:47] "Start"
Jul 24 16:05:54.058882 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.058813    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-189.ec2.internal.18c5456b336f1d28  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-189.ec2.internal,UID:ip-10-0-130-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-189.ec2.internal,},FirstTimestamp:2026-07-24 16:05:54.049006888 +0000 UTC m=+0.339765874,LastTimestamp:2026-07-24 16:05:54.049006888 +0000 UTC m=+0.339765874,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-189.ec2.internal,}"
Jul 24 16:05:54.060439 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.060378    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-189.ec2.internal.18c5456b336f423e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-189.ec2.internal,UID:ip-10-0-130-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-189.ec2.internal,},FirstTimestamp:2026-07-24 16:05:54.049016382 +0000 UTC m=+0.339775369,LastTimestamp:2026-07-24 16:05:54.049016382 +0000 UTC m=+0.339775369,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-189.ec2.internal,}"
Jul 24 16:05:54.060843 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.060825    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w6hj7"
Jul 24 16:05:54.068402 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.068383    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w6hj7"
Jul 24 16:05:54.073101 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.073023    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-189.ec2.internal.18c5456b336ed6b6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-189.ec2.internal.18c5456b336ed6b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-189.ec2.internal,UID:ip-10-0-130-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-189.ec2.internal,},FirstTimestamp:2026-07-24 16:05:54.048988854 +0000 UTC m=+0.339747840,LastTimestamp:2026-07-24 16:05:54.050269966 +0000 UTC m=+0.341028952,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-189.ec2.internal,}"
Jul 24 16:05:54.085969 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.085825    2581 manager.go:337] "Starting Device Plugin manager"
Jul 24 16:05:54.086070 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.086008    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 16:05:54.086070 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086023    2581 server.go:87] "Starting device plugin registration server"
Jul 24 16:05:54.086286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086273    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 16:05:54.086354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086288    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 16:05:54.086473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086454    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 16:05:54.086547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086535    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 16:05:54.086591 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.086549    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 16:05:54.086979 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.086953    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 16:05:54.087076 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.087002    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:54.135455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.135427    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 16:05:54.142719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.135472    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 16:05:54.142719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.135493    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 16:05:54.142719 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.135527    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 16:05:54.142719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.139716    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:54.187294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.187178    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.188205 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.188189    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.188294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.188218    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.188294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.188227    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.188294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.188271    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.210666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.210649    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.210724 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.210670    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-189.ec2.internal\": node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:54.236303 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.236271    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"]
Jul 24 16:05:54.236423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.236352    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.237158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.237142    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.237223 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.237168    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.237223 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.237179    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.239524 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.239512    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.239656 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.239642    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.239708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.239675    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.240284 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240267    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.240363 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240299    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.240363 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240310    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.240363 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240274    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.240505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240368    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.240505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.240384    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.242617 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.242601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.242700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.242629    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 16:05:54.243234 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.243221    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 16:05:54.243310 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.243257    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 16:05:54.243310 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.243270    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeHasSufficientPID"
Jul 24 16:05:54.256832 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.256814    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-189.ec2.internal\" not found" node="ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.261340 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.261323    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-189.ec2.internal\" not found" node="ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.306819 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.306798    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:54.331196 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.331177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/184e074dc10ec1472e8fcaa4bff99132-config\") pod \"kube-apiserver-proxy-ip-10-0-130-189.ec2.internal\" (UID: \"184e074dc10ec1472e8fcaa4bff99132\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.331282 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.331202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.331282 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.331220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.407530 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.407507    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:54.431610 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.431714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/184e074dc10ec1472e8fcaa4bff99132-config\") pod \"kube-apiserver-proxy-ip-10-0-130-189.ec2.internal\" (UID: \"184e074dc10ec1472e8fcaa4bff99132\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.431714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.431714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.431714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431696    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/184e074dc10ec1472e8fcaa4bff99132-config\") pod \"kube-apiserver-proxy-ip-10-0-130-189.ec2.internal\" (UID: \"184e074dc10ec1472e8fcaa4bff99132\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.431714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:54.431688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61f2ae70685368516b67c7efe6481d52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal\" (UID: \"61f2ae70685368516b67c7efe6481d52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:54.507962 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:54.507884    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:55.905402 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:55.905372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:55.909092 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:55.909075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:55.953549 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:55.953521    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:56.054064 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.054033    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:56.154675 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.154588    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-189.ec2.internal\" not found"
Jul 24 16:05:56.241453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.241422    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:56.274306 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.274280    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:56.287007 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.286987    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:05:56.288404 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.288391    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"
Jul 24 16:05:56.294800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.294781    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 16:05:56.318931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.318904    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 16:05:56.319054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.319035    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 16:05:56.319096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.319035    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 16:05:56.353233 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.353208    2581 apiserver.go:52] "Watching apiserver"
Jul 24 16:05:56.369519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.369498    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 16:05:56.370486 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.370464    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn","openshift-cluster-node-tuning-operator/tuned-xx48z","openshift-dns/node-resolver-rl87m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal","openshift-multus/network-metrics-daemon-4h4nw","openshift-network-diagnostics/network-check-target-2gcbb","kube-system/global-pull-secret-syncer-2b9xc","openshift-image-registry/node-ca-qk29m","openshift-multus/multus-additional-cni-plugins-g9j5h","openshift-multus/multus-jg65c","openshift-network-operator/iptables-alerter-wg7x5","openshift-ovn-kubernetes/ovnkube-node-6nllc","kube-system/konnectivity-agent-r4tlm","kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal"]
Jul 24 16:05:56.372844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.372826    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 16:05:56.373160 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.373140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.376068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.375860    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 16:05:56.376068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.375872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 16:05:56.376068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.375890    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bl26r\""
Jul 24 16:05:56.376068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.376034    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.376341 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.376300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.376640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.376620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.376747 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.376690    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 16:05:56.377027 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.377009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 16:05:56.378922 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.378887    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.379020 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.378953    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cvrq5\""
Jul 24 16:05:56.379234 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.379332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-var-lib-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-etc-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.379332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-modprobe-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-run\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-node-log\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-config\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-kubernetes\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-log-socket\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-netd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovn-node-metrics-cert\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-var-lib-kubelet\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrbk\" (UniqueName: \"kubernetes.io/projected/878d4a80-3f1e-40b1-9a73-b80555ff09c9-kube-api-access-pmrbk\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-systemd-units\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-slash\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-netns\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-conf\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-systemd\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-sys\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-systemd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.379935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-lib-modules\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-etc-tuned\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.379978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-tmp\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtm49\" (UniqueName: \"kubernetes.io/projected/2bb4ea61-8028-40f6-973d-51acafac3175-kube-api-access-vtm49\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-kubelet\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-ovn\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-env-overrides\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-bin\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-script-lib\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysconfig\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.380361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.380208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-host\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.381276 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.381257    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.381321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.381273    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.381533 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.381509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bc7wh\""
Jul 24 16:05:56.381606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.381580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.383680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbfzs\""
Jul 24 16:05:56.383680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383676    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 16:05:56.383876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383676    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.383876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383788    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 16:05:56.383876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.384026 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.383923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:05:56.384026 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.383973    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.386110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.386093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:56.386185 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.386154    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:05:56.388569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.388548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.390930 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.390883    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 16:05:56.390983 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.390929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6pqng\""
Jul 24 16:05:56.391120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.391088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.391296 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.391120    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 16:05:56.393263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.393214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.393402 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.393374    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 16:05:56.393499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.393438    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.393552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.393389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k9zm\""
Jul 24 16:05:56.393552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.393533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.395497 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.395481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.395861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.395844    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.396032 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.396015    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.396257 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.396242    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 16:05:56.396547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.396534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 16:05:56.396712 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.396699    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 16:05:56.397052 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.397037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mhk85\""
Jul 24 16:05:56.397575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.397561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 16:05:56.397626 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.397597    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zgc57\""
Jul 24 16:05:56.398190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.398175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.400551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.400534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.400621 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.400590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:05:56.401000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.400982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 16:05:56.401084 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.401012    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wph7q\""
Jul 24 16:05:56.401084 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.401062    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 16:05:56.401084 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.401072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:05:56.414014 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.413971    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dmdc"
Jul 24 16:05:56.418672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.418622    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 16:00:55 +0000 UTC" deadline="2027-12-31 09:34:23.787170396 +0000 UTC"
Jul 24 16:05:56.418672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.418671    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12593h28m27.368501795s"
Jul 24 16:05:56.422523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.422508    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7dmdc"
Jul 24 16:05:56.475336 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.475320    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 16:05:56.480611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-ovn\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.480689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-env-overrides\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.480689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-kubelet\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.480759 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-ovn\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.480759 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-multus-certs\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.480818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.480818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.480907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-bin\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.480907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.480907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.480907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/000766ac-c982-4243-952e-326d73f98490-host-slash\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.480907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-var-lib-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-modprobe-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-bin\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-var-lib-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-device-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.480986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-node-log\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-config\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-env-overrides\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-modprobe-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-kubernetes\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-node-log\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-registration-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-agent-certs\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-kubernetes\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-log-socket\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cni-binary-copy\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-log-socket\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r9ms\" (UniqueName: \"kubernetes.io/projected/f6dd050c-bb36-4b36-aa9c-f972635cec1e-kube-api-access-7r9ms\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cnibin\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-os-release\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-k8s-cni-cncf-io\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-dbus\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-conf-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5145161-3ca1-460a-8fda-08dd3a8511d0-tmp-dir\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxh2\" (UniqueName: \"kubernetes.io/projected/f5145161-3ca1-460a-8fda-08dd3a8511d0-kube-api-access-tcxh2\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlm8q\" (UniqueName: \"kubernetes.io/projected/5d37a955-60c6-43ed-a7d6-b4474401d086-kube-api-access-jlm8q\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vhh\" (UniqueName: \"kubernetes.io/projected/0f12bcaa-2383-458d-9b20-e1b1c90cba96-kube-api-access-c5vhh\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t77c\" (UniqueName: \"kubernetes.io/projected/8edc9564-d43d-4fb5-adb7-c9229292e4a9-kube-api-access-2t77c\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-systemd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-lib-modules\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.481793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-etc-tuned\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-systemd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-tmp\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-system-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8d2f57c-3eb4-4f54-9853-24f65d577a32-host\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dslq\" (UniqueName: \"kubernetes.io/projected/d8d2f57c-3eb4-4f54-9853-24f65d577a32-kube-api-access-8dslq\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-kubelet\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-socket-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-script-lib\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysconfig\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-host\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-lib-modules\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-hostroot\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-sys-fs\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.482604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysconfig\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481899    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-etc-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.481983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-run\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-konnectivity-ca\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8d2f57c-3eb4-4f54-9853-24f65d577a32-serviceca\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/000766ac-c982-4243-952e-326d73f98490-iptables-alerter-script\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlv7l\" (UniqueName: \"kubernetes.io/projected/000766ac-c982-4243-952e-326d73f98490-kube-api-access-zlv7l\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-config\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-socket-dir-parent\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-bin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-multus\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-daemon-config\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-etc-kubernetes\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.483330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-kubelet-config\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-run-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovnkube-script-lib\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-netd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-host\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-kubelet\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-etc-openvswitch\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-cni-netd\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-run\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovn-node-metrics-cert\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-var-lib-kubelet\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482698    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrbk\" (UniqueName: \"kubernetes.io/projected/878d4a80-3f1e-40b1-9a73-b80555ff09c9-kube-api-access-pmrbk\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-var-lib-kubelet\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cnibin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-d\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.482916    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f2ae70685368516b67c7efe6481d52.slice/crio-fe85f9e652b8049cf092f96e6859e18c843ee60c50485b56ae18a341bd988095 WatchSource:0}: Error finding container fe85f9e652b8049cf092f96e6859e18c843ee60c50485b56ae18a341bd988095: Status 404 returned error can't find the container with id fe85f9e652b8049cf092f96e6859e18c843ee60c50485b56ae18a341bd988095
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5145161-3ca1-460a-8fda-08dd3a8511d0-hosts-file\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.482997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-systemd-units\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-slash\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-systemd-units\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-netns\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-run-netns\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/878d4a80-3f1e-40b1-9a73-b80555ff09c9-host-slash\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-conf\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-systemd\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-sys\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtm49\" (UniqueName: \"kubernetes.io/projected/2bb4ea61-8028-40f6-973d-51acafac3175-kube-api-access-vtm49\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-sysctl-conf\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483213    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-etc-systemd\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.484963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-os-release\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.485637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb4ea61-8028-40f6-973d-51acafac3175-sys\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.485637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-netns\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.485637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.483368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-system-cni-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.485637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.485424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-etc-tuned\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.485637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.485506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb4ea61-8028-40f6-973d-51acafac3175-tmp\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.485776 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.485639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/878d4a80-3f1e-40b1-9a73-b80555ff09c9-ovn-node-metrics-cert\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.487787 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.487773    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:05:56.490979 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.490962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtm49\" (UniqueName: \"kubernetes.io/projected/2bb4ea61-8028-40f6-973d-51acafac3175-kube-api-access-vtm49\") pod \"tuned-xx48z\" (UID: \"2bb4ea61-8028-40f6-973d-51acafac3175\") " pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.491121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.491105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrbk\" (UniqueName: \"kubernetes.io/projected/878d4a80-3f1e-40b1-9a73-b80555ff09c9-kube-api-access-pmrbk\") pod \"ovnkube-node-6nllc\" (UID: \"878d4a80-3f1e-40b1-9a73-b80555ff09c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.584344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-agent-certs\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.584344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cni-binary-copy\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r9ms\" (UniqueName: \"kubernetes.io/projected/f6dd050c-bb36-4b36-aa9c-f972635cec1e-kube-api-access-7r9ms\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cnibin\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-os-release\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-k8s-cni-cncf-io\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-dbus\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cnibin\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-os-release\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-k8s-cni-cncf-io\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-conf-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5145161-3ca1-460a-8fda-08dd3a8511d0-tmp-dir\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-dbus\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxh2\" (UniqueName: \"kubernetes.io/projected/f5145161-3ca1-460a-8fda-08dd3a8511d0-kube-api-access-tcxh2\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-conf-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlm8q\" (UniqueName: \"kubernetes.io/projected/5d37a955-60c6-43ed-a7d6-b4474401d086-kube-api-access-jlm8q\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vhh\" (UniqueName: \"kubernetes.io/projected/0f12bcaa-2383-458d-9b20-e1b1c90cba96-kube-api-access-c5vhh\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t77c\" (UniqueName: \"kubernetes.io/projected/8edc9564-d43d-4fb5-adb7-c9229292e4a9-kube-api-access-2t77c\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-system-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8d2f57c-3eb4-4f54-9853-24f65d577a32-host\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dslq\" (UniqueName: \"kubernetes.io/projected/d8d2f57c-3eb4-4f54-9853-24f65d577a32-kube-api-access-8dslq\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-socket-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-system-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-hostroot\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.584925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-sys-fs\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5145161-3ca1-460a-8fda-08dd3a8511d0-tmp-dir\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.584938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.585028    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cni-binary-copy\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d8d2f57c-3eb4-4f54-9853-24f65d577a32-host\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-konnectivity-ca\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8d2f57c-3eb4-4f54-9853-24f65d577a32-serviceca\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-hostroot\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/000766ac-c982-4243-952e-326d73f98490-iptables-alerter-script\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlv7l\" (UniqueName: \"kubernetes.io/projected/000766ac-c982-4243-952e-326d73f98490-kube-api-access-zlv7l\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-socket-dir-parent\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-bin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-multus\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-daemon-config\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-etc-kubernetes\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-kubelet-config\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.585766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cnibin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5145161-3ca1-460a-8fda-08dd3a8511d0-hosts-file\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-os-release\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-os-release\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.585551    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:05:57.085507163 +0000 UTC m=+2.031287454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-sys-fs\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-netns\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-socket-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-system-cni-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-kubelet\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-konnectivity-ca\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-multus-certs\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-multus\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/000766ac-c982-4243-952e-326d73f98490-iptables-alerter-script\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-etc-selinux\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-kubelet\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-netns\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-var-lib-cni-bin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-etc-kubernetes\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f5145161-3ca1-460a-8fda-08dd3a8511d0-hosts-file\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3c3a185-7e8d-4104-b229-7a08b508b311-kubelet-config\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-daemon-config\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-host-run-multus-certs\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-system-cni-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-socket-dir-parent\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-cnibin\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.585989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.586075    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:56.586938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.586138    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:05:57.086118957 +0000 UTC m=+2.031899248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8edc9564-d43d-4fb5-adb7-c9229292e4a9-multus-cni-dir\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/000766ac-c982-4243-952e-326d73f98490-host-slash\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/000766ac-c982-4243-952e-326d73f98490-host-slash\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-device-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f12bcaa-2383-458d-9b20-e1b1c90cba96-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-registration-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-device-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d8d2f57c-3eb4-4f54-9853-24f65d577a32-serviceca\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d37a955-60c6-43ed-a7d6-b4474401d086-registration-dir\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586366    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f12bcaa-2383-458d-9b20-e1b1c90cba96-cni-binary-copy\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.587481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.586963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5fa79ce-1af8-4da1-b24e-72a044f8ccbd-agent-certs\") pod \"konnectivity-agent-r4tlm\" (UID: \"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd\") " pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.593182 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.593091    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:05:56.593182 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.593115    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:05:56.593182 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.593129    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:56.593822 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:56.593190    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:05:57.093173314 +0000 UTC m=+2.038953614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:56.593822 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.593614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxh2\" (UniqueName: \"kubernetes.io/projected/f5145161-3ca1-460a-8fda-08dd3a8511d0-kube-api-access-tcxh2\") pod \"node-resolver-rl87m\" (UID: \"f5145161-3ca1-460a-8fda-08dd3a8511d0\") " pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.594112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.594092    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t77c\" (UniqueName: \"kubernetes.io/projected/8edc9564-d43d-4fb5-adb7-c9229292e4a9-kube-api-access-2t77c\") pod \"multus-jg65c\" (UID: \"8edc9564-d43d-4fb5-adb7-c9229292e4a9\") " pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.594171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.594099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r9ms\" (UniqueName: \"kubernetes.io/projected/f6dd050c-bb36-4b36-aa9c-f972635cec1e-kube-api-access-7r9ms\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:56.594171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.594124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vhh\" (UniqueName: \"kubernetes.io/projected/0f12bcaa-2383-458d-9b20-e1b1c90cba96-kube-api-access-c5vhh\") pod \"multus-additional-cni-plugins-g9j5h\" (UID: \"0f12bcaa-2383-458d-9b20-e1b1c90cba96\") " pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.594935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.594913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlm8q\" (UniqueName: \"kubernetes.io/projected/5d37a955-60c6-43ed-a7d6-b4474401d086-kube-api-access-jlm8q\") pod \"aws-ebs-csi-driver-node-4gvhn\" (UID: \"5d37a955-60c6-43ed-a7d6-b4474401d086\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.595302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.595286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlv7l\" (UniqueName: \"kubernetes.io/projected/000766ac-c982-4243-952e-326d73f98490-kube-api-access-zlv7l\") pod \"iptables-alerter-wg7x5\" (UID: \"000766ac-c982-4243-952e-326d73f98490\") " pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.595593 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.595580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dslq\" (UniqueName: \"kubernetes.io/projected/d8d2f57c-3eb4-4f54-9853-24f65d577a32-kube-api-access-8dslq\") pod \"node-ca-qk29m\" (UID: \"d8d2f57c-3eb4-4f54-9853-24f65d577a32\") " pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.619994 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.619977    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:56.701382 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.701299    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:05:56.706917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.706894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xx48z"
Jul 24 16:05:56.712161 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.712133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878d4a80_3f1e_40b1_9a73_b80555ff09c9.slice/crio-89c3e0a84f271930971b68f5feffdeca9a380175ddf88c0cf5cd51ca644e42be WatchSource:0}: Error finding container 89c3e0a84f271930971b68f5feffdeca9a380175ddf88c0cf5cd51ca644e42be: Status 404 returned error can't find the container with id 89c3e0a84f271930971b68f5feffdeca9a380175ddf88c0cf5cd51ca644e42be
Jul 24 16:05:56.716325 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.716304    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb4ea61_8028_40f6_973d_51acafac3175.slice/crio-d0a5545e3069dc1c03779baadb095caefcd069164aeeb5168786ed3407f2d70c WatchSource:0}: Error finding container d0a5545e3069dc1c03779baadb095caefcd069164aeeb5168786ed3407f2d70c: Status 404 returned error can't find the container with id d0a5545e3069dc1c03779baadb095caefcd069164aeeb5168786ed3407f2d70c
Jul 24 16:05:56.734582 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.734564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rl87m"
Jul 24 16:05:56.738017 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.737996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn"
Jul 24 16:05:56.745246 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.745206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5145161_3ca1_460a_8fda_08dd3a8511d0.slice/crio-bd11609ff6dc713ceb53eefeb9bd72b76f50bfc06cf09a612f735cdc69d3b531 WatchSource:0}: Error finding container bd11609ff6dc713ceb53eefeb9bd72b76f50bfc06cf09a612f735cdc69d3b531: Status 404 returned error can't find the container with id bd11609ff6dc713ceb53eefeb9bd72b76f50bfc06cf09a612f735cdc69d3b531
Jul 24 16:05:56.747001 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.746969    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d37a955_60c6_43ed_a7d6_b4474401d086.slice/crio-2dc1c862b329f40462470ec105d8a31125bae181c22896f919736e5dd81ce9e1 WatchSource:0}: Error finding container 2dc1c862b329f40462470ec105d8a31125bae181c22896f919736e5dd81ce9e1: Status 404 returned error can't find the container with id 2dc1c862b329f40462470ec105d8a31125bae181c22896f919736e5dd81ce9e1
Jul 24 16:05:56.770201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.770179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:05:56.787801 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.787780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qk29m"
Jul 24 16:05:56.789313 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.789290    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fa79ce_1af8_4da1_b24e_72a044f8ccbd.slice/crio-86c1f41b5353a6e24dc68c07443ee75b0131b093e910cd8e6ce7dfcf9cc868b5 WatchSource:0}: Error finding container 86c1f41b5353a6e24dc68c07443ee75b0131b093e910cd8e6ce7dfcf9cc868b5: Status 404 returned error can't find the container with id 86c1f41b5353a6e24dc68c07443ee75b0131b093e910cd8e6ce7dfcf9cc868b5
Jul 24 16:05:56.789801 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.789770    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184e074dc10ec1472e8fcaa4bff99132.slice/crio-34510b85864292e773731cf2fb682883547d4714295191a589198239d2be73dc WatchSource:0}: Error finding container 34510b85864292e773731cf2fb682883547d4714295191a589198239d2be73dc: Status 404 returned error can't find the container with id 34510b85864292e773731cf2fb682883547d4714295191a589198239d2be73dc
Jul 24 16:05:56.793801 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.793777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g9j5h"
Jul 24 16:05:56.796185 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.796165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d2f57c_3eb4_4f54_9853_24f65d577a32.slice/crio-9670f8ad9c60147f6b29243e0800965e8fbaad9d02a8f9bd262bbccd8b15d31c WatchSource:0}: Error finding container 9670f8ad9c60147f6b29243e0800965e8fbaad9d02a8f9bd262bbccd8b15d31c: Status 404 returned error can't find the container with id 9670f8ad9c60147f6b29243e0800965e8fbaad9d02a8f9bd262bbccd8b15d31c
Jul 24 16:05:56.799054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.799035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jg65c"
Jul 24 16:05:56.803183 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.803165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f12bcaa_2383_458d_9b20_e1b1c90cba96.slice/crio-0199ab29f5ae79cf9aa8bf347014d8a1d8432622258a55eb777ab9d5afc30752 WatchSource:0}: Error finding container 0199ab29f5ae79cf9aa8bf347014d8a1d8432622258a55eb777ab9d5afc30752: Status 404 returned error can't find the container with id 0199ab29f5ae79cf9aa8bf347014d8a1d8432622258a55eb777ab9d5afc30752
Jul 24 16:05:56.804340 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.804325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wg7x5"
Jul 24 16:05:56.808259 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.808239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edc9564_d43d_4fb5_adb7_c9229292e4a9.slice/crio-a495966c5ee76540e7cee16ef9dfbc556ca665f9f9676ead6db6e480f3f42a33 WatchSource:0}: Error finding container a495966c5ee76540e7cee16ef9dfbc556ca665f9f9676ead6db6e480f3f42a33: Status 404 returned error can't find the container with id a495966c5ee76540e7cee16ef9dfbc556ca665f9f9676ead6db6e480f3f42a33
Jul 24 16:05:56.814153 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:05:56.814129    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000766ac_c982_4243_952e_326d73f98490.slice/crio-9380c9b12657edd61c20343bb9e47044c4f913394e7cce64dd3a1323540c2b86 WatchSource:0}: Error finding container 9380c9b12657edd61c20343bb9e47044c4f913394e7cce64dd3a1323540c2b86: Status 404 returned error can't find the container with id 9380c9b12657edd61c20343bb9e47044c4f913394e7cce64dd3a1323540c2b86
Jul 24 16:05:56.842059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:56.842026    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:57.090079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.089992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:57.090079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.090045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:57.090301 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.090148    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:57.090301 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.090153    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:57.090301 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.090207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:05:58.090187565 +0000 UTC m=+3.035967859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:57.090301 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.090235    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:05:58.090215152 +0000 UTC m=+3.035995427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:57.190964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.190930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:57.191128 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.191116    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:05:57.191186 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.191137    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:05:57.191186 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.191150    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:57.191289 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.191218    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:05:58.191192595 +0000 UTC m=+3.136972871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:57.425715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.425600    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:00:56 +0000 UTC" deadline="2028-04-16 18:09:42.723074956 +0000 UTC"
Jul 24 16:05:57.425715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.425663    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15170h3m45.297415556s"
Jul 24 16:05:57.484675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.484490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:57.484675 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:57.484624    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:05:57.505928 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.505840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4tlm" event={"ID":"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd","Type":"ContainerStarted","Data":"86c1f41b5353a6e24dc68c07443ee75b0131b093e910cd8e6ce7dfcf9cc868b5"}
Jul 24 16:05:57.523562 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.523526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn" event={"ID":"5d37a955-60c6-43ed-a7d6-b4474401d086","Type":"ContainerStarted","Data":"2dc1c862b329f40462470ec105d8a31125bae181c22896f919736e5dd81ce9e1"}
Jul 24 16:05:57.530936 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.530877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rl87m" event={"ID":"f5145161-3ca1-460a-8fda-08dd3a8511d0","Type":"ContainerStarted","Data":"bd11609ff6dc713ceb53eefeb9bd72b76f50bfc06cf09a612f735cdc69d3b531"}
Jul 24 16:05:57.540291 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.540247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xx48z" event={"ID":"2bb4ea61-8028-40f6-973d-51acafac3175","Type":"ContainerStarted","Data":"d0a5545e3069dc1c03779baadb095caefcd069164aeeb5168786ed3407f2d70c"}
Jul 24 16:05:57.560953 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.560885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal" event={"ID":"61f2ae70685368516b67c7efe6481d52","Type":"ContainerStarted","Data":"fe85f9e652b8049cf092f96e6859e18c843ee60c50485b56ae18a341bd988095"}
Jul 24 16:05:57.575022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.574989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wg7x5" event={"ID":"000766ac-c982-4243-952e-326d73f98490","Type":"ContainerStarted","Data":"9380c9b12657edd61c20343bb9e47044c4f913394e7cce64dd3a1323540c2b86"}
Jul 24 16:05:57.591860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.591819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jg65c" event={"ID":"8edc9564-d43d-4fb5-adb7-c9229292e4a9","Type":"ContainerStarted","Data":"a495966c5ee76540e7cee16ef9dfbc556ca665f9f9676ead6db6e480f3f42a33"}
Jul 24 16:05:57.603360 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.603328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerStarted","Data":"0199ab29f5ae79cf9aa8bf347014d8a1d8432622258a55eb777ab9d5afc30752"}
Jul 24 16:05:57.611561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.611530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qk29m" event={"ID":"d8d2f57c-3eb4-4f54-9853-24f65d577a32","Type":"ContainerStarted","Data":"9670f8ad9c60147f6b29243e0800965e8fbaad9d02a8f9bd262bbccd8b15d31c"}
Jul 24 16:05:57.616021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.615997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal" event={"ID":"184e074dc10ec1472e8fcaa4bff99132","Type":"ContainerStarted","Data":"34510b85864292e773731cf2fb682883547d4714295191a589198239d2be73dc"}
Jul 24 16:05:57.632921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.632894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"89c3e0a84f271930971b68f5feffdeca9a380175ddf88c0cf5cd51ca644e42be"}
Jul 24 16:05:57.639050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:57.639029    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.098435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.098512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.098634    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.098696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:06:00.098678632 +0000 UTC m=+5.044458912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.099078    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:58.099163 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.099127    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:00.099111519 +0000 UTC m=+5.044891801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:05:58.199713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.199676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:58.199925 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.199907    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:05:58.200020 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.199934    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:05:58.200020 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.199947    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:58.200020 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.200017    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:06:00.199996012 +0000 UTC m=+5.145776301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:05:58.309725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.309505    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 16:05:58.426193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.426107    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 16:00:56 +0000 UTC" deadline="2028-03-04 13:32:12.905626897 +0000 UTC"
Jul 24 16:05:58.426193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.426147    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14133h26m14.479484461s"
Jul 24 16:05:58.481393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.481324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:05:58.481558 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.481452    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:05:58.481998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:58.481836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:05:58.481998 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:58.481930    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:05:59.486483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:05:59.483303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:05:59.486483 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:05:59.483430    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:00.115517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:00.115480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:00.115680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:00.115551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:00.115680 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.115670    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:00.115797 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.115727    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:06:04.115709799 +0000 UTC m=+9.061490080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:00.116136 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.116112    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:00.116218 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.116184    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:04.116167149 +0000 UTC m=+9.061947441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:00.216958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:00.216871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:00.217115 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.217042    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:00.217115 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.217065    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:00.217115 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.217078    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:00.217288 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.217137    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:06:04.217116792 +0000 UTC m=+9.162897071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:00.481089 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:00.481011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:00.481263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:00.481019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:00.481263 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.481139    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:00.481263 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:00.481207    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:01.481061 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:01.481022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:01.481524 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:01.481186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:02.481318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:02.481285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:02.481836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:02.481285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:02.481836 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:02.481409    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:02.481836 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:02.481491    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:03.481583 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:03.481553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:03.482040 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:03.481683    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:04.149327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:04.149294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:04.149520 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:04.149376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:04.149520 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.149476    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:04.149644 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.149550    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:06:12.149531967 +0000 UTC m=+17.095312244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:04.149644 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.149487    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:04.149729 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.149634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:12.149616887 +0000 UTC m=+17.095397181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:04.250708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:04.250602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:04.250891 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.250826    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:04.250891 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.250854    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:04.250891 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.250867    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:04.251054 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.250928    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:06:12.250908362 +0000 UTC m=+17.196688651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:04.480707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:04.480618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:04.480879 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:04.480619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:04.480879 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.480764    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:04.480879 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:04.480818    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:05.481821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:05.481778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:05.482289 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:05.481923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:06.481660 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:06.481621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:06.481827 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:06.481739    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:06.481827 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:06.481797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:06.482288 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:06.481925    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:07.480882 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:07.480843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:07.481063 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:07.480982    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:08.480930 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:08.480853    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:08.480930 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:08.480896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:08.481471 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:08.480981    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:08.481471 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:08.481145    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:09.483451 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:09.483424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:09.483853 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:09.483543    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:10.480662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:10.480628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:10.480813 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:10.480732    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:10.480813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:10.480793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:10.480916 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:10.480901    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:11.481771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:11.481729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:11.482249 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:11.481868    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:12.207706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:12.207492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:12.207862 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:12.207749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:12.207862 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.207635    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:12.207862 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.207848    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:12.207862 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.207862    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:28.207838453 +0000 UTC m=+33.153618750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:12.208057 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.207890    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:06:28.207878172 +0000 UTC m=+33.153658447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:12.308625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:12.308573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:12.308779 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.308768    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:12.308842 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.308790    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:12.308842 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.308803    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:12.308940 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.308858    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:06:28.308840666 +0000 UTC m=+33.254620942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:12.481679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:12.481587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:12.481679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:12.481632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:12.482184 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.481716    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:12.482184 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:12.481853    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:13.483596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:13.483554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:13.484003 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:13.483683    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:14.481586 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:14.481554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:14.481728 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:14.481562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:14.481728 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:14.481672    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:14.481840 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:14.481756    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:15.484455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:15.484407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:15.484907 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:15.484578    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:16.481597 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:16.481566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:16.481733 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:16.481566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:16.481733 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:16.481706    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:16.481839 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:16.481770    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:17.481124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.480885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:17.482030 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:17.481151    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:17.692811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.692780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rl87m" event={"ID":"f5145161-3ca1-460a-8fda-08dd3a8511d0","Type":"ContainerStarted","Data":"e2f2f9f6d842a8956bfa7d4bf5364f4448b9130c4acc5c4a21bb47937f90dd28"}
Jul 24 16:06:17.694146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.694110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xx48z" event={"ID":"2bb4ea61-8028-40f6-973d-51acafac3175","Type":"ContainerStarted","Data":"18e4ee09d4da446b68f9ff873b80cc2d972aa1ab10223fd5da290df18486d156"}
Jul 24 16:06:17.695531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.695509    2581 generic.go:356] "Generic (PLEG): container finished" podID="61f2ae70685368516b67c7efe6481d52" containerID="778ed4d7f977df4b7d3a9131fd7da91b05df4026f2c86df6ce458d39a3b8e308" exitCode=0
Jul 24 16:06:17.695655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.695573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal" event={"ID":"61f2ae70685368516b67c7efe6481d52","Type":"ContainerDied","Data":"778ed4d7f977df4b7d3a9131fd7da91b05df4026f2c86df6ce458d39a3b8e308"}
Jul 24 16:06:17.697359 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.697114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jg65c" event={"ID":"8edc9564-d43d-4fb5-adb7-c9229292e4a9","Type":"ContainerStarted","Data":"e18a7104ebd3c9665a71de5f3e3a8265419d1b82c54ae014fcc57858db28b120"}
Jul 24 16:06:17.698603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.698579    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="16244a3f3aec15f87a454724b7e0772623a8d9657ec7693954365676db6662fd" exitCode=0
Jul 24 16:06:17.698674 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.698649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"16244a3f3aec15f87a454724b7e0772623a8d9657ec7693954365676db6662fd"}
Jul 24 16:06:17.699931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.699911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qk29m" event={"ID":"d8d2f57c-3eb4-4f54-9853-24f65d577a32","Type":"ContainerStarted","Data":"ccbb5827b485d1f419c222e65f6b829e4e10dd62c7532108cfc76711395378c8"}
Jul 24 16:06:17.701152 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.701130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal" event={"ID":"184e074dc10ec1472e8fcaa4bff99132","Type":"ContainerStarted","Data":"ec275f6446d27d9b4df0225088399c7458878f9dbf64cf84ddc4a5c629b754df"}
Jul 24 16:06:17.703954 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.703928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"365b7ad01fbec265ea0998a10b408a0f2e5c88b2c00751e315ab6a99038cecf5"}
Jul 24 16:06:17.704024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.703979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"357ceaa820e55a6d1a7e96e386e36b01187fb1522b2d7ffd06340dc2e9f00041"}
Jul 24 16:06:17.704024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.704010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"272b97c85f7f439e77d47a4ead803d3fbb08621844a3e624862546c29f6aec98"}
Jul 24 16:06:17.704109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.704055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"3fd2ec90c10283e0e5db73bd61be790ac1f60723ed20d44b795a9f7a82717eb5"}
Jul 24 16:06:17.704109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.704089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"e4cc5d679c55fd673457db6d8795ca8ac8dd233aeed43c1b6dfed566610fbb4d"}
Jul 24 16:06:17.704204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.704117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"1c015366fd5559b2f58de74ae28d2202c1d41326b66121ef3fbfa0b0a3cb2c15"}
Jul 24 16:06:17.705422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.705404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4tlm" event={"ID":"a5fa79ce-1af8-4da1-b24e-72a044f8ccbd","Type":"ContainerStarted","Data":"22d95d64088ce81902ac251ba152136f130e5c48e66eabb0a63e70a54199aa36"}
Jul 24 16:06:17.706671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.706654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn" event={"ID":"5d37a955-60c6-43ed-a7d6-b4474401d086","Type":"ContainerStarted","Data":"260a6b38a9ddee36fb12891801f507afb61f3639fabc1af65350c3fcd55f6d7c"}
Jul 24 16:06:17.708471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.708415    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rl87m" podStartSLOduration=3.017548963 podStartE2EDuration="22.708403103s" totalImagesPullingTime="19.69085414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.707880453 +0000 UTC m=+22.653660750" watchObservedRunningTime="2026-07-24 16:06:17.708403103 +0000 UTC m=+22.654183400"
Jul 24 16:06:17.724066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.724026    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xx48z" podStartSLOduration=2.98300857 podStartE2EDuration="22.724013116s" totalImagesPullingTime="19.741004546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.723584539 +0000 UTC m=+22.669364837" watchObservedRunningTime="2026-07-24 16:06:17.724013116 +0000 UTC m=+22.669793413"
Jul 24 16:06:17.741497 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.741377    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jg65c" podStartSLOduration=3.055271195 podStartE2EDuration="22.741356819s" totalImagesPullingTime="19.686085624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.740723572 +0000 UTC m=+22.686503870" watchObservedRunningTime="2026-07-24 16:06:17.741356819 +0000 UTC m=+22.687137119"
Jul 24 16:06:17.757678 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.757626    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qk29m" podStartSLOduration=3.117600091 podStartE2EDuration="22.75761091s" totalImagesPullingTime="19.640010819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.757015228 +0000 UTC m=+22.702795528" watchObservedRunningTime="2026-07-24 16:06:17.75761091 +0000 UTC m=+22.703391242"
Jul 24 16:06:17.806015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.805986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:06:17.823371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.823329    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-189.ec2.internal" podStartSLOduration=21.823313743 podStartE2EDuration="21.823313743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.822868957 +0000 UTC m=+22.768649256" watchObservedRunningTime="2026-07-24 16:06:17.823313743 +0000 UTC m=+22.769094053"
Jul 24 16:06:17.839491 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.839345    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r4tlm" podStartSLOduration=11.453140983 podStartE2EDuration="22.839324342s" totalImagesPullingTime="11.386183359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:17.838472268 +0000 UTC m=+22.784252568" watchObservedRunningTime="2026-07-24 16:06:17.839324342 +0000 UTC m=+22.785104641"
Jul 24 16:06:17.924675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.924637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:06:17.925319 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:17.925294    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:06:18.370883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.370861    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 16:06:18.446342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.446196    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T16:06:18.370878748Z","UUID":"91a3e8d6-74eb-48d2-95a9-12b9b839f116","Handler":null,"Name":"","Endpoint":""}
Jul 24 16:06:18.447642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.447626    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 16:06:18.447774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.447659    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 16:06:18.480834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.480808    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:18.480834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.480822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:18.481055 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:18.480913    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:18.481115 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:18.481066    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:18.710800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.710724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal" event={"ID":"61f2ae70685368516b67c7efe6481d52","Type":"ContainerStarted","Data":"44769b05df48e754bb4e9da99b4c708680042415f7a7dc4cffca6cdacfb09069"}
Jul 24 16:06:18.712412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.712386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wg7x5" event={"ID":"000766ac-c982-4243-952e-326d73f98490","Type":"ContainerStarted","Data":"1590d1595cdb4ade8a173903f6a92cce68c6391f8a82625b81762b164518e11c"}
Jul 24 16:06:18.714453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.714383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn" event={"ID":"5d37a955-60c6-43ed-a7d6-b4474401d086","Type":"ContainerStarted","Data":"a4a1e24c4cebef7857edad6578d1b2d1e36804efe36dccc8302fcee027ba8ab6"}
Jul 24 16:06:18.715234 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.715183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r4tlm"
Jul 24 16:06:18.726252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.726135    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-189.ec2.internal" podStartSLOduration=22.726116733 podStartE2EDuration="22.726116733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:18.72555357 +0000 UTC m=+23.671333879" watchObservedRunningTime="2026-07-24 16:06:18.726116733 +0000 UTC m=+23.671897032"
Jul 24 16:06:18.755878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:18.755818    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wg7x5" podStartSLOduration=4.111880557 podStartE2EDuration="23.755799547s" totalImagesPullingTime="19.64391899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:18.7553459 +0000 UTC m=+23.701126197" watchObservedRunningTime="2026-07-24 16:06:18.755799547 +0000 UTC m=+23.701579863"
Jul 24 16:06:19.481516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:19.481468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:19.481786 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:19.481614    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:20.481489 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:20.481456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:20.481939 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:20.481457    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:20.481939 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:20.481588    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:20.481939 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:20.481624    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:20.722288 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:20.722248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"9613ff20cb2ee7ff4805645bb09b86a1d2179709fce404ddfedc5510118badbb"}
Jul 24 16:06:20.724625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:20.724598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn" event={"ID":"5d37a955-60c6-43ed-a7d6-b4474401d086","Type":"ContainerStarted","Data":"4c443e9a0c958b97e3ff26c968953e05b751591c4b0a5775bbe88417f50404e1"}
Jul 24 16:06:20.743714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:20.743606    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4gvhn" podStartSLOduration=3.183948348 podStartE2EDuration="25.74358384s" totalImagesPullingTime="22.559635492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:20.743246558 +0000 UTC m=+25.689026857" watchObservedRunningTime="2026-07-24 16:06:20.74358384 +0000 UTC m=+25.689364138"
Jul 24 16:06:21.480903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:21.480860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:21.481091 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:21.481013    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:22.480725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:22.480689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:22.480725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:22.480727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:22.481173 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:22.480820    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:22.481173 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:22.480923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:23.481287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.481050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:23.482274 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:23.481363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:23.734526 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.734443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" event={"ID":"878d4a80-3f1e-40b1-9a73-b80555ff09c9","Type":"ContainerStarted","Data":"c06cb396dd8dd4b711fcd181c77cf5695f6c896b4e8c0636d9135f85ed082cba"}
Jul 24 16:06:23.734719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.734703    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:23.736171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.736144    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="4932953153d5e5a0d3d3ee43374a1723b8a4132547f1e56a501b1fd63de7d862" exitCode=0
Jul 24 16:06:23.736270 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.736179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"4932953153d5e5a0d3d3ee43374a1723b8a4132547f1e56a501b1fd63de7d862"}
Jul 24 16:06:23.750260 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.750238    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:23.760867 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:23.760824    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc" podStartSLOduration=8.754373906 podStartE2EDuration="28.760812043s" totalImagesPullingTime="20.006438137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:23.759662762 +0000 UTC m=+28.705443060" watchObservedRunningTime="2026-07-24 16:06:23.760812043 +0000 UTC m=+28.706592369"
Jul 24 16:06:24.314041 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.314014    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:24.481730 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.481696    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:24.481730 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.481718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:24.482190 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:24.481832    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:24.482190 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:24.481983    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:24.738756 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.738643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:24.753435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.753410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:24.971987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.971947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b9xc"]
Jul 24 16:06:24.972158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.972109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:24.972260 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:24.972215    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:24.973777 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.973746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2gcbb"]
Jul 24 16:06:24.973886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.973838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:24.973939 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:24.973913    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:24.976834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.976810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4h4nw"]
Jul 24 16:06:24.976916 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:24.976903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:24.977036 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:24.977014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:25.742342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:25.742311    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="7a8b0f242152b013e77e72c64510431d2566172002a06023d7f59c9089e18d83" exitCode=0
Jul 24 16:06:25.742783 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:25.742399    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"7a8b0f242152b013e77e72c64510431d2566172002a06023d7f59c9089e18d83"}
Jul 24 16:06:26.481365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:26.481327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:26.481523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:26.481379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:26.481523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:26.481465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:26.481523 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:26.481491    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:26.481679 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:26.481537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:26.481679 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:26.481598    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:26.746740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:26.746706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerStarted","Data":"e55184a66cf7d9f40e2b1884c2aad55789dd6132eb4cd03ee6da21a629401465"}
Jul 24 16:06:27.750743 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:27.750706    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="e55184a66cf7d9f40e2b1884c2aad55789dd6132eb4cd03ee6da21a629401465" exitCode=0
Jul 24 16:06:27.751104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:27.750749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"e55184a66cf7d9f40e2b1884c2aad55789dd6132eb4cd03ee6da21a629401465"}
Jul 24 16:06:28.225211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.225175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:28.225371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.225270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:28.225371 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.225365    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:28.225433 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.225372    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:28.225433 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.225418    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret podName:c3c3a185-7e8d-4104-b229-7a08b508b311 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:00.225404917 +0000 UTC m=+65.171185194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret") pod "global-pull-secret-syncer-2b9xc" (UID: "c3c3a185-7e8d-4104-b229-7a08b508b311") : object "kube-system"/"original-pull-secret" not registered
Jul 24 16:06:28.225433 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.225432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs podName:f6dd050c-bb36-4b36-aa9c-f972635cec1e nodeName:}" failed. No retries permitted until 2026-07-24 16:07:00.225426236 +0000 UTC m=+65.171206512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs") pod "network-metrics-daemon-4h4nw" (UID: "f6dd050c-bb36-4b36-aa9c-f972635cec1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 16:06:28.326608 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.326571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:28.326777 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.326711    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 16:06:28.326777 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.326731    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 16:06:28.326777 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.326743    2581 projected.go:196] Error preparing data for projected volume kube-api-access-jnphl for pod openshift-network-diagnostics/network-check-target-2gcbb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:28.326955 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.326806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl podName:0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d nodeName:}" failed. No retries permitted until 2026-07-24 16:07:00.326787057 +0000 UTC m=+65.272567352 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jnphl" (UniqueName: "kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl") pod "network-check-target-2gcbb" (UID: "0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 16:06:28.481735 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.481652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:28.481871 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.481661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:28.481871 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.481773    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4h4nw" podUID="f6dd050c-bb36-4b36-aa9c-f972635cec1e"
Jul 24 16:06:28.481871 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:28.481788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:28.481871 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.481844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b9xc" podUID="c3c3a185-7e8d-4104-b229-7a08b508b311"
Jul 24 16:06:28.482003 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:28.481916    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2gcbb" podUID="0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d"
Jul 24 16:06:30.387214 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.387141    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-189.ec2.internal" event="NodeReady"
Jul 24 16:06:30.387595 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.387282    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 16:06:30.434013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.432566    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:06:30.437021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.436995    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"]
Jul 24 16:06:30.437151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.437131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.439737 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.439717    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-szsnm"]
Jul 24 16:06:30.439870 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.439854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"
Jul 24 16:06:30.439939 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.439922    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 16:06:30.440368 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.440348    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 16:06:30.442678 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.442655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.443514 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.443494    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"]
Jul 24 16:06:30.444201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.443954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mglv9\""
Jul 24 16:06:30.444201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.444003    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.446509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.446486    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"]
Jul 24 16:06:30.446614 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.446569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.449333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.449245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.450669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.450647    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.451138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 16:06:30.451442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451418    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 24 16:06:30.451715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.451998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"]
Jul 24 16:06:30.452200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451748    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.452352 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.452336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 16:06:30.452455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.451801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.452610 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.452592    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.452690 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.452487    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.452849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.452828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 24 16:06:30.452933 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.452917    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 24 16:06:30.453033 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.453014    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nqq6g\""
Jul 24 16:06:30.453098 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.453072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.453650 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.453635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mnqwf\""
Jul 24 16:06:30.453918 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.453696    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndlwb\""
Jul 24 16:06:30.454046 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.453729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 24 16:06:30.455255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.455019    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9k8pw"]
Jul 24 16:06:30.455255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.455131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.458046 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.458028    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"]
Jul 24 16:06:30.458455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.458152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t6hzv\""
Jul 24 16:06:30.458455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.458258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.459486 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.459192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 16:06:30.459633 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.459550    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 24 16:06:30.460823 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.460806    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 24 16:06:30.461744 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.461725    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h6kss\""
Jul 24 16:06:30.462777 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.462757    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fplw4\""
Jul 24 16:06:30.463020 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463001    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 24 16:06:30.463291 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-szsnm"]
Jul 24 16:06:30.463460 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463443    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.463561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.463641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 24 16:06:30.463775 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.464024    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.464043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.464059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"]
Jul 24 16:06:30.464126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.463395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 24 16:06:30.464927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.464609    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.471039 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.470933    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 24 16:06:30.471239 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.471209    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.471875 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.471768    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.471875 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.471790    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5jbdk\""
Jul 24 16:06:30.472535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.472515    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 24 16:06:30.473194 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.473175    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55d74b7cb7-j6qlv"]
Jul 24 16:06:30.474725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.474702    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 24 16:06:30.476293 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.476275    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"]
Jul 24 16:06:30.476431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.476415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.478740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.478723    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.479087 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479065    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 16:06:30.479534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 16:06:30.479534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hqf69\""
Jul 24 16:06:30.479534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479453    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.479744 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479590    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 16:06:30.479802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.479740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 16:06:30.480788 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.480708    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8f6rc"]
Jul 24 16:06:30.480883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.480787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:06:30.480939 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.480913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:06:30.481015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.480959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.481116 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.481099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:06:30.483004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.482905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:06:30.483781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483331    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 24 16:06:30.483781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483392    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lkrpt"]
Jul 24 16:06:30.483781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 24 16:06:30.483781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gft6g\""
Jul 24 16:06:30.483781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483630    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.484161 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483742    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.484537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483753    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.484537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483871    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fvsfq\""
Jul 24 16:06:30.484537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.483901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.485344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.485312    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:06:30.485730 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.485711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nb27\""
Jul 24 16:06:30.485936 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.485919    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.486368 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.486351    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 16:06:30.486673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.486653    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 16:06:30.486952 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.486934    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"]
Jul 24 16:06:30.487088 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.487073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 16:06:30.487367 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.487354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7xbff\""
Jul 24 16:06:30.487980 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.487947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.490853 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.490835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 16:06:30.491084 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.490987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6rwh\""
Jul 24 16:06:30.491165 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.491155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 16:06:30.492312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492294    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9k8pw"]
Jul 24 16:06:30.492412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492329    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"]
Jul 24 16:06:30.492412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8f6rc"]
Jul 24 16:06:30.492412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"]
Jul 24 16:06:30.492566 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"
Jul 24 16:06:30.492863 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.492843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lkrpt"]
Jul 24 16:06:30.493763 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.493718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55d74b7cb7-j6qlv"]
Jul 24 16:06:30.494489 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.494469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g49x4\""
Jul 24 16:06:30.542639 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbadbd8b-ced4-4d90-a17a-5686275f4839-serving-cert\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.542760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.542760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.542760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.542760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2450dc38-ba13-4aec-b1d0-334b0d0db42b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.542968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.542968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.542968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-default-certificate\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.542968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.542992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1111b24-1671-43d0-8880-1e6b808bdb80-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.543163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-config\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpb2b\" (UniqueName: \"kubernetes.io/projected/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-kube-api-access-qpb2b\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjr75\" (UniqueName: \"kubernetes.io/projected/bbadbd8b-ced4-4d90-a17a-5686275f4839-kube-api-access-xjr75\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d25fff1f-5047-42d0-8c93-a68bac63ec50-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd30f1-8401-4836-a8f9-3da46b05452f-serving-cert\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzbww\" (UniqueName: \"kubernetes.io/projected/58dd30f1-8401-4836-a8f9-3da46b05452f-kube-api-access-pzbww\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rffh7\" (UniqueName: \"kubernetes.io/projected/59f51710-f801-48d4-8e26-4186ab4ddb71-kube-api-access-rffh7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jks\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqlln\" (UniqueName: \"kubernetes.io/projected/d25fff1f-5047-42d0-8c93-a68bac63ec50-kube-api-access-nqlln\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-stats-auth\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt67s\" (UniqueName: \"kubernetes.io/projected/e1111b24-1671-43d0-8880-1e6b808bdb80-kube-api-access-zt67s\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-tmp\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbp4x\" (UniqueName: \"kubernetes.io/projected/25510c44-793c-46fc-802c-45cb8361af75-kube-api-access-lbp4x\") pod \"volume-data-source-validator-549c6d54cf-z65wn\" (UID: \"25510c44-793c-46fc-802c-45cb8361af75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-snapshots\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-service-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543755    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.543955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.543778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjd8\" (UniqueName: \"kubernetes.io/projected/0c43f0d9-5d66-4838-9119-d060a4ea18a2-kube-api-access-7bjd8\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.544679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.544320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59f51710-f801-48d4-8e26-4186ab4ddb71-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.544679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.544378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59f51710-f801-48d4-8e26-4186ab4ddb71-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.544679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.544421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-trusted-ca\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.544679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.544453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25fff1f-5047-42d0-8c93-a68bac63ec50-config\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.613815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.613772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:30.645357 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt67s\" (UniqueName: \"kubernetes.io/projected/e1111b24-1671-43d0-8880-1e6b808bdb80-kube-api-access-zt67s\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.645357 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-tmp\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.645357 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbp4x\" (UniqueName: \"kubernetes.io/projected/25510c44-793c-46fc-802c-45cb8361af75-kube-api-access-lbp4x\") pod \"volume-data-source-validator-549c6d54cf-z65wn\" (UID: \"25510c44-793c-46fc-802c-45cb8361af75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"
Jul 24 16:06:30.645624 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-snapshots\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.645624 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-service-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.645624 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.645624 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqpx\" (UniqueName: \"kubernetes.io/projected/3eff99bf-f98f-461d-988e-2e78d5e03899-kube-api-access-vsqpx\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.645842 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-tmp\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.645895 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.645948 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjd8\" (UniqueName: \"kubernetes.io/projected/0c43f0d9-5d66-4838-9119-d060a4ea18a2-kube-api-access-7bjd8\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.646008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eff99bf-f98f-461d-988e-2e78d5e03899-cert\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.646008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.645992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59f51710-f801-48d4-8e26-4186ab4ddb71-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.646097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-service-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.646097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bbadbd8b-ced4-4d90-a17a-5686275f4839-snapshots\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.646271 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59f51710-f801-48d4-8e26-4186ab4ddb71-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.646396 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a44290-1bcc-4162-b399-4c4712855bf9-tmp-dir\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.646396 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-trusted-ca\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.646396 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25fff1f-5047-42d0-8c93-a68bac63ec50-config\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbadbd8b-ced4-4d90-a17a-5686275f4839-serving-cert\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2450dc38-ba13-4aec-b1d0-334b0d0db42b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/59f51710-f801-48d4-8e26-4186ab4ddb71-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.646575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.646654    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.646689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a44290-1bcc-4162-b399-4c4712855bf9-config-volume\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.646715    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.146698667 +0000 UTC m=+36.092478948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.646752    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:30.646925 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.646854    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.647163    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.147139516 +0000 UTC m=+36.092919804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.647186    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.147175728 +0000 UTC m=+36.092956007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-default-certificate\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-trusted-ca\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.647302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.647601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.647601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d25fff1f-5047-42d0-8c93-a68bac63ec50-config\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.647601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2450dc38-ba13-4aec-b1d0-334b0d0db42b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.647601 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.647578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.1475632 +0000 UTC m=+36.093343496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.647996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwjhm\" (UniqueName: \"kubernetes.io/projected/a4cc8721-4a26-4dbb-b90d-082eeabe2a77-kube-api-access-dwjhm\") pod \"network-check-source-7d88cb55d8-m8cfd\" (UID: \"a4cc8721-4a26-4dbb-b90d-082eeabe2a77\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648024    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1111b24-1671-43d0-8880-1e6b808bdb80-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-config\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpb2b\" (UniqueName: \"kubernetes.io/projected/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-kube-api-access-qpb2b\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjr75\" (UniqueName: \"kubernetes.io/projected/bbadbd8b-ced4-4d90-a17a-5686275f4839-kube-api-access-xjr75\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d25fff1f-5047-42d0-8c93-a68bac63ec50-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd30f1-8401-4836-a8f9-3da46b05452f-serving-cert\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzbww\" (UniqueName: \"kubernetes.io/projected/58dd30f1-8401-4836-a8f9-3da46b05452f-kube-api-access-pzbww\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rffh7\" (UniqueName: \"kubernetes.io/projected/59f51710-f801-48d4-8e26-4186ab4ddb71-kube-api-access-rffh7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.649132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jks\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqlln\" (UniqueName: \"kubernetes.io/projected/d25fff1f-5047-42d0-8c93-a68bac63ec50-kube-api-access-nqlln\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-stats-auth\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4rb\" (UniqueName: \"kubernetes.io/projected/53a44290-1bcc-4162-b399-4c4712855bf9-kube-api-access-5k4rb\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbadbd8b-ced4-4d90-a17a-5686275f4839-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648839    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.648850    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e1111b24-1671-43d0-8880-1e6b808bdb80-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.649072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58dd30f1-8401-4836-a8f9-3da46b05452f-config\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.649341    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.649390    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.149374055 +0000 UTC m=+36.095154355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.650009    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.650025    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:30.650120 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.650078    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.150064135 +0000 UTC m=+36.095844430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:30.651094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.651066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-default-certificate\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.651861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.651621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bbadbd8b-ced4-4d90-a17a-5686275f4839-serving-cert\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.651968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.651953    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.652168 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.652134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/59f51710-f801-48d4-8e26-4186ab4ddb71-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.652659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.652618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.653035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.653013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58dd30f1-8401-4836-a8f9-3da46b05452f-serving-cert\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.654111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.653991    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-stats-auth\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.654664 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.654641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d25fff1f-5047-42d0-8c93-a68bac63ec50-serving-cert\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.656345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.656320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt67s\" (UniqueName: \"kubernetes.io/projected/e1111b24-1671-43d0-8880-1e6b808bdb80-kube-api-access-zt67s\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:30.656688 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.656662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbp4x\" (UniqueName: \"kubernetes.io/projected/25510c44-793c-46fc-802c-45cb8361af75-kube-api-access-lbp4x\") pod \"volume-data-source-validator-549c6d54cf-z65wn\" (UID: \"25510c44-793c-46fc-802c-45cb8361af75\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"
Jul 24 16:06:30.656861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.656841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.658206 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.658179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjd8\" (UniqueName: \"kubernetes.io/projected/0c43f0d9-5d66-4838-9119-d060a4ea18a2-kube-api-access-7bjd8\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:30.659122 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.659078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rffh7\" (UniqueName: \"kubernetes.io/projected/59f51710-f801-48d4-8e26-4186ab4ddb71-kube-api-access-rffh7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-l845t\" (UID: \"59f51710-f801-48d4-8e26-4186ab4ddb71\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.659278 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.659238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjr75\" (UniqueName: \"kubernetes.io/projected/bbadbd8b-ced4-4d90-a17a-5686275f4839-kube-api-access-xjr75\") pod \"insights-operator-5885fdb759-9k8pw\" (UID: \"bbadbd8b-ced4-4d90-a17a-5686275f4839\") " pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.659349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.659327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jks\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:30.659456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.659423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzbww\" (UniqueName: \"kubernetes.io/projected/58dd30f1-8401-4836-a8f9-3da46b05452f-kube-api-access-pzbww\") pod \"console-operator-584dcb6b54-szsnm\" (UID: \"58dd30f1-8401-4836-a8f9-3da46b05452f\") " pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.659844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.659827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqlln\" (UniqueName: \"kubernetes.io/projected/d25fff1f-5047-42d0-8c93-a68bac63ec50-kube-api-access-nqlln\") pod \"service-ca-operator-5d6c75f84f-cndhm\" (UID: \"d25fff1f-5047-42d0-8c93-a68bac63ec50\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.661542 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.661505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpb2b\" (UniqueName: \"kubernetes.io/projected/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-kube-api-access-qpb2b\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:30.702843 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.702806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:30.749905 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.749871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4rb\" (UniqueName: \"kubernetes.io/projected/53a44290-1bcc-4162-b399-4c4712855bf9-kube-api-access-5k4rb\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.750096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.749923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqpx\" (UniqueName: \"kubernetes.io/projected/3eff99bf-f98f-461d-988e-2e78d5e03899-kube-api-access-vsqpx\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.750096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eff99bf-f98f-461d-988e-2e78d5e03899-cert\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.750209 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a44290-1bcc-4162-b399-4c4712855bf9-tmp-dir\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.750298 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.750298 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a44290-1bcc-4162-b399-4c4712855bf9-config-volume\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.750391 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.750299    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:30.750391 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwjhm\" (UniqueName: \"kubernetes.io/projected/a4cc8721-4a26-4dbb-b90d-082eeabe2a77-kube-api-access-dwjhm\") pod \"network-check-source-7d88cb55d8-m8cfd\" (UID: \"a4cc8721-4a26-4dbb-b90d-082eeabe2a77\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"
Jul 24 16:06:30.750391 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:30.750373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:31.250352584 +0000 UTC m=+36.196132863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:30.750574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a44290-1bcc-4162-b399-4c4712855bf9-tmp-dir\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.750888 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.750867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a44290-1bcc-4162-b399-4c4712855bf9-config-volume\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.752864 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.752844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eff99bf-f98f-461d-988e-2e78d5e03899-cert\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.758793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.758768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4rb\" (UniqueName: \"kubernetes.io/projected/53a44290-1bcc-4162-b399-4c4712855bf9-kube-api-access-5k4rb\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:30.759076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.759055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqpx\" (UniqueName: \"kubernetes.io/projected/3eff99bf-f98f-461d-988e-2e78d5e03899-kube-api-access-vsqpx\") pod \"ingress-canary-8f6rc\" (UID: \"3eff99bf-f98f-461d-988e-2e78d5e03899\") " pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.759240 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.759203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwjhm\" (UniqueName: \"kubernetes.io/projected/a4cc8721-4a26-4dbb-b90d-082eeabe2a77-kube-api-access-dwjhm\") pod \"network-check-source-7d88cb55d8-m8cfd\" (UID: \"a4cc8721-4a26-4dbb-b90d-082eeabe2a77\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"
Jul 24 16:06:30.767104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.766764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"
Jul 24 16:06:30.774734 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.774713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:30.796304 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.796100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"
Jul 24 16:06:30.812504 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.812214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9k8pw"
Jul 24 16:06:30.840563 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.840526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"
Jul 24 16:06:30.863790 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.863755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8f6rc"
Jul 24 16:06:30.879686 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:30.878400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"
Jul 24 16:06:31.022624 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.022511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn"]
Jul 24 16:06:31.031886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.031601    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-szsnm"]
Jul 24 16:06:31.035125 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.035018    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dd30f1_8401_4836_a8f9_3da46b05452f.slice/crio-3313a456a7a34fdb9790cc40bf0d082f31415b8aa05b7314f7bb01aef2308e86 WatchSource:0}: Error finding container 3313a456a7a34fdb9790cc40bf0d082f31415b8aa05b7314f7bb01aef2308e86: Status 404 returned error can't find the container with id 3313a456a7a34fdb9790cc40bf0d082f31415b8aa05b7314f7bb01aef2308e86
Jul 24 16:06:31.035409 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.035374    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25510c44_793c_46fc_802c_45cb8361af75.slice/crio-e658ef1b64c236df694f99d48eaa6ee27878f5bb6b6852931e2a5fb0f0000b2f WatchSource:0}: Error finding container e658ef1b64c236df694f99d48eaa6ee27878f5bb6b6852931e2a5fb0f0000b2f: Status 404 returned error can't find the container with id e658ef1b64c236df694f99d48eaa6ee27878f5bb6b6852931e2a5fb0f0000b2f
Jul 24 16:06:31.042157 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.041657    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm"]
Jul 24 16:06:31.043302 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.042759    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25fff1f_5047_42d0_8c93_a68bac63ec50.slice/crio-474aaf35df48c7b800b98eac300e8cabd80e1610544e0b394f7128e28dda984f WatchSource:0}: Error finding container 474aaf35df48c7b800b98eac300e8cabd80e1610544e0b394f7128e28dda984f: Status 404 returned error can't find the container with id 474aaf35df48c7b800b98eac300e8cabd80e1610544e0b394f7128e28dda984f
Jul 24 16:06:31.058659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.058631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9k8pw"]
Jul 24 16:06:31.066283 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.066238    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbadbd8b_ced4_4d90_a17a_5686275f4839.slice/crio-ceeccaef352c943885b1d7ff9b1c07c3670065ba25dd8ee3555555b38d2e4359 WatchSource:0}: Error finding container ceeccaef352c943885b1d7ff9b1c07c3670065ba25dd8ee3555555b38d2e4359: Status 404 returned error can't find the container with id ceeccaef352c943885b1d7ff9b1c07c3670065ba25dd8ee3555555b38d2e4359
Jul 24 16:06:31.094275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.093518    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t"]
Jul 24 16:06:31.108110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.108089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8f6rc"]
Jul 24 16:06:31.111496 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.111474    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eff99bf_f98f_461d_988e_2e78d5e03899.slice/crio-92292e2807f196817481389ef37f1aaeb53cff545758701ab174e1e48275c229 WatchSource:0}: Error finding container 92292e2807f196817481389ef37f1aaeb53cff545758701ab174e1e48275c229: Status 404 returned error can't find the container with id 92292e2807f196817481389ef37f1aaeb53cff545758701ab174e1e48275c229
Jul 24 16:06:31.120063 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.120037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd"]
Jul 24 16:06:31.123158 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:31.123132    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cc8721_4a26_4dbb_b90d_082eeabe2a77.slice/crio-c5ed80537da73607d69c189ab9df19a86209f98e3a7c1f341ed62d308ee86147 WatchSource:0}: Error finding container c5ed80537da73607d69c189ab9df19a86209f98e3a7c1f341ed62d308ee86147: Status 404 returned error can't find the container with id c5ed80537da73607d69c189ab9df19a86209f98e3a7c1f341ed62d308ee86147
Jul 24 16:06:31.157132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157263    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.157307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:31.157329 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157313    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157329    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157364    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157336    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157313755 +0000 UTC m=+37.103094053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157410    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157391869 +0000 UTC m=+37.103172160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157428    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157418842 +0000 UTC m=+37.103199124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157442    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157453    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157453    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157444232 +0000 UTC m=+37.103224512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157473    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157465133 +0000 UTC m=+37.103245414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:31.157667 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.157494    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.157482501 +0000 UTC m=+37.103262792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:31.258803 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.258774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:31.258949 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.258930    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:31.259009 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:31.259001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:32.258984371 +0000 UTC m=+37.204764647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:31.719295 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.719153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:31.762336 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.762297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd" event={"ID":"a4cc8721-4a26-4dbb-b90d-082eeabe2a77","Type":"ContainerStarted","Data":"c5ed80537da73607d69c189ab9df19a86209f98e3a7c1f341ed62d308ee86147"}
Jul 24 16:06:31.763640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.763608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8f6rc" event={"ID":"3eff99bf-f98f-461d-988e-2e78d5e03899","Type":"ContainerStarted","Data":"92292e2807f196817481389ef37f1aaeb53cff545758701ab174e1e48275c229"}
Jul 24 16:06:31.765177 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.765125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t" event={"ID":"59f51710-f801-48d4-8e26-4186ab4ddb71","Type":"ContainerStarted","Data":"31e27e5c17eaf13bdde68d650afa70d32453330a7cf48bea177dda28659dc9bb"}
Jul 24 16:06:31.766426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.766396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9k8pw" event={"ID":"bbadbd8b-ced4-4d90-a17a-5686275f4839","Type":"ContainerStarted","Data":"ceeccaef352c943885b1d7ff9b1c07c3670065ba25dd8ee3555555b38d2e4359"}
Jul 24 16:06:31.767666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.767641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn" event={"ID":"25510c44-793c-46fc-802c-45cb8361af75","Type":"ContainerStarted","Data":"e658ef1b64c236df694f99d48eaa6ee27878f5bb6b6852931e2a5fb0f0000b2f"}
Jul 24 16:06:31.768898 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.768875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm" event={"ID":"d25fff1f-5047-42d0-8c93-a68bac63ec50","Type":"ContainerStarted","Data":"474aaf35df48c7b800b98eac300e8cabd80e1610544e0b394f7128e28dda984f"}
Jul 24 16:06:31.769997 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:31.769955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" event={"ID":"58dd30f1-8401-4836-a8f9-3da46b05452f","Type":"ContainerStarted","Data":"3313a456a7a34fdb9790cc40bf0d082f31415b8aa05b7314f7bb01aef2308e86"}
Jul 24 16:06:32.169867 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.169825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:32.170059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.169874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:32.170059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.169905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:32.170059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.169965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:32.170059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.170024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:32.170059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.170057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.1702052 +0000 UTC m=+39.115985496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170249    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170262    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170285    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170291    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.170279991 +0000 UTC m=+39.116060279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170295    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:32.170336 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170327    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.170317113 +0000 UTC m=+39.116097393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:32.170761 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170353    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:32.170761 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170359    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.170334698 +0000 UTC m=+39.116114977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:32.170761 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170384    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.170374892 +0000 UTC m=+39.116155181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:32.170761 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170408    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:32.170761 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.170440    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.170430503 +0000 UTC m=+39.116210781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:32.270779 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:32.270734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:32.270963 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.270925    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:32.271028 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:32.271007    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:34.270985322 +0000 UTC m=+39.216765610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:33.754423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:33.754280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:33.817532 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:33.817494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.190429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.190615    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.190674    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.190656825 +0000 UTC m=+43.136437108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191069    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191120    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.191105852 +0000 UTC m=+43.136886134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191177    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191219    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.191207416 +0000 UTC m=+43.136987694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191297    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:34.191521 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191328    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.191318579 +0000 UTC m=+43.137098856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:34.192389 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191392    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.191381433 +0000 UTC m=+43.137161712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:34.192389 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191450    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:34.192389 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191460    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:34.192389 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.191486    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.191477387 +0000 UTC m=+43.137257669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:34.291457 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.291419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:34.291721 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.291703    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:34.291792 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:34.291768    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:38.291750119 +0000 UTC m=+43.237530402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:34.787500 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.787463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t" event={"ID":"59f51710-f801-48d4-8e26-4186ab4ddb71","Type":"ContainerStarted","Data":"a343d280db67bbf59a61a77687a799600bc984f1b6e8e80688a0d919aa021ae5"}
Jul 24 16:06:34.806968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.806710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t" podStartSLOduration=12.697607257 podStartE2EDuration="15.806689223s" totalImagesPullingTime="3.109081966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:34.804613519 +0000 UTC m=+39.750393818" watchObservedRunningTime="2026-07-24 16:06:34.806689223 +0000 UTC m=+39.752469522"
Jul 24 16:06:34.811886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.807982    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="c862d5a27f1356a3eb192536f0bf8d89cb79b9b5590b6a12a4b8aada3b2b1327" exitCode=0
Jul 24 16:06:34.811886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.808032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"c862d5a27f1356a3eb192536f0bf8d89cb79b9b5590b6a12a4b8aada3b2b1327"}
Jul 24 16:06:34.940019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:34.939949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:35.004415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:35.004344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:36.931270 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.931200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:36.934958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.934935    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"]
Jul 24 16:06:36.966795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.966754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"]
Jul 24 16:06:36.966960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.966827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"
Jul 24 16:06:36.970540 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.970504    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 24 16:06:36.970994 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.970968    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ftnsp\""
Jul 24 16:06:36.971114 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:36.971080    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 24 16:06:37.040112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.040073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:37.112054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.112022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:37.120030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.119994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcv4n\" (UniqueName: \"kubernetes.io/projected/d7b0b757-9856-4c76-acf5-362b475510ea-kube-api-access-bcv4n\") pod \"migrator-6865c9967-cmmz2\" (UID: \"d7b0b757-9856-4c76-acf5-362b475510ea\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"
Jul 24 16:06:37.221712 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.221623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcv4n\" (UniqueName: \"kubernetes.io/projected/d7b0b757-9856-4c76-acf5-362b475510ea-kube-api-access-bcv4n\") pod \"migrator-6865c9967-cmmz2\" (UID: \"d7b0b757-9856-4c76-acf5-362b475510ea\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"
Jul 24 16:06:37.232444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.232416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcv4n\" (UniqueName: \"kubernetes.io/projected/d7b0b757-9856-4c76-acf5-362b475510ea-kube-api-access-bcv4n\") pod \"migrator-6865c9967-cmmz2\" (UID: \"d7b0b757-9856-4c76-acf5-362b475510ea\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"
Jul 24 16:06:37.278370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:37.278336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"
Jul 24 16:06:38.231342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:38.231342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231468    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231494    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231528    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231511223 +0000 UTC m=+51.177291500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231590    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231606    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231587216 +0000 UTC m=+51.177367492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231644    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231633555 +0000 UTC m=+51.177413831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231663    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231654247 +0000 UTC m=+51.177434527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.231733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231815    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231832    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:38.231847 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231853    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:38.232420 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231834801 +0000 UTC m=+51.177615077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:38.232420 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.231935    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.231918797 +0000 UTC m=+51.177699080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:38.332304 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:38.332270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:38.332461 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.332425    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:38.332511 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:38.332501    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:06:46.332486103 +0000 UTC m=+51.278266380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:40.252737 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.252707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2"]
Jul 24 16:06:40.255410 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:40.255386    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b0b757_9856_4c76_acf5_362b475510ea.slice/crio-35dd3723e8370736b7c272a17e45488fee2b06490ef57f49378cea4de2620f73 WatchSource:0}: Error finding container 35dd3723e8370736b7c272a17e45488fee2b06490ef57f49378cea4de2620f73: Status 404 returned error can't find the container with id 35dd3723e8370736b7c272a17e45488fee2b06490ef57f49378cea4de2620f73
Jul 24 16:06:40.825023 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.824992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd" event={"ID":"a4cc8721-4a26-4dbb-b90d-082eeabe2a77","Type":"ContainerStarted","Data":"c4b5f1fb1fb461c66e2f902a1f199b7c8370c24cfa2291152646c0d92e19a42b"}
Jul 24 16:06:40.826561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.826529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8f6rc" event={"ID":"3eff99bf-f98f-461d-988e-2e78d5e03899","Type":"ContainerStarted","Data":"9f42cd01534832916bd6fef2a071f1bb697776ca3749a85626b3168c5b9af4a7"}
Jul 24 16:06:40.832336 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.831926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9k8pw" event={"ID":"bbadbd8b-ced4-4d90-a17a-5686275f4839","Type":"ContainerStarted","Data":"6139882c60784b594879957cd7533710a2445a98c2e40ec8d07cff10d45fd2d0"}
Jul 24 16:06:40.834431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.833927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn" event={"ID":"25510c44-793c-46fc-802c-45cb8361af75","Type":"ContainerStarted","Data":"8efc0bcfe25470c37f16d514c6794c7d033b05b5bdc1ce1c3c6c0279db2f5d56"}
Jul 24 16:06:40.835371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.835333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2" event={"ID":"d7b0b757-9856-4c76-acf5-362b475510ea","Type":"ContainerStarted","Data":"35dd3723e8370736b7c272a17e45488fee2b06490ef57f49378cea4de2620f73"}
Jul 24 16:06:40.844738 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.844694    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-m8cfd" podStartSLOduration=12.835230485 podStartE2EDuration="21.844677419s" totalImagesPullingTime="9.009446934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:40.843404361 +0000 UTC m=+45.789184660" watchObservedRunningTime="2026-07-24 16:06:40.844677419 +0000 UTC m=+45.790457718"
Jul 24 16:06:40.847727 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.847705    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f12bcaa-2383-458d-9b20-e1b1c90cba96" containerID="85f7aa17f2a610119c5184607320091148719472ec8f20a715e97dc59ba0f0bc" exitCode=0
Jul 24 16:06:40.847907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.847742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerDied","Data":"85f7aa17f2a610119c5184607320091148719472ec8f20a715e97dc59ba0f0bc"}
Jul 24 16:06:40.850144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.850124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm" event={"ID":"d25fff1f-5047-42d0-8c93-a68bac63ec50","Type":"ContainerStarted","Data":"6453f2ab77663375ea1bbeb07dba37b508f9b819cede19909d3d95063deeae58"}
Jul 24 16:06:40.853134 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.853111    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/0.log"
Jul 24 16:06:40.853217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.853153    2581 generic.go:356] "Generic (PLEG): container finished" podID="58dd30f1-8401-4836-a8f9-3da46b05452f" containerID="407ffaeaaed96f4cb5e52b709b22dabfbfe1f4053d6b8a27da83e0e96e552da5" exitCode=255
Jul 24 16:06:40.853217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.853202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" event={"ID":"58dd30f1-8401-4836-a8f9-3da46b05452f","Type":"ContainerDied","Data":"407ffaeaaed96f4cb5e52b709b22dabfbfe1f4053d6b8a27da83e0e96e552da5"}
Jul 24 16:06:40.853541 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.853481    2581 scope.go:117] "RemoveContainer" containerID="407ffaeaaed96f4cb5e52b709b22dabfbfe1f4053d6b8a27da83e0e96e552da5"
Jul 24 16:06:40.862687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.862640    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8f6rc" podStartSLOduration=1.849225926 podStartE2EDuration="10.862624382s" totalImagesPullingTime="9.013398456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:40.861419091 +0000 UTC m=+45.807199388" watchObservedRunningTime="2026-07-24 16:06:40.862624382 +0000 UTC m=+45.808404681"
Jul 24 16:06:40.876850 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.876797    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-z65wn" podStartSLOduration=12.793179999 podStartE2EDuration="21.876778076s" totalImagesPullingTime="9.083598077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:40.876630369 +0000 UTC m=+45.822410668" watchObservedRunningTime="2026-07-24 16:06:40.876778076 +0000 UTC m=+45.822558376"
Jul 24 16:06:40.895356 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.894184    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-9k8pw" podStartSLOduration=12.83998767 podStartE2EDuration="21.894160163s" totalImagesPullingTime="9.054172493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:40.893342751 +0000 UTC m=+45.839123050" watchObservedRunningTime="2026-07-24 16:06:40.894160163 +0000 UTC m=+45.839940468"
Jul 24 16:06:40.932068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.932018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm" podStartSLOduration=12.85130099 podStartE2EDuration="21.932004126s" totalImagesPullingTime="9.080703136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:40.931677665 +0000 UTC m=+45.877457966" watchObservedRunningTime="2026-07-24 16:06:40.932004126 +0000 UTC m=+45.877784425"
Jul 24 16:06:40.996447 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:40.996345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:41.095250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.095183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:41.708519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.708487    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pl2dn"]
Jul 24 16:06:41.725308 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.725277    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl2dn"]
Jul 24 16:06:41.725484 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.725360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.728145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.728117    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 16:06:41.728304 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.728117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 16:06:41.729065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.729038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4gkx\""
Jul 24 16:06:41.752889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.752860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:41.769118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.769088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/811057f4-42f1-4b2e-ad21-645420760bbf-crio-socket\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.769285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.769140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.769285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.769259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngm7x\" (UniqueName: \"kubernetes.io/projected/811057f4-42f1-4b2e-ad21-645420760bbf-kube-api-access-ngm7x\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.769389 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.769313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/811057f4-42f1-4b2e-ad21-645420760bbf-data-volume\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.769477 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.769394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.812853 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.812818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:41.860746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.860723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:06:41.861095 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.861081    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/0.log"
Jul 24 16:06:41.861145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.861112    2581 generic.go:356] "Generic (PLEG): container finished" podID="58dd30f1-8401-4836-a8f9-3da46b05452f" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e" exitCode=255
Jul 24 16:06:41.861236 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.861202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" event={"ID":"58dd30f1-8401-4836-a8f9-3da46b05452f","Type":"ContainerDied","Data":"c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"}
Jul 24 16:06:41.861297 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.861283    2581 scope.go:117] "RemoveContainer" containerID="407ffaeaaed96f4cb5e52b709b22dabfbfe1f4053d6b8a27da83e0e96e552da5"
Jul 24 16:06:41.861560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.861533    2581 scope.go:117] "RemoveContainer" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"
Jul 24 16:06:41.861745 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:41.861724    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-szsnm_openshift-console-operator(58dd30f1-8401-4836-a8f9-3da46b05452f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" podUID="58dd30f1-8401-4836-a8f9-3da46b05452f"
Jul 24 16:06:41.864881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.864858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" event={"ID":"0f12bcaa-2383-458d-9b20-e1b1c90cba96","Type":"ContainerStarted","Data":"20cfef3d14a57ee553341bd10b78fe5a3efe8966bf6fa5e6ddcf2d8ad3adc329"}
Jul 24 16:06:41.870664 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/811057f4-42f1-4b2e-ad21-645420760bbf-crio-socket\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngm7x\" (UniqueName: \"kubernetes.io/projected/811057f4-42f1-4b2e-ad21-645420760bbf-kube-api-access-ngm7x\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/811057f4-42f1-4b2e-ad21-645420760bbf-data-volume\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/811057f4-42f1-4b2e-ad21-645420760bbf-crio-socket\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.870833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.870912 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:41.870852    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:41.870912 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:41.870906    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.3708885 +0000 UTC m=+47.316668788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:41.871104 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:41.870933    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:41.871104 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:41.870962    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:42.370953713 +0000 UTC m=+47.316733988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:41.871104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.871082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/811057f4-42f1-4b2e-ad21-645420760bbf-data-volume\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.891384 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.891359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngm7x\" (UniqueName: \"kubernetes.io/projected/811057f4-42f1-4b2e-ad21-645420760bbf-kube-api-access-ngm7x\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:41.928893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:41.928833    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g9j5h" podStartSLOduration=13.188191003 podStartE2EDuration="46.928817026s" totalImagesPullingTime="33.740626023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:41.927705215 +0000 UTC m=+46.873485512" watchObservedRunningTime="2026-07-24 16:06:41.928817026 +0000 UTC m=+46.874597326"
Jul 24 16:06:42.210092 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.210043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:42.297840 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.297759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log" limit=1024
Jul 24 16:06:42.375155 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.375121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:42.375342 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:42.375266    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.375342 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:42.375325    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.375310083 +0000 UTC m=+48.321090362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:42.375342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.375263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:42.375539 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:42.375365    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.375539 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:42.375426    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:43.375409726 +0000 UTC m=+48.321190016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:42.869559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.869521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2" event={"ID":"d7b0b757-9856-4c76-acf5-362b475510ea","Type":"ContainerStarted","Data":"c1d7da972332393af467c8f11a095eebf84d4dcba2ca0122d84ebb4542304c39"}
Jul 24 16:06:42.870028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.869609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2" event={"ID":"d7b0b757-9856-4c76-acf5-362b475510ea","Type":"ContainerStarted","Data":"50d1f7f2e1f13d4cd06ede15577bf336dc3cbbd7f6d45f195ad818a3a48e5e0c"}
Jul 24 16:06:42.871073 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.871054    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:06:42.871421 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.871404    2581 scope.go:117] "RemoveContainer" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"
Jul 24 16:06:42.871606 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:42.871585    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-szsnm_openshift-console-operator(58dd30f1-8401-4836-a8f9-3da46b05452f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" podUID="58dd30f1-8401-4836-a8f9-3da46b05452f"
Jul 24 16:06:42.917346 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:42.917293    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cmmz2" podStartSLOduration=5.14442869 podStartE2EDuration="6.917278295s" totalImagesPullingTime="1.772849605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:06:42.891097979 +0000 UTC m=+47.836878303" watchObservedRunningTime="2026-07-24 16:06:42.917278295 +0000 UTC m=+47.863058594"
Jul 24 16:06:43.382787 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:43.382750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:43.382952 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:43.382863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:43.382952 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:43.382934    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:43.382952 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:43.382952    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:43.383108 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:43.383006    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.382988933 +0000 UTC m=+50.328769209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:43.383108 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:43.383022    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:45.3830143 +0000 UTC m=+50.328794576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:43.695758 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:43.695683    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rl87m_f5145161-3ca1-460a-8fda-08dd3a8511d0/dns-node-resolver/0.log"
Jul 24 16:06:44.892066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:44.892038    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qk29m_d8d2f57c-3eb4-4f54-9853-24f65d577a32/node-ca/0.log"
Jul 24 16:06:45.293177 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.293146    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8f6rc_3eff99bf-f98f-461d-988e-2e78d5e03899/serve-healthcheck-canary/0.log"
Jul 24 16:06:45.399856 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.399822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:45.400042 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:45.399974    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:45.400042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.400010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:45.400042 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:45.400029    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.400014457 +0000 UTC m=+54.345794732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:45.400197 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:45.400057    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 16:06:45.400197 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:45.400096    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:49.400085183 +0000 UTC m=+54.345865459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : configmap "kube-rbac-proxy" not found
Jul 24 16:06:45.509148 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.509110    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cmmz2_d7b0b757-9856-4c76-acf5-362b475510ea/migrator/0.log"
Jul 24 16:06:45.692424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.692347    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cmmz2_d7b0b757-9856-4c76-acf5-362b475510ea/graceful-termination/0.log"
Jul 24 16:06:45.895671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:45.895639    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-l845t_59f51710-f801-48d4-8e26-4186ab4ddb71/kube-storage-version-migrator-operator/0.log"
Jul 24 16:06:46.307317 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307461    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.307441744 +0000 UTC m=+67.253222040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : configmap references non-existent config key: service-ca.crt
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307493    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307498    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 16:06:46.307532 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307515    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854fbd6c4f-k74ng: secret "image-registry-tls" not found
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307542    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert podName:2450dc38-ba13-4aec-b1d0-334b0d0db42b nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.307530762 +0000 UTC m=+67.253311038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-rgnb8" (UID: "2450dc38-ba13-4aec-b1d0-334b0d0db42b") : secret "networking-console-plugin-cert" not found
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307565    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls podName:d9e0dcfb-5aab-4b46-af7a-06f076209e85 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.30755202 +0000 UTC m=+67.253332296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls") pod "image-registry-854fbd6c4f-k74ng" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85") : secret "image-registry-tls" not found
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.307667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:06:46.307745 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307742    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:46.307960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307765    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 24 16:06:46.307960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307779    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls podName:e1111b24-1671-43d0-8880-1e6b808bdb80 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.307768873 +0000 UTC m=+67.253549154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-drnjw" (UID: "e1111b24-1671-43d0-8880-1e6b808bdb80") : secret "cluster-monitoring-operator-tls" not found
Jul 24 16:06:46.307960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307818    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls podName:0c43f0d9-5d66-4838-9119-d060a4ea18a2 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.307806758 +0000 UTC m=+67.253587034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls") pod "cluster-samples-operator-6748489656-gvq4j" (UID: "0c43f0d9-5d66-4838-9119-d060a4ea18a2") : secret "samples-operator-tls" not found
Jul 24 16:06:46.307960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307773    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 24 16:06:46.307960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.307849    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs podName:89f28435-6d7e-46af-b76c-1ca8c4c9f1da nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.307842398 +0000 UTC m=+67.253622674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs") pod "router-default-55d74b7cb7-j6qlv" (UID: "89f28435-6d7e-46af-b76c-1ca8c4c9f1da") : secret "router-metrics-certs-default" not found
Jul 24 16:06:46.408268 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:46.408214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:06:46.408443 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.408358    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 16:06:46.408443 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:46.408415    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls podName:53a44290-1bcc-4162-b399-4c4712855bf9 nodeName:}" failed. No retries permitted until 2026-07-24 16:07:02.408401503 +0000 UTC m=+67.354181784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls") pod "dns-default-lkrpt" (UID: "53a44290-1bcc-4162-b399-4c4712855bf9") : secret "dns-default-metrics-tls" not found
Jul 24 16:06:49.440614 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:49.440580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:49.441200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:49.440691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:49.441200 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:49.440769    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:49.441200 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:49.440856    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls podName:811057f4-42f1-4b2e-ad21-645420760bbf nodeName:}" failed. No retries permitted until 2026-07-24 16:06:57.440834574 +0000 UTC m=+62.386614855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl2dn" (UID: "811057f4-42f1-4b2e-ad21-645420760bbf") : secret "insights-runtime-extractor-tls" not found
Jul 24 16:06:49.441200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:49.441129    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/811057f4-42f1-4b2e-ad21-645420760bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:50.774823 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:50.774777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:50.775215 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:50.775077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:06:50.775215 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:50.775172    2581 scope.go:117] "RemoveContainer" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"
Jul 24 16:06:50.775373 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:50.775351    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-szsnm_openshift-console-operator(58dd30f1-8401-4836-a8f9-3da46b05452f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" podUID="58dd30f1-8401-4836-a8f9-3da46b05452f"
Jul 24 16:06:50.898018 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:50.897992    2581 scope.go:117] "RemoveContainer" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"
Jul 24 16:06:50.898180 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:06:50.898163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-szsnm_openshift-console-operator(58dd30f1-8401-4836-a8f9-3da46b05452f)\"" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" podUID="58dd30f1-8401-4836-a8f9-3da46b05452f"
Jul 24 16:06:56.757019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:56.756992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nllc"
Jul 24 16:06:57.514492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.514459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:57.516746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.516721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/811057f4-42f1-4b2e-ad21-645420760bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl2dn\" (UID: \"811057f4-42f1-4b2e-ad21-645420760bbf\") " pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:57.641281 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.641247    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4gkx\""
Jul 24 16:06:57.645600 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.645579    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl2dn"
Jul 24 16:06:57.768790 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.768722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl2dn"]
Jul 24 16:06:57.771691 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:06:57.771664    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811057f4_42f1_4b2e_ad21_645420760bbf.slice/crio-6dd630b8d20cbc0268155b288b20a28a629308a18b9a11f67a6f4d538700f60c WatchSource:0}: Error finding container 6dd630b8d20cbc0268155b288b20a28a629308a18b9a11f67a6f4d538700f60c: Status 404 returned error can't find the container with id 6dd630b8d20cbc0268155b288b20a28a629308a18b9a11f67a6f4d538700f60c
Jul 24 16:06:57.918142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:06:57.918098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl2dn" event={"ID":"811057f4-42f1-4b2e-ad21-645420760bbf","Type":"ContainerStarted","Data":"6dd630b8d20cbc0268155b288b20a28a629308a18b9a11f67a6f4d538700f60c"}
Jul 24 16:07:00.240399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.240364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:07:00.240834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.240503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:07:00.242574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.242554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 16:07:00.242696 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.242558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 16:07:00.253640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.253618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3c3a185-7e8d-4104-b229-7a08b508b311-original-pull-secret\") pod \"global-pull-secret-syncer-2b9xc\" (UID: \"c3c3a185-7e8d-4104-b229-7a08b508b311\") " pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:07:00.253743 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.253666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6dd050c-bb36-4b36-aa9c-f972635cec1e-metrics-certs\") pod \"network-metrics-daemon-4h4nw\" (UID: \"f6dd050c-bb36-4b36-aa9c-f972635cec1e\") " pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:07:00.256623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.256599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b9xc"
Jul 24 16:07:00.342019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.341987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:07:00.344781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.344750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnphl\" (UniqueName: \"kubernetes.io/projected/0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d-kube-api-access-jnphl\") pod \"network-check-target-2gcbb\" (UID: \"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d\") " pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:07:00.536323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.536291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fvsfq\""
Jul 24 16:07:00.544525 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.544499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4h4nw"
Jul 24 16:07:00.549961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.549938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nb27\""
Jul 24 16:07:00.558744 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:00.558715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:07:02.363821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.363784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:07:02.364347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.363833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:07:02.364347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.363864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:02.364347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.363914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:02.364347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.363964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:02.364347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.364322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:07:02.364784 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.364753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-service-ca-bundle\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:02.367024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.366995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c43f0d9-5d66-4838-9119-d060a4ea18a2-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-gvq4j\" (UID: \"0c43f0d9-5d66-4838-9119-d060a4ea18a2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:07:02.367024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.367014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1111b24-1671-43d0-8880-1e6b808bdb80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-drnjw\" (UID: \"e1111b24-1671-43d0-8880-1e6b808bdb80\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:07:02.367206 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.367003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89f28435-6d7e-46af-b76c-1ca8c4c9f1da-metrics-certs\") pod \"router-default-55d74b7cb7-j6qlv\" (UID: \"89f28435-6d7e-46af-b76c-1ca8c4c9f1da\") " pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:02.367206 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.367117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2450dc38-ba13-4aec-b1d0-334b0d0db42b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-rgnb8\" (UID: \"2450dc38-ba13-4aec-b1d0-334b0d0db42b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:07:02.367523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.367502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"image-registry-854fbd6c4f-k74ng\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") " pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:02.465623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.465588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:07:02.468028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.468001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a44290-1bcc-4162-b399-4c4712855bf9-metrics-tls\") pod \"dns-default-lkrpt\" (UID: \"53a44290-1bcc-4162-b399-4c4712855bf9\") " pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:07:02.554022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.553990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndlwb\""
Jul 24 16:07:02.561983 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.561966    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:02.586199 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.586166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mnqwf\""
Jul 24 16:07:02.594294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.594269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"
Jul 24 16:07:02.608008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.607983    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h6kss\""
Jul 24 16:07:02.615918 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.615857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"
Jul 24 16:07:02.621109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.621093    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5jbdk\""
Jul 24 16:07:02.628481 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.628457    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hqf69\""
Jul 24 16:07:02.629472 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.629454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"
Jul 24 16:07:02.636374 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.636352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:02.673822 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.673789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6rwh\""
Jul 24 16:07:02.681927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:02.681889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:07:03.104030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.102407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b9xc"]
Jul 24 16:07:03.179909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.176112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2gcbb"]
Jul 24 16:07:03.203137 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.203093    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0841c1ec_a2c2_4aaa_9e3f_37ae9b2cc76d.slice/crio-53e9a1fdaa5afe58f5e051df273c7f1527c8867190f707fecd0c3e879a3f9da0 WatchSource:0}: Error finding container 53e9a1fdaa5afe58f5e051df273c7f1527c8867190f707fecd0c3e879a3f9da0: Status 404 returned error can't find the container with id 53e9a1fdaa5afe58f5e051df273c7f1527c8867190f707fecd0c3e879a3f9da0
Jul 24 16:07:03.454512 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.454432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4h4nw"]
Jul 24 16:07:03.457203 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.457175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lkrpt"]
Jul 24 16:07:03.457498 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.457475    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dd050c_bb36_4b36_aa9c_f972635cec1e.slice/crio-9c65dc9d9db11a9d4a75f409152d5c4ac25b9e2b31f861507ea74678ef84aa63 WatchSource:0}: Error finding container 9c65dc9d9db11a9d4a75f409152d5c4ac25b9e2b31f861507ea74678ef84aa63: Status 404 returned error can't find the container with id 9c65dc9d9db11a9d4a75f409152d5c4ac25b9e2b31f861507ea74678ef84aa63
Jul 24 16:07:03.459868 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.459729    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a44290_1bcc_4162_b399_4c4712855bf9.slice/crio-86c73067b34fb76f8c0adf6e19bacd36855bc7c173f3850ee1d6fed4bfa0f353 WatchSource:0}: Error finding container 86c73067b34fb76f8c0adf6e19bacd36855bc7c173f3850ee1d6fed4bfa0f353: Status 404 returned error can't find the container with id 86c73067b34fb76f8c0adf6e19bacd36855bc7c173f3850ee1d6fed4bfa0f353
Jul 24 16:07:03.463193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.463162    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55d74b7cb7-j6qlv"]
Jul 24 16:07:03.471702 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.471672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f28435_6d7e_46af_b76c_1ca8c4c9f1da.slice/crio-cd54ef6158804554b6bbdf80eaca0c98832ea1e1d407fb8da860fbdd2b68c272 WatchSource:0}: Error finding container cd54ef6158804554b6bbdf80eaca0c98832ea1e1d407fb8da860fbdd2b68c272: Status 404 returned error can't find the container with id cd54ef6158804554b6bbdf80eaca0c98832ea1e1d407fb8da860fbdd2b68c272
Jul 24 16:07:03.500853 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.500826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw"]
Jul 24 16:07:03.501887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.501866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8"]
Jul 24 16:07:03.504439 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.504238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j"]
Jul 24 16:07:03.509069 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.507858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:07:03.509069 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.508331    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2450dc38_ba13_4aec_b1d0_334b0d0db42b.slice/crio-db9212d3dfde849680f21284df5bdebf6f2de23f5993b32482d8b3705082835f WatchSource:0}: Error finding container db9212d3dfde849680f21284df5bdebf6f2de23f5993b32482d8b3705082835f: Status 404 returned error can't find the container with id db9212d3dfde849680f21284df5bdebf6f2de23f5993b32482d8b3705082835f
Jul 24 16:07:03.509069 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.508815    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1111b24_1671_43d0_8880_1e6b808bdb80.slice/crio-3afec4a76fc928997921baf41ed538b843083789e34ee3c4787ca4a13fdd04fd WatchSource:0}: Error finding container 3afec4a76fc928997921baf41ed538b843083789e34ee3c4787ca4a13fdd04fd: Status 404 returned error can't find the container with id 3afec4a76fc928997921baf41ed538b843083789e34ee3c4787ca4a13fdd04fd
Jul 24 16:07:03.513100 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:03.513070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e0dcfb_5aab_4b46_af7a_06f076209e85.slice/crio-45bb8b73698fce4caa8246124b3ce3cfa92f804ce88251af4513d36edace1fac WatchSource:0}: Error finding container 45bb8b73698fce4caa8246124b3ce3cfa92f804ce88251af4513d36edace1fac: Status 404 returned error can't find the container with id 45bb8b73698fce4caa8246124b3ce3cfa92f804ce88251af4513d36edace1fac
Jul 24 16:07:03.944720 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.944116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" event={"ID":"d9e0dcfb-5aab-4b46-af7a-06f076209e85","Type":"ContainerStarted","Data":"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"}
Jul 24 16:07:03.944720 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.944175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" event={"ID":"d9e0dcfb-5aab-4b46-af7a-06f076209e85","Type":"ContainerStarted","Data":"45bb8b73698fce4caa8246124b3ce3cfa92f804ce88251af4513d36edace1fac"}
Jul 24 16:07:03.944720 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.944244    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:03.945707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.945681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8" event={"ID":"2450dc38-ba13-4aec-b1d0-334b0d0db42b","Type":"ContainerStarted","Data":"db9212d3dfde849680f21284df5bdebf6f2de23f5993b32482d8b3705082835f"}
Jul 24 16:07:03.947713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.947685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl2dn" event={"ID":"811057f4-42f1-4b2e-ad21-645420760bbf","Type":"ContainerStarted","Data":"e75e075998b132fce7a10c61cff5a5b3320903bf92b827668a2114e492122562"}
Jul 24 16:07:03.949531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.949469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h4nw" event={"ID":"f6dd050c-bb36-4b36-aa9c-f972635cec1e","Type":"ContainerStarted","Data":"9c65dc9d9db11a9d4a75f409152d5c4ac25b9e2b31f861507ea74678ef84aa63"}
Jul 24 16:07:03.950931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.950906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b9xc" event={"ID":"c3c3a185-7e8d-4104-b229-7a08b508b311","Type":"ContainerStarted","Data":"92ea3190dc7094d26c777ea360ff2edc8e0c08d7ca3b2d40d5d6ba301c339a39"}
Jul 24 16:07:03.952494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.952442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lkrpt" event={"ID":"53a44290-1bcc-4162-b399-4c4712855bf9","Type":"ContainerStarted","Data":"86c73067b34fb76f8c0adf6e19bacd36855bc7c173f3850ee1d6fed4bfa0f353"}
Jul 24 16:07:03.954752 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.954731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv" event={"ID":"89f28435-6d7e-46af-b76c-1ca8c4c9f1da","Type":"ContainerStarted","Data":"b354b0d379ffe2395ca1a41cae4daf61ab29506753b11e070ef5d3c6a30668dd"}
Jul 24 16:07:03.954947 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.954932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv" event={"ID":"89f28435-6d7e-46af-b76c-1ca8c4c9f1da","Type":"ContainerStarted","Data":"cd54ef6158804554b6bbdf80eaca0c98832ea1e1d407fb8da860fbdd2b68c272"}
Jul 24 16:07:03.957332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.957308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2gcbb" event={"ID":"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d","Type":"ContainerStarted","Data":"5c2d3f2c53b6055233da29689ce423c91ce9bede90c76f87552550448307f65b"}
Jul 24 16:07:03.957441 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.957349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2gcbb" event={"ID":"0841c1ec-a2c2-4aaa-9e3f-37ae9b2cc76d","Type":"ContainerStarted","Data":"53e9a1fdaa5afe58f5e051df273c7f1527c8867190f707fecd0c3e879a3f9da0"}
Jul 24 16:07:03.957892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.957872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:07:03.959324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.959299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw" event={"ID":"e1111b24-1671-43d0-8880-1e6b808bdb80","Type":"ContainerStarted","Data":"3afec4a76fc928997921baf41ed538b843083789e34ee3c4787ca4a13fdd04fd"}
Jul 24 16:07:03.961490 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.961439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j" event={"ID":"0c43f0d9-5d66-4838-9119-d060a4ea18a2","Type":"ContainerStarted","Data":"e3bf7325a06364babf667c4d5950d313cacd589cf26a4e7f41be471ffd59f3f7"}
Jul 24 16:07:03.971455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.971405    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" podStartSLOduration=67.971389338 podStartE2EDuration="1m7.971389338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:05:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:03.969798285 +0000 UTC m=+68.915578609" watchObservedRunningTime="2026-07-24 16:07:03.971389338 +0000 UTC m=+68.917169639"
Jul 24 16:07:03.989062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:03.987720    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2gcbb" podStartSLOduration=68.987700739 podStartE2EDuration="1m8.987700739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:03.986635825 +0000 UTC m=+68.932416124" watchObservedRunningTime="2026-07-24 16:07:03.987700739 +0000 UTC m=+68.933481038"
Jul 24 16:07:04.010288 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.008689    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv" podStartSLOduration=45.008670223 podStartE2EDuration="45.008670223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:04.008341261 +0000 UTC m=+68.954121578" watchObservedRunningTime="2026-07-24 16:07:04.008670223 +0000 UTC m=+68.954450500"
Jul 24 16:07:04.609210 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.609176    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"]
Jul 24 16:07:04.612800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.612774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.620813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.619856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 16:07:04.620813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.620131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 16:07:04.620813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.620413    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 16:07:04.620813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.620610    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 16:07:04.637093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.636980    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:04.639637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.639368    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"]
Jul 24 16:07:04.641162 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.641040    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:04.696502 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.696270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df8ec997-5980-451e-919c-bc5fc240610a-klusterlet-config\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.696502 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.696342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df8ec997-5980-451e-919c-bc5fc240610a-tmp\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.696502 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.696381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297nh\" (UniqueName: \"kubernetes.io/projected/df8ec997-5980-451e-919c-bc5fc240610a-kube-api-access-297nh\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.797671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.797633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df8ec997-5980-451e-919c-bc5fc240610a-tmp\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.797863 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.797692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-297nh\" (UniqueName: \"kubernetes.io/projected/df8ec997-5980-451e-919c-bc5fc240610a-kube-api-access-297nh\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.797863 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.797763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df8ec997-5980-451e-919c-bc5fc240610a-klusterlet-config\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.798927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.798568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df8ec997-5980-451e-919c-bc5fc240610a-tmp\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.822024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.821944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df8ec997-5980-451e-919c-bc5fc240610a-klusterlet-config\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.824175 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.824123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-297nh\" (UniqueName: \"kubernetes.io/projected/df8ec997-5980-451e-919c-bc5fc240610a-kube-api-access-297nh\") pod \"klusterlet-addon-workmgr-67976b849-v25x6\" (UID: \"df8ec997-5980-451e-919c-bc5fc240610a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.928069 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.927720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:04.970646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.970615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:04.971851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:04.971828    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55d74b7cb7-j6qlv"
Jul 24 16:07:06.481834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:06.481756    2581 scope.go:117] "RemoveContainer" containerID="c78629d4fbab63fd2db14179068a3fc1370e8253f847eed7e2346cf4641c8c7e"
Jul 24 16:07:10.666323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:10.666286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"]
Jul 24 16:07:11.353949 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:11.353914    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8ec997_5980_451e_919c_bc5fc240610a.slice/crio-d4ea30281c58b1d610124a42586394cc5fa249057e08a94bd12a7b8b275ab8e0 WatchSource:0}: Error finding container d4ea30281c58b1d610124a42586394cc5fa249057e08a94bd12a7b8b275ab8e0: Status 404 returned error can't find the container with id d4ea30281c58b1d610124a42586394cc5fa249057e08a94bd12a7b8b275ab8e0
Jul 24 16:07:12.002136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.002044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw" event={"ID":"e1111b24-1671-43d0-8880-1e6b808bdb80","Type":"ContainerStarted","Data":"735a5bf794a1ed9c2562481acbf636f63933269a00d06ab2ddc7bcbec83a0966"}
Jul 24 16:07:12.005283 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.005176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j" event={"ID":"0c43f0d9-5d66-4838-9119-d060a4ea18a2","Type":"ContainerStarted","Data":"ac52bdef452be7a2f7993f570e1d8e4a3f320670be4e422a8af7e61e4de61562"}
Jul 24 16:07:12.008120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.008032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8" event={"ID":"2450dc38-ba13-4aec-b1d0-334b0d0db42b","Type":"ContainerStarted","Data":"815bf4e52affd8f1b89f1aad7fe1db9a4d9fe4e0757d437f964721a314acf5a5"}
Jul 24 16:07:12.027249 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.025820    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:07:12.027249 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.025929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" event={"ID":"58dd30f1-8401-4836-a8f9-3da46b05452f","Type":"ContainerStarted","Data":"55cd225d6ac81360b0eb30eafd49602d9de075ac2b8555af17c73722273a297e"}
Jul 24 16:07:12.027249 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.027123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:07:12.037649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.037570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h4nw" event={"ID":"f6dd050c-bb36-4b36-aa9c-f972635cec1e","Type":"ContainerStarted","Data":"0b611457003edaf75d8e2cf5a848158f90dcf32b23894e9e93915b8807a609b5"}
Jul 24 16:07:12.040012 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.039530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b9xc" event={"ID":"c3c3a185-7e8d-4104-b229-7a08b508b311","Type":"ContainerStarted","Data":"879c5e1acf6ae731bfae83af95290c148a2b08c48e73ff25e4b670e56c0c3fbb"}
Jul 24 16:07:12.042307 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.042152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lkrpt" event={"ID":"53a44290-1bcc-4162-b399-4c4712855bf9","Type":"ContainerStarted","Data":"ed00e4ac56738d70993d667830314c259ced7804306dd82554faad957b430956"}
Jul 24 16:07:12.047933 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.045478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6" event={"ID":"df8ec997-5980-451e-919c-bc5fc240610a","Type":"ContainerStarted","Data":"d4ea30281c58b1d610124a42586394cc5fa249057e08a94bd12a7b8b275ab8e0"}
Jul 24 16:07:12.050472 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.049810    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-drnjw" podStartSLOduration=45.050220824 podStartE2EDuration="53.049790062s" totalImagesPullingTime="7.999569238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:12.047406648 +0000 UTC m=+76.993186973" watchObservedRunningTime="2026-07-24 16:07:12.049790062 +0000 UTC m=+76.995570340"
Jul 24 16:07:12.055376 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.055357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm"
Jul 24 16:07:12.079247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.076968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-rgnb8" podStartSLOduration=46.064285668 podStartE2EDuration="53.076945246s" totalImagesPullingTime="7.012659578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:12.075854308 +0000 UTC m=+77.021634607" watchObservedRunningTime="2026-07-24 16:07:12.076945246 +0000 UTC m=+77.022725525"
Jul 24 16:07:12.122311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.122134    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2b9xc" podStartSLOduration=67.681666768 podStartE2EDuration="1m16.122108565s" totalImagesPullingTime="8.440441797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:12.094948345 +0000 UTC m=+77.040728644" watchObservedRunningTime="2026-07-24 16:07:12.122108565 +0000 UTC m=+77.067888865"
Jul 24 16:07:12.122865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:12.122828    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-szsnm" podStartSLOduration=44.039667411 podStartE2EDuration="53.12281693s" totalImagesPullingTime="9.083149519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:12.120488674 +0000 UTC m=+77.066268982" watchObservedRunningTime="2026-07-24 16:07:12.12281693 +0000 UTC m=+77.068597228"
Jul 24 16:07:13.053112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.052989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lkrpt" event={"ID":"53a44290-1bcc-4162-b399-4c4712855bf9","Type":"ContainerStarted","Data":"5145c7ce7a4a802f67be91a86bab778699c4d303f349b2d12d318e8d53d3a907"}
Jul 24 16:07:13.053955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.053888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:07:13.057252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.057211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j" event={"ID":"0c43f0d9-5d66-4838-9119-d060a4ea18a2","Type":"ContainerStarted","Data":"e004bceeeb345a499ea243b14431b65543daa8bffc135f7ed86d05511e7f0a35"}
Jul 24 16:07:13.060092 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.060059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl2dn" event={"ID":"811057f4-42f1-4b2e-ad21-645420760bbf","Type":"ContainerStarted","Data":"d09651e8293e504028164aa3e618ef69c82e21394a523f6ca73578a567508fc1"}
Jul 24 16:07:13.064100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.063426    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4h4nw" event={"ID":"f6dd050c-bb36-4b36-aa9c-f972635cec1e","Type":"ContainerStarted","Data":"0bd6cbfdca52306cad7a5b3c074c2322deca4db892aa777d6d70fa4519aae8b0"}
Jul 24 16:07:13.076723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.076675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lkrpt" podStartSLOduration=36.016342157 podStartE2EDuration="43.076656111s" totalImagesPullingTime="7.060313954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.074702826 +0000 UTC m=+78.020483145" watchObservedRunningTime="2026-07-24 16:07:13.076656111 +0000 UTC m=+78.022436414"
Jul 24 16:07:13.104604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.104516    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-gvq4j" podStartSLOduration=46.142832545 podStartE2EDuration="54.104499688s" totalImagesPullingTime="7.961667143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.103192125 +0000 UTC m=+78.048972415" watchObservedRunningTime="2026-07-24 16:07:13.104499688 +0000 UTC m=+78.050279988"
Jul 24 16:07:13.125413 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:13.125215    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4h4nw" podStartSLOduration=71.061842573 podStartE2EDuration="1m18.125191842s" totalImagesPullingTime="7.063349269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:13.123776055 +0000 UTC m=+78.069556355" watchObservedRunningTime="2026-07-24 16:07:13.125191842 +0000 UTC m=+78.070972141"
Jul 24 16:07:18.086518 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.086464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6" event={"ID":"df8ec997-5980-451e-919c-bc5fc240610a","Type":"ContainerStarted","Data":"b5a237ada75e759c1f79c1e1588652993bab462566a770812aaad19ac42ee67e"}
Jul 24 16:07:18.086996 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.086553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:18.088597 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.088574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6"
Jul 24 16:07:18.088781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.088764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl2dn" event={"ID":"811057f4-42f1-4b2e-ad21-645420760bbf","Type":"ContainerStarted","Data":"9f066d6ea5e18f53684b5b18055c836362a5207f97796f7fcd4d5e25af763911"}
Jul 24 16:07:18.108051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.108002    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67976b849-v25x6" podStartSLOduration=8.013135559 podStartE2EDuration="14.107988037s" totalImagesPullingTime="6.094852478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:18.105867152 +0000 UTC m=+83.051647450" watchObservedRunningTime="2026-07-24 16:07:18.107988037 +0000 UTC m=+83.053768335"
Jul 24 16:07:18.133953 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:18.133904    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pl2dn" podStartSLOduration=17.853225057 podStartE2EDuration="37.133889035s" totalImagesPullingTime="19.280663978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:06:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:18.133439688 +0000 UTC m=+83.079220003" watchObservedRunningTime="2026-07-24 16:07:18.133889035 +0000 UTC m=+83.079669333"
Jul 24 16:07:21.075144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:21.075113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lkrpt"
Jul 24 16:07:24.973972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:24.973943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:29.848314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:29.848280    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:07:35.976077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:35.976043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2gcbb"
Jul 24 16:07:45.839582 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:45.839543    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v288l"]
Jul 24 16:07:46.011584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.011550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.016066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.016039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 16:07:46.016066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.016056    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 16:07:46.016286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.016039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 16:07:46.016286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.016039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9pb8\""
Jul 24 16:07:46.016286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.016111    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 16:07:46.119706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-wtmp\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-metrics-client-ca\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-tls\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-sys\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msm22\" (UniqueName: \"kubernetes.io/projected/1f265f40-5f1e-42f4-bacb-297c46f560ac-kube-api-access-msm22\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.119919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-root\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.120072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-textfile\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.120072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.119985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-wtmp\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-metrics-client-ca\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-tls\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-wtmp\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-sys\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msm22\" (UniqueName: \"kubernetes.io/projected/1f265f40-5f1e-42f4-bacb-297c46f560ac-kube-api-access-msm22\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-root\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-textfile\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-sys\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f265f40-5f1e-42f4-bacb-297c46f560ac-root\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-textfile\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-metrics-client-ca\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.221927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.221884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.223724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.223687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-tls\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.223791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.223767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f265f40-5f1e-42f4-bacb-297c46f560ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.230601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.230568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msm22\" (UniqueName: \"kubernetes.io/projected/1f265f40-5f1e-42f4-bacb-297c46f560ac-kube-api-access-msm22\") pod \"node-exporter-v288l\" (UID: \"1f265f40-5f1e-42f4-bacb-297c46f560ac\") " pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.321337 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:46.321305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v288l"
Jul 24 16:07:46.364657 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:07:46.364624    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f265f40_5f1e_42f4_bacb_297c46f560ac.slice/crio-6ba869d6916a04f4c132fcab8cfe4dd8e84e50048e589eaa1f3ef7c8959f82d1 WatchSource:0}: Error finding container 6ba869d6916a04f4c132fcab8cfe4dd8e84e50048e589eaa1f3ef7c8959f82d1: Status 404 returned error can't find the container with id 6ba869d6916a04f4c132fcab8cfe4dd8e84e50048e589eaa1f3ef7c8959f82d1
Jul 24 16:07:47.195938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:47.195891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v288l" event={"ID":"1f265f40-5f1e-42f4-bacb-297c46f560ac","Type":"ContainerStarted","Data":"6ba869d6916a04f4c132fcab8cfe4dd8e84e50048e589eaa1f3ef7c8959f82d1"}
Jul 24 16:07:48.200836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:48.200752    2581 generic.go:356] "Generic (PLEG): container finished" podID="1f265f40-5f1e-42f4-bacb-297c46f560ac" containerID="39022ac1b422dd890fe1d1f905d62c560c9fc440d5e76928cf7bff18814d967a" exitCode=0
Jul 24 16:07:48.201207 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:48.200841    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v288l" event={"ID":"1f265f40-5f1e-42f4-bacb-297c46f560ac","Type":"ContainerDied","Data":"39022ac1b422dd890fe1d1f905d62c560c9fc440d5e76928cf7bff18814d967a"}
Jul 24 16:07:49.206204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:49.206169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v288l" event={"ID":"1f265f40-5f1e-42f4-bacb-297c46f560ac","Type":"ContainerStarted","Data":"8b8258d8bc5c58203ab8c4ac47d1b7c2a529566815349989509898999db693e9"}
Jul 24 16:07:49.206587 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:49.206275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v288l" event={"ID":"1f265f40-5f1e-42f4-bacb-297c46f560ac","Type":"ContainerStarted","Data":"cf1caa879ed67a409581fd82c1a3297c5d68b4b4f264d84fdeb6ed23b816f92e"}
Jul 24 16:07:49.227760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:49.227710    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v288l" podStartSLOduration=2.717467306 podStartE2EDuration="4.227695147s" totalImagesPullingTime="1.398643564s" totalInitContainerRuntime="111.584277ms" isStatefulPod=true podCreationTimestamp="2026-07-24 16:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:07:49.22680289 +0000 UTC m=+114.172583187" watchObservedRunningTime="2026-07-24 16:07:49.227695147 +0000 UTC m=+114.173475444"
Jul 24 16:07:52.218913 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:52.218878    2581 generic.go:356] "Generic (PLEG): container finished" podID="59f51710-f801-48d4-8e26-4186ab4ddb71" containerID="a343d280db67bbf59a61a77687a799600bc984f1b6e8e80688a0d919aa021ae5" exitCode=0
Jul 24 16:07:52.219327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:52.218931    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t" event={"ID":"59f51710-f801-48d4-8e26-4186ab4ddb71","Type":"ContainerDied","Data":"a343d280db67bbf59a61a77687a799600bc984f1b6e8e80688a0d919aa021ae5"}
Jul 24 16:07:52.219327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:52.219219    2581 scope.go:117] "RemoveContainer" containerID="a343d280db67bbf59a61a77687a799600bc984f1b6e8e80688a0d919aa021ae5"
Jul 24 16:07:53.225056 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:53.225025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-l845t" event={"ID":"59f51710-f801-48d4-8e26-4186ab4ddb71","Type":"ContainerStarted","Data":"2d4371a75c72b48f9b9701e8c74bf176a07ffe00f15aadc80236be898568f9fb"}
Jul 24 16:07:54.867019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:54.866978    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerName="registry" containerID="cri-o://66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567" gracePeriod=30
Jul 24 16:07:54.969865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:54.969815    2581 patch_prober.go:28] interesting pod/image-registry-854fbd6c4f-k74ng container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body=
Jul 24 16:07:54.970064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:54.969877    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused"
Jul 24 16:07:55.109076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.109050    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:55.193509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193473    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5jks\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193499    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.193764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193692    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted\") pod \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\" (UID: \"d9e0dcfb-5aab-4b46-af7a-06f076209e85\") "
Jul 24 16:07:55.194025 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.193997    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:07:55.194522 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.194477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:07:55.196127 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.196090    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:07:55.196246 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.196154    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:55.196318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.196253    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks" (OuterVolumeSpecName: "kube-api-access-q5jks") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "kube-api-access-q5jks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:55.196318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.196276    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:07:55.196318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.196312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:07:55.202524 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.202501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d9e0dcfb-5aab-4b46-af7a-06f076209e85" (UID: "d9e0dcfb-5aab-4b46-af7a-06f076209e85"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:07:55.233425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.233397    2581 generic.go:356] "Generic (PLEG): container finished" podID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerID="66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567" exitCode=0
Jul 24 16:07:55.233507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.233439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng"
Jul 24 16:07:55.233507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.233456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" event={"ID":"d9e0dcfb-5aab-4b46-af7a-06f076209e85","Type":"ContainerDied","Data":"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"}
Jul 24 16:07:55.233507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.233493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854fbd6c4f-k74ng" event={"ID":"d9e0dcfb-5aab-4b46-af7a-06f076209e85","Type":"ContainerDied","Data":"45bb8b73698fce4caa8246124b3ce3cfa92f804ce88251af4513d36edace1fac"}
Jul 24 16:07:55.233604 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.233512    2581 scope.go:117] "RemoveContainer" containerID="66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"
Jul 24 16:07:55.241612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.241594    2581 scope.go:117] "RemoveContainer" containerID="66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"
Jul 24 16:07:55.241903 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:07:55.241885    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567\": container with ID starting with 66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567 not found: ID does not exist" containerID="66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"
Jul 24 16:07:55.241949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.241910    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567"} err="failed to get container status \"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567\": rpc error: code = NotFound desc = could not find container \"66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567\": container with ID starting with 66866fcbedd7e6fa764809b60b53eba8ae4fc1a58abef794e552620624b53567 not found: ID does not exist"
Jul 24 16:07:55.255753 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.255733    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:07:55.259964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.259934    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-854fbd6c4f-k74ng"]
Jul 24 16:07:55.295046 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295025    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-certificates\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295046    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-installation-pull-secrets\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295057    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-registry-tls\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295066    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d9e0dcfb-5aab-4b46-af7a-06f076209e85-ca-trust-extracted\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295074    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-bound-sa-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295082    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5jks\" (UniqueName: \"kubernetes.io/projected/d9e0dcfb-5aab-4b46-af7a-06f076209e85-kube-api-access-q5jks\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295090    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e0dcfb-5aab-4b46-af7a-06f076209e85-trusted-ca\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.295120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.295099    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d9e0dcfb-5aab-4b46-af7a-06f076209e85-image-registry-private-configuration\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:07:55.485340 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:07:55.485263    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" path="/var/lib/kubelet/pods/d9e0dcfb-5aab-4b46-af7a-06f076209e85/volumes"
Jul 24 16:08:01.261794 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:01.261757    2581 generic.go:356] "Generic (PLEG): container finished" podID="bbadbd8b-ced4-4d90-a17a-5686275f4839" containerID="6139882c60784b594879957cd7533710a2445a98c2e40ec8d07cff10d45fd2d0" exitCode=0
Jul 24 16:08:01.262200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:01.261828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9k8pw" event={"ID":"bbadbd8b-ced4-4d90-a17a-5686275f4839","Type":"ContainerDied","Data":"6139882c60784b594879957cd7533710a2445a98c2e40ec8d07cff10d45fd2d0"}
Jul 24 16:08:01.262200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:01.262184    2581 scope.go:117] "RemoveContainer" containerID="6139882c60784b594879957cd7533710a2445a98c2e40ec8d07cff10d45fd2d0"
Jul 24 16:08:02.267134 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:02.267101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9k8pw" event={"ID":"bbadbd8b-ced4-4d90-a17a-5686275f4839","Type":"ContainerStarted","Data":"597b4da6e8a6d15670a9ec54c75cc904dfbfe3f965cf642d335251373cccb012"}
Jul 24 16:08:16.323142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:16.323105    2581 generic.go:356] "Generic (PLEG): container finished" podID="d25fff1f-5047-42d0-8c93-a68bac63ec50" containerID="6453f2ab77663375ea1bbeb07dba37b508f9b819cede19909d3d95063deeae58" exitCode=0
Jul 24 16:08:16.323701 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:16.323184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm" event={"ID":"d25fff1f-5047-42d0-8c93-a68bac63ec50","Type":"ContainerDied","Data":"6453f2ab77663375ea1bbeb07dba37b508f9b819cede19909d3d95063deeae58"}
Jul 24 16:08:16.323701 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:16.323625    2581 scope.go:117] "RemoveContainer" containerID="6453f2ab77663375ea1bbeb07dba37b508f9b819cede19909d3d95063deeae58"
Jul 24 16:08:17.329949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:08:17.329917    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-cndhm" event={"ID":"d25fff1f-5047-42d0-8c93-a68bac63ec50","Type":"ContainerStarted","Data":"1a099f1e9522db540043d43e85c0830fecd17508c67627cf918e3e7cc53efedc"}
Jul 24 16:09:10.335867 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.335785    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"]
Jul 24 16:09:10.336350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.336092    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerName="registry"
Jul 24 16:09:10.336350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.336102    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerName="registry"
Jul 24 16:09:10.336350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.336150    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e0dcfb-5aab-4b46-af7a-06f076209e85" containerName="registry"
Jul 24 16:09:10.339452 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.339404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.341825 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.341804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 16:09:10.342136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.342119    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t84cz\""
Jul 24 16:09:10.342259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.342136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 16:09:10.342259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.342164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 16:09:10.342259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.342169    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 16:09:10.342819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.342802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 16:09:10.348002 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.347983    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 16:09:10.351986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.351968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"]
Jul 24 16:09:10.484353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484353 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-federate-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-serving-certs-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-metrics-client-ca\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6tg4\" (UniqueName: \"kubernetes.io/projected/1b0b6122-d5d2-48a1-b48a-9b24004a494b-kube-api-access-q6tg4\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.484739 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.484567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585619 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-serving-certs-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-metrics-client-ca\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6tg4\" (UniqueName: \"kubernetes.io/projected/1b0b6122-d5d2-48a1-b48a-9b24004a494b-kube-api-access-q6tg4\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.585829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.586135 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.586135 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.585879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-federate-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.586459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.586433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-serving-certs-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.586675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.586648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.587403 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.587379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b0b6122-d5d2-48a1-b48a-9b24004a494b-metrics-client-ca\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.588426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.588396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.588595 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.588579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-telemeter-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.588646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.588630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.588824 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.588803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1b0b6122-d5d2-48a1-b48a-9b24004a494b-federate-client-tls\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.594079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.594055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6tg4\" (UniqueName: \"kubernetes.io/projected/1b0b6122-d5d2-48a1-b48a-9b24004a494b-kube-api-access-q6tg4\") pod \"telemeter-client-5f88694c9d-8l9qt\" (UID: \"1b0b6122-d5d2-48a1-b48a-9b24004a494b\") " pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.649395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.649357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"
Jul 24 16:09:10.786516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:10.786427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f88694c9d-8l9qt"]
Jul 24 16:09:10.789096 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:09:10.789067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0b6122_d5d2_48a1_b48a_9b24004a494b.slice/crio-9613d1ef27c5a4c97ab05b22fb10e3159dd5a64fcc8c3b6c95c57af49f4f37aa WatchSource:0}: Error finding container 9613d1ef27c5a4c97ab05b22fb10e3159dd5a64fcc8c3b6c95c57af49f4f37aa: Status 404 returned error can't find the container with id 9613d1ef27c5a4c97ab05b22fb10e3159dd5a64fcc8c3b6c95c57af49f4f37aa
Jul 24 16:09:11.526407 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:11.526368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt" event={"ID":"1b0b6122-d5d2-48a1-b48a-9b24004a494b","Type":"ContainerStarted","Data":"9613d1ef27c5a4c97ab05b22fb10e3159dd5a64fcc8c3b6c95c57af49f4f37aa"}
Jul 24 16:09:13.537203 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:13.537151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt" event={"ID":"1b0b6122-d5d2-48a1-b48a-9b24004a494b","Type":"ContainerStarted","Data":"b71943d4b1fef99a429c15c10bbb7f17907a8e0c1374a72ea9710cddc4a95513"}
Jul 24 16:09:14.543028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:14.542997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt" event={"ID":"1b0b6122-d5d2-48a1-b48a-9b24004a494b","Type":"ContainerStarted","Data":"7674fc7406d796fa5756c64f0a5749d463eacea0ca4aeff8b08523e962763ece"}
Jul 24 16:09:14.543436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:14.543082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt" event={"ID":"1b0b6122-d5d2-48a1-b48a-9b24004a494b","Type":"ContainerStarted","Data":"1cb62c127b0b1805296e6fe8581978c59440a84f9e222ce68c6aaf8cec578e3d"}
Jul 24 16:09:14.572512 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:09:14.572459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f88694c9d-8l9qt" podStartSLOduration=1.522929212 podStartE2EDuration="4.572443691s" totalImagesPullingTime="3.049514479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:09:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:09:14.567153393 +0000 UTC m=+199.512933702" watchObservedRunningTime="2026-07-24 16:09:14.572443691 +0000 UTC m=+199.518223988"
Jul 24 16:10:55.380508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:10:55.380477    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:10:55.389398 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:10:55.389372    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 16:10:55.390314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:10:55.390298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:12:06.335726 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.335631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"]
Jul 24 16:12:06.338785 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.338762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.341160 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.341137    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 24 16:12:06.341305 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.341202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 24 16:12:06.341899 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.341886    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nz6ws\""
Jul 24 16:12:06.351875 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.351853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"]
Jul 24 16:12:06.369482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.369452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd5rt\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-kube-api-access-fd5rt\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.369598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.369504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.469949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.469910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd5rt\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-kube-api-access-fd5rt\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.470115 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.469958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.478355 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.478328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.478747 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.478725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd5rt\" (UniqueName: \"kubernetes.io/projected/031c7a4b-e496-406d-b5f8-18a3aaae44b5-kube-api-access-fd5rt\") pod \"cert-manager-cainjector-559cdd8c87-9xjvl\" (UID: \"031c7a4b-e496-406d-b5f8-18a3aaae44b5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.658012 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.657936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"
Jul 24 16:12:06.823528 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.823507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl"]
Jul 24 16:12:06.825752 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:06.825722    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod031c7a4b_e496_406d_b5f8_18a3aaae44b5.slice/crio-7b61eee4076f87447202c1fc9a06719779de506dccd192b2c95fb398c348a416 WatchSource:0}: Error finding container 7b61eee4076f87447202c1fc9a06719779de506dccd192b2c95fb398c348a416: Status 404 returned error can't find the container with id 7b61eee4076f87447202c1fc9a06719779de506dccd192b2c95fb398c348a416
Jul 24 16:12:06.827838 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:06.827820    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:12:07.179722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:07.179690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl" event={"ID":"031c7a4b-e496-406d-b5f8-18a3aaae44b5","Type":"ContainerStarted","Data":"7b61eee4076f87447202c1fc9a06719779de506dccd192b2c95fb398c348a416"}
Jul 24 16:12:10.194713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:10.194618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl" event={"ID":"031c7a4b-e496-406d-b5f8-18a3aaae44b5","Type":"ContainerStarted","Data":"1ac7ce83395864b5c1acaa9ac722710d9d5a31dd81e6ef62db91598c31311ccb"}
Jul 24 16:12:10.211527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:10.211474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9xjvl" podStartSLOduration=1.148348705 podStartE2EDuration="4.211460742s" totalImagesPullingTime="3.063112037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:10.210713031 +0000 UTC m=+375.156493331" watchObservedRunningTime="2026-07-24 16:12:10.211460742 +0000 UTC m=+375.157241039"
Jul 24 16:12:14.943104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:14.943073    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzk78"]
Jul 24 16:12:14.946423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:14.946406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:14.948603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:14.948582    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7bcmv\""
Jul 24 16:12:14.957410 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:14.957389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzk78"]
Jul 24 16:12:15.029519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.029486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.029692 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.029526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z88\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-kube-api-access-r8z88\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.130131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.130089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.130323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.130142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z88\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-kube-api-access-r8z88\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.139062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.139026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-bound-sa-token\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.139426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.139405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z88\" (UniqueName: \"kubernetes.io/projected/f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd-kube-api-access-r8z88\") pod \"cert-manager-55b4d954d5-qzk78\" (UID: \"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd\") " pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.255527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.255466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qzk78"
Jul 24 16:12:15.399299 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:15.399268    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qzk78"]
Jul 24 16:12:15.401551 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:15.401524    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6a7f8a5_4f64_4cf9_97b8_f41781dd13cd.slice/crio-7262fa5dc1d4aa3a29c34871ea4177524f747b67e94cee75c271a7cd3bb6e145 WatchSource:0}: Error finding container 7262fa5dc1d4aa3a29c34871ea4177524f747b67e94cee75c271a7cd3bb6e145: Status 404 returned error can't find the container with id 7262fa5dc1d4aa3a29c34871ea4177524f747b67e94cee75c271a7cd3bb6e145
Jul 24 16:12:16.218459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:16.218428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzk78" event={"ID":"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd","Type":"ContainerStarted","Data":"0c603cee01241a9fc988148dabd405d2a8711ff40a64c4b6f2f578dbd89004d5"}
Jul 24 16:12:16.218848 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:16.218468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qzk78" event={"ID":"f6a7f8a5-4f64-4cf9-97b8-f41781dd13cd","Type":"ContainerStarted","Data":"7262fa5dc1d4aa3a29c34871ea4177524f747b67e94cee75c271a7cd3bb6e145"}
Jul 24 16:12:16.237322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:16.237275    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qzk78" podStartSLOduration=2.237259201 podStartE2EDuration="2.237259201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:16.237009851 +0000 UTC m=+381.182790150" watchObservedRunningTime="2026-07-24 16:12:16.237259201 +0000 UTC m=+381.183039499"
Jul 24 16:12:36.867890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.867855    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"]
Jul 24 16:12:36.873323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.873306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:36.877042 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.877014    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 16:12:36.878181 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.878151    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zw9nh\""
Jul 24 16:12:36.878309 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.878159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 16:12:36.878309 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.878217    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 16:12:36.879100 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.879085    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 16:12:36.899792 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.899767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"]
Jul 24 16:12:36.902326 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.902304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:36.902428 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.902337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:36.902428 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.902363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5ln\" (UniqueName: \"kubernetes.io/projected/2b81cdea-80c4-4b5c-a6d0-166eba27139f-kube-api-access-8f5ln\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:36.902515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.902461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:36.902571 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:36.902518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.003501 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.003464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.003689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.003524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.003689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.003543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.003689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.003559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5ln\" (UniqueName: \"kubernetes.io/projected/2b81cdea-80c4-4b5c-a6d0-166eba27139f-kube-api-access-8f5ln\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.003689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.003586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.004028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.004000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-manifests\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.005825 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.005803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b81cdea-80c4-4b5c-a6d0-166eba27139f-tmp\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.005942 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.005904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.006094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.006073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b81cdea-80c4-4b5c-a6d0-166eba27139f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.012631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.012608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5ln\" (UniqueName: \"kubernetes.io/projected/2b81cdea-80c4-4b5c-a6d0-166eba27139f-kube-api-access-8f5ln\") pod \"opendatahub-operator-controller-manager-5d6c795b6-9sk74\" (UID: \"2b81cdea-80c4-4b5c-a6d0-166eba27139f\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.184754 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.184656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:37.328802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:37.328777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"]
Jul 24 16:12:37.331518 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:37.331487    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b81cdea_80c4_4b5c_a6d0_166eba27139f.slice/crio-0acfa850ea5b90bdc93f16dde1af61b52ec7bb47d01ba5416df7e9b78a365fab WatchSource:0}: Error finding container 0acfa850ea5b90bdc93f16dde1af61b52ec7bb47d01ba5416df7e9b78a365fab: Status 404 returned error can't find the container with id 0acfa850ea5b90bdc93f16dde1af61b52ec7bb47d01ba5416df7e9b78a365fab
Jul 24 16:12:38.305157 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:38.305123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74" event={"ID":"2b81cdea-80c4-4b5c-a6d0-166eba27139f","Type":"ContainerStarted","Data":"0acfa850ea5b90bdc93f16dde1af61b52ec7bb47d01ba5416df7e9b78a365fab"}
Jul 24 16:12:41.320414 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:41.320376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74" event={"ID":"2b81cdea-80c4-4b5c-a6d0-166eba27139f","Type":"ContainerStarted","Data":"fcce9ba7129ef28a165d1ed3ae3a470c15d76c0939c8cbc2798a74b411851d61"}
Jul 24 16:12:42.325515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:42.325475    2581 generic.go:356] "Generic (PLEG): container finished" podID="2b81cdea-80c4-4b5c-a6d0-166eba27139f" containerID="fcce9ba7129ef28a165d1ed3ae3a470c15d76c0939c8cbc2798a74b411851d61" exitCode=0
Jul 24 16:12:42.325889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:42.325557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74" event={"ID":"2b81cdea-80c4-4b5c-a6d0-166eba27139f","Type":"ContainerDied","Data":"fcce9ba7129ef28a165d1ed3ae3a470c15d76c0939c8cbc2798a74b411851d61"}
Jul 24 16:12:43.332017 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:43.331981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74" event={"ID":"2b81cdea-80c4-4b5c-a6d0-166eba27139f","Type":"ContainerStarted","Data":"3d3e308ca307bc42313906800650aea0d0408f0ab9ef7c3b69bb53bd19e4f985"}
Jul 24 16:12:43.332466 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:43.332054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:43.359389 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:43.359340    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74" podStartSLOduration=2.92549605 podStartE2EDuration="7.359324473s" totalImagesPullingTime="3.364107042s" totalInitContainerRuntime="1.069721381s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:12:43.358186536 +0000 UTC m=+408.303966852" watchObservedRunningTime="2026-07-24 16:12:43.359324473 +0000 UTC m=+408.305104771"
Jul 24 16:12:54.338521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:54.338487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6c795b6-9sk74"
Jul 24 16:12:57.653837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.653808    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"]
Jul 24 16:12:57.658622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.658605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.666034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.665897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 16:12:57.666034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.665948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 16:12:57.666034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.665962    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sqhqs\""
Jul 24 16:12:57.670799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.670774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"]
Jul 24 16:12:57.795437 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.795402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae79aced-a77f-4df3-9870-afaaa9a063dc-tls-certs\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.795437 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.795441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct25d\" (UniqueName: \"kubernetes.io/projected/ae79aced-a77f-4df3-9870-afaaa9a063dc-kube-api-access-ct25d\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.795687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.795559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae79aced-a77f-4df3-9870-afaaa9a063dc-tmp\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.896613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.896571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae79aced-a77f-4df3-9870-afaaa9a063dc-tls-certs\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.896613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.896613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct25d\" (UniqueName: \"kubernetes.io/projected/ae79aced-a77f-4df3-9870-afaaa9a063dc-kube-api-access-ct25d\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.896838 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.896670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae79aced-a77f-4df3-9870-afaaa9a063dc-tmp\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.898903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.898878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae79aced-a77f-4df3-9870-afaaa9a063dc-tmp\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.899161 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.899140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae79aced-a77f-4df3-9870-afaaa9a063dc-tls-certs\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.939943 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.939878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct25d\" (UniqueName: \"kubernetes.io/projected/ae79aced-a77f-4df3-9870-afaaa9a063dc-kube-api-access-ct25d\") pod \"kube-auth-proxy-cd59bb69-qg8hj\" (UID: \"ae79aced-a77f-4df3-9870-afaaa9a063dc\") " pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:57.945635 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.945610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v9rwg"]
Jul 24 16:12:57.949161 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.949145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:57.953869 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.953852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ws8qj\""
Jul 24 16:12:57.954071 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.954040    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 16:12:57.963331 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.963308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v9rwg"]
Jul 24 16:12:57.969316 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:57.969299    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"
Jul 24 16:12:58.098686 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.098655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.098880 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.098739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7h8v\" (UniqueName: \"kubernetes.io/projected/8b55df44-5868-4c2d-845a-c5c43770fdfd-kube-api-access-p7h8v\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.100112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.100093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj"]
Jul 24 16:12:58.101764 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:58.101738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae79aced_a77f_4df3_9870_afaaa9a063dc.slice/crio-a715bfc8f42cdc6dd7a20fccb00a3962e3affe6dfdfe87c3ce17590a1c330493 WatchSource:0}: Error finding container a715bfc8f42cdc6dd7a20fccb00a3962e3affe6dfdfe87c3ce17590a1c330493: Status 404 returned error can't find the container with id a715bfc8f42cdc6dd7a20fccb00a3962e3affe6dfdfe87c3ce17590a1c330493
Jul 24 16:12:58.199802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.199723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.199802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.199769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7h8v\" (UniqueName: \"kubernetes.io/projected/8b55df44-5868-4c2d-845a-c5c43770fdfd-kube-api-access-p7h8v\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.199982 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:12:58.199883    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 16:12:58.199982 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:12:58.199947    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert podName:8b55df44-5868-4c2d-845a-c5c43770fdfd nodeName:}" failed. No retries permitted until 2026-07-24 16:12:58.699928293 +0000 UTC m=+423.645708569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert") pod "odh-model-controller-7998c67dc4-v9rwg" (UID: "8b55df44-5868-4c2d-845a-c5c43770fdfd") : secret "odh-model-controller-webhook-cert" not found
Jul 24 16:12:58.209592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.209570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7h8v\" (UniqueName: \"kubernetes.io/projected/8b55df44-5868-4c2d-845a-c5c43770fdfd-kube-api-access-p7h8v\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.402673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.402640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj" event={"ID":"ae79aced-a77f-4df3-9870-afaaa9a063dc","Type":"ContainerStarted","Data":"a715bfc8f42cdc6dd7a20fccb00a3962e3affe6dfdfe87c3ce17590a1c330493"}
Jul 24 16:12:58.705194 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.705152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.707584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.707563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b55df44-5868-4c2d-845a-c5c43770fdfd-cert\") pod \"odh-model-controller-7998c67dc4-v9rwg\" (UID: \"8b55df44-5868-4c2d-845a-c5c43770fdfd\") " pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:58.858833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:58.858796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:12:59.039317 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.039286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-v9rwg"]
Jul 24 16:12:59.043996 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:59.043944    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b55df44_5868_4c2d_845a_c5c43770fdfd.slice/crio-92f780b0d737541e0a9bfc9a0eac3e34becdfedcb9b1553462c1219d3a7d685b WatchSource:0}: Error finding container 92f780b0d737541e0a9bfc9a0eac3e34becdfedcb9b1553462c1219d3a7d685b: Status 404 returned error can't find the container with id 92f780b0d737541e0a9bfc9a0eac3e34becdfedcb9b1553462c1219d3a7d685b
Jul 24 16:12:59.197781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.197745    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lxjvm"]
Jul 24 16:12:59.202018 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.201999    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.207569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.207546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-f22nw\""
Jul 24 16:12:59.210086 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.210067    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 16:12:59.216544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.216521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lxjvm"]
Jul 24 16:12:59.310626 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.310578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3551fa5a-2b86-418e-9175-d972b3382a93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.310794 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.310737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtp8\" (UniqueName: \"kubernetes.io/projected/3551fa5a-2b86-418e-9175-d972b3382a93-kube-api-access-bqtp8\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.387631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.387595    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:12:59.390877 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.390862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.395898 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.395876    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 24 16:12:59.396248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.396202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 24 16:12:59.396393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.396378    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 16:12:59.396908 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.396893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 24 16:12:59.396970 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.396932    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n4tl4\""
Jul 24 16:12:59.409463 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.409432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg" event={"ID":"8b55df44-5868-4c2d-845a-c5c43770fdfd","Type":"ContainerStarted","Data":"92f780b0d737541e0a9bfc9a0eac3e34becdfedcb9b1553462c1219d3a7d685b"}
Jul 24 16:12:59.411917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.411886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtp8\" (UniqueName: \"kubernetes.io/projected/3551fa5a-2b86-418e-9175-d972b3382a93-kube-api-access-bqtp8\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.412029 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.411946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3551fa5a-2b86-418e-9175-d972b3382a93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.413994 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.413971    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:12:59.415091 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.415070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3551fa5a-2b86-418e-9175-d972b3382a93-tls-certs\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.443182 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.443155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtp8\" (UniqueName: \"kubernetes.io/projected/3551fa5a-2b86-418e-9175-d972b3382a93-kube-api-access-bqtp8\") pod \"model-serving-api-54d89bd5fc-lxjvm\" (UID: \"3551fa5a-2b86-418e-9175-d972b3382a93\") " pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.512191 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:12:59.512390 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.512727 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.512700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2297j\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.613750 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.613909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.613909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.613909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.613909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.614116 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2297j\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.614116 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.613967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.614432 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.614413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.616881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.616854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.617572 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.617548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.617969 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.617921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.619139 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.619095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.633442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.633422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2297j\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.634082 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.634060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zr6cl\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.655469 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.655442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lxjvm"]
Jul 24 16:12:59.699504 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.699472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:12:59.878465 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:12:59.878431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:12:59.882746 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:12:59.882709    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81182ff8_b300_4ba1_a220_ca4fb79ec859.slice/crio-87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c WatchSource:0}: Error finding container 87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c: Status 404 returned error can't find the container with id 87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c
Jul 24 16:13:00.419912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:00.419827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" event={"ID":"81182ff8-b300-4ba1-a220-ca4fb79ec859","Type":"ContainerStarted","Data":"87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c"}
Jul 24 16:13:00.421662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:00.421551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm" event={"ID":"3551fa5a-2b86-418e-9175-d972b3382a93","Type":"ContainerStarted","Data":"1d3d33153b39d3997ff6c14fb874ee686e6dfaf61b07746929d3f0e2db31c876"}
Jul 24 16:13:03.905660 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:03.905618    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:13:03.906040 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:03.905693    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:13:04.444293 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.444254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg" event={"ID":"8b55df44-5868-4c2d-845a-c5c43770fdfd","Type":"ContainerStarted","Data":"717ead039ae6bf058c71fa0631b6cc7b96da9b0c500e75515108e72cfa36cdca"}
Jul 24 16:13:04.444499 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.444373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:13:04.445819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.445795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj" event={"ID":"ae79aced-a77f-4df3-9870-afaaa9a063dc","Type":"ContainerStarted","Data":"49c913e6571752b1285acda2fe37900e4db406dd2990bfa192451758095a8669"}
Jul 24 16:13:04.447426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.447397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" event={"ID":"81182ff8-b300-4ba1-a220-ca4fb79ec859","Type":"ContainerStarted","Data":"072aaf88f58989376f8b54bfd0197d343d9cbcbc9372d3337fc6401bf31d48f2"}
Jul 24 16:13:04.447603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.447585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:13:04.448971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.448953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm" event={"ID":"3551fa5a-2b86-418e-9175-d972b3382a93","Type":"ContainerStarted","Data":"b3d315ff6b8d6e2d0df88fc00875e7416ad6855189cc866fc4a843d88c21f794"}
Jul 24 16:13:04.449126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.449108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:13:04.449560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.449536    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zr6cl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:13:04.449634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.449587    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:13:04.467504 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.467463    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg" podStartSLOduration=2.617979031 podStartE2EDuration="7.467450904s" totalImagesPullingTime="4.849471873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:04.46563981 +0000 UTC m=+429.411420108" watchObservedRunningTime="2026-07-24 16:13:04.467450904 +0000 UTC m=+429.413231235"
Jul 24 16:13:04.505865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.505820    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm" podStartSLOduration=1.325118524 podStartE2EDuration="5.505807294s" totalImagesPullingTime="4.18068877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:04.505388529 +0000 UTC m=+429.451168828" watchObservedRunningTime="2026-07-24 16:13:04.505807294 +0000 UTC m=+429.451587589"
Jul 24 16:13:04.532276 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.532212    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" podStartSLOduration=1.512242481 podStartE2EDuration="5.532196076s" totalImagesPullingTime="4.019953595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:04.530695717 +0000 UTC m=+429.476476014" watchObservedRunningTime="2026-07-24 16:13:04.532196076 +0000 UTC m=+429.477976375"
Jul 24 16:13:04.557204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:04.557156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cd59bb69-qg8hj" podStartSLOduration=1.817669778 podStartE2EDuration="7.557137793s" totalImagesPullingTime="5.739468015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:04.554267501 +0000 UTC m=+429.500047798" watchObservedRunningTime="2026-07-24 16:13:04.557137793 +0000 UTC m=+429.502918090"
Jul 24 16:13:05.454688 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.454655    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zr6cl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:13:05.455053 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.454711    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:13:05.868741 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.868707    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"]
Jul 24 16:13:05.872309 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.872289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.874917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.874892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jmh8k\""
Jul 24 16:13:05.888292 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.888271    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"]
Jul 24 16:13:05.973135 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973135 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:05.973595 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:05.973424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwn2n\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-kube-api-access-fwn2n\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074090 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074090 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwn2n\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-kube-api-access-fwn2n\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.074946 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.074873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.075080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.075057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.076712 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.076690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.076838 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.076816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.097277 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.097251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.098067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.098047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwn2n\" (UniqueName: \"kubernetes.io/projected/27fd22a2-1c57-4275-97d1-7ecb7a4d1835-kube-api-access-fwn2n\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8\" (UID: \"27fd22a2-1c57-4275-97d1-7ecb7a4d1835\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.184200 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.184113    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:06.338216 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.338188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"]
Jul 24 16:13:06.339873 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:13:06.339850    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fd22a2_1c57_4275_97d1_7ecb7a4d1835.slice/crio-f0549dde09a9cc1baa0fcd0971084fce671c1cf9b2b4c01485878b99a5eea050 WatchSource:0}: Error finding container f0549dde09a9cc1baa0fcd0971084fce671c1cf9b2b4c01485878b99a5eea050: Status 404 returned error can't find the container with id f0549dde09a9cc1baa0fcd0971084fce671c1cf9b2b4c01485878b99a5eea050
Jul 24 16:13:06.459774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:06.459702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8" event={"ID":"27fd22a2-1c57-4275-97d1-7ecb7a4d1835","Type":"ContainerStarted","Data":"f0549dde09a9cc1baa0fcd0971084fce671c1cf9b2b4c01485878b99a5eea050"}
Jul 24 16:13:08.454974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:08.454937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:13:08.713640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:08.713606    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:13:08.713745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:08.713677    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:13:08.713745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:08.713705    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:13:09.363492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.363460    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86frx"]
Jul 24 16:13:09.366732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.366710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.369530 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.369510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 24 16:13:09.369748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.369730    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9vcfz\""
Jul 24 16:13:09.380234 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.380200    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"]
Jul 24 16:13:09.386754 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.384747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.389184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.389158    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hg9dq\""
Jul 24 16:13:09.389380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.389360    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 24 16:13:09.392458 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.392439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86frx"]
Jul 24 16:13:09.406680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.406656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.406799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.406693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2pm\" (UniqueName: \"kubernetes.io/projected/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-kube-api-access-2n2pm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.406799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.406774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31212062-6d64-4685-ac04-639fde0c55c9-cert\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.406889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.406798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9lcm\" (UniqueName: \"kubernetes.io/projected/31212062-6d64-4685-ac04-639fde0c55c9-kube-api-access-j9lcm\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.429055 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.429026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"]
Jul 24 16:13:09.475886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.475852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8" event={"ID":"27fd22a2-1c57-4275-97d1-7ecb7a4d1835","Type":"ContainerStarted","Data":"fcc64fcc39057840840d883a00f5f5160e69940fe9b5673c9373edd4c3d3bc47"}
Jul 24 16:13:09.507806 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.507775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.507806 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.507808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2pm\" (UniqueName: \"kubernetes.io/projected/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-kube-api-access-2n2pm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.508043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.507874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31212062-6d64-4685-ac04-639fde0c55c9-cert\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.508043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.507898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9lcm\" (UniqueName: \"kubernetes.io/projected/31212062-6d64-4685-ac04-639fde0c55c9-kube-api-access-j9lcm\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.508043 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:13:09.507907    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 24 16:13:09.508043 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:13:09.507970    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert podName:4e06dd05-0382-4f6e-a9ef-bdae47fd7812 nodeName:}" failed. No retries permitted until 2026-07-24 16:13:10.007950719 +0000 UTC m=+434.953731003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert") pod "llmisvc-controller-manager-777c6bd7d5-f5pqp" (UID: "4e06dd05-0382-4f6e-a9ef-bdae47fd7812") : secret "llmisvc-webhook-server-cert" not found
Jul 24 16:13:09.511107 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.511083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31212062-6d64-4685-ac04-639fde0c55c9-cert\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.523102 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.523053    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8" podStartSLOduration=2.15151559 podStartE2EDuration="4.523034859s" totalImagesPullingTime="2.371519269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:09.521819316 +0000 UTC m=+434.467599626" watchObservedRunningTime="2026-07-24 16:13:09.523034859 +0000 UTC m=+434.468815157"
Jul 24 16:13:09.526692 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.526671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2pm\" (UniqueName: \"kubernetes.io/projected/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-kube-api-access-2n2pm\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:09.543793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.543770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9lcm\" (UniqueName: \"kubernetes.io/projected/31212062-6d64-4685-ac04-639fde0c55c9-kube-api-access-j9lcm\") pod \"kserve-controller-manager-d6f4b65b8-86frx\" (UID: \"31212062-6d64-4685-ac04-639fde0c55c9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.679186 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.679083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:09.863150 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:09.863016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-86frx"]
Jul 24 16:13:09.865626 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:13:09.865596    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31212062_6d64_4685_ac04_639fde0c55c9.slice/crio-24ee7714c767a602edd1fd61edf1688d4410e205082509fdb4c4e77c01ddc679 WatchSource:0}: Error finding container 24ee7714c767a602edd1fd61edf1688d4410e205082509fdb4c4e77c01ddc679: Status 404 returned error can't find the container with id 24ee7714c767a602edd1fd61edf1688d4410e205082509fdb4c4e77c01ddc679
Jul 24 16:13:10.012320 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.012293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:10.014580 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.014563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e06dd05-0382-4f6e-a9ef-bdae47fd7812-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f5pqp\" (UID: \"4e06dd05-0382-4f6e-a9ef-bdae47fd7812\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:10.185156 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.185121    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:10.189713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.189690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:10.296893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.296807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:10.474263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.474198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"]
Jul 24 16:13:10.478676 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:13:10.478652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e06dd05_0382_4f6e_a9ef_bdae47fd7812.slice/crio-fd053ae5c2e6a9715f84ffecbbbc71ed8c6bdc3264b5d8db067fe76c882c74c7 WatchSource:0}: Error finding container fd053ae5c2e6a9715f84ffecbbbc71ed8c6bdc3264b5d8db067fe76c882c74c7: Status 404 returned error can't find the container with id fd053ae5c2e6a9715f84ffecbbbc71ed8c6bdc3264b5d8db067fe76c882c74c7
Jul 24 16:13:10.482584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.482563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx" event={"ID":"31212062-6d64-4685-ac04-639fde0c55c9","Type":"ContainerStarted","Data":"24ee7714c767a602edd1fd61edf1688d4410e205082509fdb4c4e77c01ddc679"}
Jul 24 16:13:10.482882 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.482863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:10.483733 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:10.483716    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8"
Jul 24 16:13:11.161348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.161313    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:13:11.161542 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.161520    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery" containerID="cri-o://072aaf88f58989376f8b54bfd0197d343d9cbcbc9372d3337fc6401bf31d48f2" gracePeriod=30
Jul 24 16:13:11.489445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.489417    2581 generic.go:356] "Generic (PLEG): container finished" podID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerID="072aaf88f58989376f8b54bfd0197d343d9cbcbc9372d3337fc6401bf31d48f2" exitCode=0
Jul 24 16:13:11.489820 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.489489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" event={"ID":"81182ff8-b300-4ba1-a220-ca4fb79ec859","Type":"ContainerDied","Data":"072aaf88f58989376f8b54bfd0197d343d9cbcbc9372d3337fc6401bf31d48f2"}
Jul 24 16:13:11.489820 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.489544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" event={"ID":"81182ff8-b300-4ba1-a220-ca4fb79ec859","Type":"ContainerDied","Data":"87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c"}
Jul 24 16:13:11.489820 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.489570    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87a85959fde8a74d41a506ca0414d8db0cede1482cf8c8a86aa80b13d49fae6c"
Jul 24 16:13:11.490826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.490804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp" event={"ID":"4e06dd05-0382-4f6e-a9ef-bdae47fd7812","Type":"ContainerStarted","Data":"fd053ae5c2e6a9715f84ffecbbbc71ed8c6bdc3264b5d8db067fe76c882c74c7"}
Jul 24 16:13:11.494706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.494687    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:13:11.525509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525485    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.525627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.525627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.525627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525606    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.525795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.525795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.526035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.525987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2297j\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j\") pod \"81182ff8-b300-4ba1-a220-ca4fb79ec859\" (UID: \"81182ff8-b300-4ba1-a220-ca4fb79ec859\") "
Jul 24 16:13:11.526410 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.526327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:13:11.527264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.526493    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-ca-configmap\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.529258 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.529205    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:13:11.529841 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.529596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j" (OuterVolumeSpecName: "kube-api-access-2297j") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "kube-api-access-2297j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:13:11.530327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.530279    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs" (OuterVolumeSpecName: "local-certs") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:13:11.530653 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.530519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:13:11.530725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.530680    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts" (OuterVolumeSpecName: "cacerts") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:13:11.530985 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.530960    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token" (OuterVolumeSpecName: "istio-token") pod "81182ff8-b300-4ba1-a220-ca4fb79ec859" (UID: "81182ff8-b300-4ba1-a220-ca4fb79ec859"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:13:11.627597 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627558    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2297j\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-kube-api-access-2297j\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.627597 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627597    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/81182ff8-b300-4ba1-a220-ca4fb79ec859-local-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.627826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627614    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-csr-dns-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.627826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627627    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-cacerts\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.627826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627641    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:11.627826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:11.627655    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81182ff8-b300-4ba1-a220-ca4fb79ec859-istio-kubeconfig\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:13:12.495578 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:12.495540    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"
Jul 24 16:13:12.558632 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:12.558579    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:13:12.566079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:12.566052    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl"]
Jul 24 16:13:13.487115 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:13.487079    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" path="/var/lib/kubelet/pods/81182ff8-b300-4ba1-a220-ca4fb79ec859/volumes"
Jul 24 16:13:13.501811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:13.501775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx" event={"ID":"31212062-6d64-4685-ac04-639fde0c55c9","Type":"ContainerStarted","Data":"f42b14c2ffc41b3058d2ecec0f55f600d6f682f3ac37f55d8b92c672f6bb7c04"}
Jul 24 16:13:13.502294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:13.502023    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:14.507913 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:14.507809    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp" event={"ID":"4e06dd05-0382-4f6e-a9ef-bdae47fd7812","Type":"ContainerStarted","Data":"3710162c99a498fa6d982067bd68d36a3ff581eb99e76d43af95d5581090d765"}
Jul 24 16:13:14.529818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:14.529766    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx" podStartSLOduration=2.751069862 podStartE2EDuration="5.529752044s" totalImagesPullingTime="2.778682182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:13.551986963 +0000 UTC m=+438.497767261" watchObservedRunningTime="2026-07-24 16:13:14.529752044 +0000 UTC m=+439.475532342"
Jul 24 16:13:14.530038 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:14.530017    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp" podStartSLOduration=1.826681754 podStartE2EDuration="5.530009131s" totalImagesPullingTime="3.703327377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:13:14.527779242 +0000 UTC m=+439.473559540" watchObservedRunningTime="2026-07-24 16:13:14.530009131 +0000 UTC m=+439.475789429"
Jul 24 16:13:15.459752 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:15.459720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lxjvm"
Jul 24 16:13:15.490565 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:15.490535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-v9rwg"
Jul 24 16:13:15.513787 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:15.513756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:16.454468 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:16.454428    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zr6cl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:13:16.454640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:16.454513    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zr6cl" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:13:44.513809 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:44.513778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-86frx"
Jul 24 16:13:46.520645 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:46.520615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f5pqp"
Jul 24 16:13:58.268316 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.268285    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:13:58.268709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.268623    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery"
Jul 24 16:13:58.268709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.268634    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery"
Jul 24 16:13:58.268709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.268690    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="81182ff8-b300-4ba1-a220-ca4fb79ec859" containerName="discovery"
Jul 24 16:13:58.271668 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.271651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:13:58.274208 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.274182    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 16:13:58.274348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.274181    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 16:13:58.275036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.275017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rxmbx\""
Jul 24 16:13:58.282245 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.282200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:13:58.333594 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.333568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7khs\" (UniqueName: \"kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs\") pod \"kuadrant-operator-catalog-6wqxk\" (UID: \"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3\") " pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:13:58.434205 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.434166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7khs\" (UniqueName: \"kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs\") pod \"kuadrant-operator-catalog-6wqxk\" (UID: \"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3\") " pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:13:58.446642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.446612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7khs\" (UniqueName: \"kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs\") pod \"kuadrant-operator-catalog-6wqxk\" (UID: \"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3\") " pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:13:58.580977 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.580895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:13:58.619197 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.619154    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:13:58.715700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.715670    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:13:58.719786 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:13:58.719752    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da5b40a_85f0_4fcf_af38_9bfbd8fe89a3.slice/crio-7f04c9946bec9db6fe77c5c0f7f1510049b656e7b10bc74167490c0b6285b155 WatchSource:0}: Error finding container 7f04c9946bec9db6fe77c5c0f7f1510049b656e7b10bc74167490c0b6285b155: Status 404 returned error can't find the container with id 7f04c9946bec9db6fe77c5c0f7f1510049b656e7b10bc74167490c0b6285b155
Jul 24 16:13:58.848639 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.848559    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr4xt"]
Jul 24 16:13:58.852944 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.852927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:13:58.874350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.874321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr4xt"]
Jul 24 16:13:58.939647 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:58.939607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzsr7\" (UniqueName: \"kubernetes.io/projected/c01ade6c-4543-42fe-82e5-4a7bb3aec996-kube-api-access-dzsr7\") pod \"kuadrant-operator-catalog-cr4xt\" (UID: \"c01ade6c-4543-42fe-82e5-4a7bb3aec996\") " pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:13:59.040811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.040776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzsr7\" (UniqueName: \"kubernetes.io/projected/c01ade6c-4543-42fe-82e5-4a7bb3aec996-kube-api-access-dzsr7\") pod \"kuadrant-operator-catalog-cr4xt\" (UID: \"c01ade6c-4543-42fe-82e5-4a7bb3aec996\") " pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:13:59.049546 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.049524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzsr7\" (UniqueName: \"kubernetes.io/projected/c01ade6c-4543-42fe-82e5-4a7bb3aec996-kube-api-access-dzsr7\") pod \"kuadrant-operator-catalog-cr4xt\" (UID: \"c01ade6c-4543-42fe-82e5-4a7bb3aec996\") " pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:13:59.162846 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.162742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:13:59.301854 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.301827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cr4xt"]
Jul 24 16:13:59.302164 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:13:59.301823    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01ade6c_4543_42fe_82e5_4a7bb3aec996.slice/crio-a78c6d82f7b86e38d19c3cba02792d8943c64432e83172b7ca0e85c92c5a322e WatchSource:0}: Error finding container a78c6d82f7b86e38d19c3cba02792d8943c64432e83172b7ca0e85c92c5a322e: Status 404 returned error can't find the container with id a78c6d82f7b86e38d19c3cba02792d8943c64432e83172b7ca0e85c92c5a322e
Jul 24 16:13:59.715996 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.715958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" event={"ID":"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3","Type":"ContainerStarted","Data":"7f04c9946bec9db6fe77c5c0f7f1510049b656e7b10bc74167490c0b6285b155"}
Jul 24 16:13:59.717473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:13:59.717434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt" event={"ID":"c01ade6c-4543-42fe-82e5-4a7bb3aec996","Type":"ContainerStarted","Data":"a78c6d82f7b86e38d19c3cba02792d8943c64432e83172b7ca0e85c92c5a322e"}
Jul 24 16:14:01.728484 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.728444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" event={"ID":"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3","Type":"ContainerStarted","Data":"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"}
Jul 24 16:14:01.728960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.728501    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" podUID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" containerName="registry-server" containerID="cri-o://8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3" gracePeriod=2
Jul 24 16:14:01.730082 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.730057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt" event={"ID":"c01ade6c-4543-42fe-82e5-4a7bb3aec996","Type":"ContainerStarted","Data":"1bf18f693442cec8bbe1ca698c62a8b6552f0ca7594e6e6278d5709b03c4c582"}
Jul 24 16:14:01.749054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.749011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" podStartSLOduration=1.693074743 podStartE2EDuration="3.748998201s" totalImagesPullingTime="2.055923458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:01.747183889 +0000 UTC m=+486.692964188" watchObservedRunningTime="2026-07-24 16:14:01.748998201 +0000 UTC m=+486.694778496"
Jul 24 16:14:01.771488 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.771450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt" podStartSLOduration=2.2984457320000002 podStartE2EDuration="3.77143574s" totalImagesPullingTime="1.472990008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:01.771103192 +0000 UTC m=+486.716883490" watchObservedRunningTime="2026-07-24 16:14:01.77143574 +0000 UTC m=+486.717216038"
Jul 24 16:14:01.973402 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:01.973372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:14:02.067820 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.067785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7khs\" (UniqueName: \"kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs\") pod \"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3\" (UID: \"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3\") "
Jul 24 16:14:02.069901 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.069876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs" (OuterVolumeSpecName: "kube-api-access-b7khs") pod "9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" (UID: "9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3"). InnerVolumeSpecName "kube-api-access-b7khs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:02.168984 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.168955    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7khs\" (UniqueName: \"kubernetes.io/projected/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3-kube-api-access-b7khs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:14:02.736668 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.736636    2581 generic.go:356] "Generic (PLEG): container finished" podID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" containerID="8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3" exitCode=0
Jul 24 16:14:02.737146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.736678    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk"
Jul 24 16:14:02.737146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.736730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" event={"ID":"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3","Type":"ContainerDied","Data":"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"}
Jul 24 16:14:02.737146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.736788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6wqxk" event={"ID":"9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3","Type":"ContainerDied","Data":"7f04c9946bec9db6fe77c5c0f7f1510049b656e7b10bc74167490c0b6285b155"}
Jul 24 16:14:02.737146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.736820    2581 scope.go:117] "RemoveContainer" containerID="8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"
Jul 24 16:14:02.746517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.746501    2581 scope.go:117] "RemoveContainer" containerID="8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"
Jul 24 16:14:02.746789 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:02.746769    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3\": container with ID starting with 8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3 not found: ID does not exist" containerID="8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"
Jul 24 16:14:02.746840 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.746798    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3"} err="failed to get container status \"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3\": rpc error: code = NotFound desc = could not find container \"8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3\": container with ID starting with 8346b7ca2e75fa127b423b00ec15f2b4992a506fb7420866c8f93c28cde94be3 not found: ID does not exist"
Jul 24 16:14:02.761219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.761195    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:14:02.767730 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:02.767708    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6wqxk"]
Jul 24 16:14:03.486779 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:03.486749    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" path="/var/lib/kubelet/pods/9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3/volumes"
Jul 24 16:14:09.163865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:09.163826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:14:09.164479 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:09.163905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:14:09.186658 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:09.186627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:14:09.796977 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:09.796953    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cr4xt"
Jul 24 16:14:32.512064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.512030    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"]
Jul 24 16:14:32.512680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.512649    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" containerName="registry-server"
Jul 24 16:14:32.512680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.512670    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" containerName="registry-server"
Jul 24 16:14:32.512795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.512756    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da5b40a-85f0-4fcf-af38-9bfbd8fe89a3" containerName="registry-server"
Jul 24 16:14:32.515851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.515832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:32.518621 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.518600    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ktjkd\""
Jul 24 16:14:32.528131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.528111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"]
Jul 24 16:14:32.618861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.618831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzdd\" (UniqueName: \"kubernetes.io/projected/286aae4e-2cad-46d9-a2f6-e722de9b0819-kube-api-access-wgzdd\") pod \"authorino-operator-75cc8d5cb7-8mm8k\" (UID: \"286aae4e-2cad-46d9-a2f6-e722de9b0819\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:32.719717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.719690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzdd\" (UniqueName: \"kubernetes.io/projected/286aae4e-2cad-46d9-a2f6-e722de9b0819-kube-api-access-wgzdd\") pod \"authorino-operator-75cc8d5cb7-8mm8k\" (UID: \"286aae4e-2cad-46d9-a2f6-e722de9b0819\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:32.757947 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.757922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzdd\" (UniqueName: \"kubernetes.io/projected/286aae4e-2cad-46d9-a2f6-e722de9b0819-kube-api-access-wgzdd\") pod \"authorino-operator-75cc8d5cb7-8mm8k\" (UID: \"286aae4e-2cad-46d9-a2f6-e722de9b0819\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:32.825915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.825841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:32.999255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:32.999201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"]
Jul 24 16:14:33.000388 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:33.000365    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286aae4e_2cad_46d9_a2f6_e722de9b0819.slice/crio-06751e5e411ad5cf04257e91ff08ca765b1d698d04d1ce5d73d9f09891e4f750 WatchSource:0}: Error finding container 06751e5e411ad5cf04257e91ff08ca765b1d698d04d1ce5d73d9f09891e4f750: Status 404 returned error can't find the container with id 06751e5e411ad5cf04257e91ff08ca765b1d698d04d1ce5d73d9f09891e4f750
Jul 24 16:14:33.893654 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:33.893620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k" event={"ID":"286aae4e-2cad-46d9-a2f6-e722de9b0819","Type":"ContainerStarted","Data":"06751e5e411ad5cf04257e91ff08ca765b1d698d04d1ce5d73d9f09891e4f750"}
Jul 24 16:14:35.905133 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:35.905096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k" event={"ID":"286aae4e-2cad-46d9-a2f6-e722de9b0819","Type":"ContainerStarted","Data":"ca7c71a664be8b04bdee77240a598719e329bd9ea16a7542ea9decbbfba83442"}
Jul 24 16:14:35.905555 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:35.905183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:35.931501 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:35.931450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k" podStartSLOduration=1.6862774919999999 podStartE2EDuration="3.931434614s" totalImagesPullingTime="2.245157122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:35.930057058 +0000 UTC m=+520.875837356" watchObservedRunningTime="2026-07-24 16:14:35.931434614 +0000 UTC m=+520.877214977"
Jul 24 16:14:37.502019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.501983    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"]
Jul 24 16:14:37.505484 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.505467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.508062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.508043    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6s624\""
Jul 24 16:14:37.523509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.523473    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"]
Jul 24 16:14:37.664802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.664763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.665033 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.664943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl9c9\" (UniqueName: \"kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.766114 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.766080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.766323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.766170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl9c9\" (UniqueName: \"kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.766539 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.766516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.779934 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.779905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl9c9\" (UniqueName: \"kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.815861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.815831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:37.971211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:37.971186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"]
Jul 24 16:14:37.973885 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:37.973855    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0cc0b9_87a7_4ae2_99d2_9be68a60cf8f.slice/crio-8f698b09e66dd20336c9ba9596ec46b802ea3f0c87c12c8a8bf228621b90ebf0 WatchSource:0}: Error finding container 8f698b09e66dd20336c9ba9596ec46b802ea3f0c87c12c8a8bf228621b90ebf0: Status 404 returned error can't find the container with id 8f698b09e66dd20336c9ba9596ec46b802ea3f0c87c12c8a8bf228621b90ebf0
Jul 24 16:14:38.922330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:38.922301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g" event={"ID":"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f","Type":"ContainerStarted","Data":"8f698b09e66dd20336c9ba9596ec46b802ea3f0c87c12c8a8bf228621b90ebf0"}
Jul 24 16:14:40.074623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.074584    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"]
Jul 24 16:14:40.078166 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.078143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:40.089121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.089100    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 24 16:14:40.089893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.089872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s6gdp\""
Jul 24 16:14:40.172680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.172647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"]
Jul 24 16:14:40.187305 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.187278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbnw9\" (UniqueName: \"kubernetes.io/projected/bd0cf85c-5619-4551-88c4-02458e073e84-kube-api-access-pbnw9\") pod \"dns-operator-controller-manager-864dd78c4c-t6thl\" (UID: \"bd0cf85c-5619-4551-88c4-02458e073e84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:40.288012 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.287972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbnw9\" (UniqueName: \"kubernetes.io/projected/bd0cf85c-5619-4551-88c4-02458e073e84-kube-api-access-pbnw9\") pod \"dns-operator-controller-manager-864dd78c4c-t6thl\" (UID: \"bd0cf85c-5619-4551-88c4-02458e073e84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:40.299887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.299846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbnw9\" (UniqueName: \"kubernetes.io/projected/bd0cf85c-5619-4551-88c4-02458e073e84-kube-api-access-pbnw9\") pod \"dns-operator-controller-manager-864dd78c4c-t6thl\" (UID: \"bd0cf85c-5619-4551-88c4-02458e073e84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:40.391408 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.391330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:40.536306 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.536188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"]
Jul 24 16:14:40.539342 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:40.539309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0cf85c_5619_4551_88c4_02458e073e84.slice/crio-2bac26018ffe6905c6eb82a49cddfeac2e94c1609593f8e045f24966057a0760 WatchSource:0}: Error finding container 2bac26018ffe6905c6eb82a49cddfeac2e94c1609593f8e045f24966057a0760: Status 404 returned error can't find the container with id 2bac26018ffe6905c6eb82a49cddfeac2e94c1609593f8e045f24966057a0760
Jul 24 16:14:40.934202 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:40.934163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl" event={"ID":"bd0cf85c-5619-4551-88c4-02458e073e84","Type":"ContainerStarted","Data":"2bac26018ffe6905c6eb82a49cddfeac2e94c1609593f8e045f24966057a0760"}
Jul 24 16:14:43.771543 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.771512    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"]
Jul 24 16:14:43.775204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.775185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:43.779414 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.779395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ljqk5\""
Jul 24 16:14:43.788751 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.788724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"]
Jul 24 16:14:43.921082 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.921047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l59jz\" (UniqueName: \"kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz\") pod \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" (UID: \"42b7ec34-d72a-4f39-8426-227947fa4112\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:43.951742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.951701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl" event={"ID":"bd0cf85c-5619-4551-88c4-02458e073e84","Type":"ContainerStarted","Data":"c4b205b3c1fb34157704e89b6853ed99168f547d5761cb3f59cec0a67f40cb06"}
Jul 24 16:14:43.951910 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.951765    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:43.953217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.953197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g" event={"ID":"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f","Type":"ContainerStarted","Data":"6b05f183c28ab638b5a13d6e67361484817770d42a5f722f701110882edc3e58"}
Jul 24 16:14:43.953344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:43.953325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:44.007134 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.007084    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g" podStartSLOduration=1.632807565 podStartE2EDuration="7.007068539s" totalImagesPullingTime="5.374260974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:44.005514555 +0000 UTC m=+528.951294853" watchObservedRunningTime="2026-07-24 16:14:44.007068539 +0000 UTC m=+528.952848837"
Jul 24 16:14:44.007459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.007432    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl" podStartSLOduration=1.148270991 podStartE2EDuration="4.007425406s" totalImagesPullingTime="2.859154415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:43.975625999 +0000 UTC m=+528.921406296" watchObservedRunningTime="2026-07-24 16:14:44.007425406 +0000 UTC m=+528.953205704"
Jul 24 16:14:44.021885 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.021804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l59jz\" (UniqueName: \"kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz\") pod \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" (UID: \"42b7ec34-d72a-4f39-8426-227947fa4112\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:44.030612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.030578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l59jz\" (UniqueName: \"kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz\") pod \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" (UID: \"42b7ec34-d72a-4f39-8426-227947fa4112\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:44.084998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.084955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:44.235633 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.235569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"]
Jul 24 16:14:44.238527 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:44.238501    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b7ec34_d72a_4f39_8426_227947fa4112.slice/crio-7909e7bce10235c24c193dfdb06c662e87d0771a3ff7091964b61ad00410894d WatchSource:0}: Error finding container 7909e7bce10235c24c193dfdb06c662e87d0771a3ff7091964b61ad00410894d: Status 404 returned error can't find the container with id 7909e7bce10235c24c193dfdb06c662e87d0771a3ff7091964b61ad00410894d
Jul 24 16:14:44.960824 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:44.960783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv" event={"ID":"42b7ec34-d72a-4f39-8426-227947fa4112","Type":"ContainerStarted","Data":"7909e7bce10235c24c193dfdb06c662e87d0771a3ff7091964b61ad00410894d"}
Jul 24 16:14:46.911835 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:46.911805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8mm8k"
Jul 24 16:14:46.973938 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:46.973906    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv" event={"ID":"42b7ec34-d72a-4f39-8426-227947fa4112","Type":"ContainerStarted","Data":"59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5"}
Jul 24 16:14:46.974111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:46.974000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:47.001821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:47.001772    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv" podStartSLOduration=2.319732038 podStartE2EDuration="4.001754457s" totalImagesPullingTime="1.682022419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:47.001216173 +0000 UTC m=+531.946996504" watchObservedRunningTime="2026-07-24 16:14:47.001754457 +0000 UTC m=+531.947534755"
Jul 24 16:14:54.962973 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:54.962886    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t6thl"
Jul 24 16:14:54.962973 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:54.962969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:56.902201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.902166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"]
Jul 24 16:14:56.902646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.902389    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" containerName="manager" containerID="cri-o://6b05f183c28ab638b5a13d6e67361484817770d42a5f722f701110882edc3e58" gracePeriod=2
Jul 24 16:14:56.912209 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.912181    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"]
Jul 24 16:14:56.925182 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.925158    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:14:56.925673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.925629    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" containerName="manager"
Jul 24 16:14:56.925673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.925653    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" containerName="manager"
Jul 24 16:14:56.925868 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.925787    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" containerName="manager"
Jul 24 16:14:56.936182 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.936151    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"]
Jul 24 16:14:56.936379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.936300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:56.936443 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.936382    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" containerName="manager" containerID="cri-o://59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5" gracePeriod=2
Jul 24 16:14:56.938008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.937985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:56.938922 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:56.938894    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:56.946476 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.946450    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"]
Jul 24 16:14:56.948968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.948942    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:14:56.961265 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.961239    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"]
Jul 24 16:14:56.961673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.961656    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" containerName="manager"
Jul 24 16:14:56.961766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.961676    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" containerName="manager"
Jul 24 16:14:56.961815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.961772    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" containerName="manager"
Jul 24 16:14:56.964761 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.964742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:56.975119 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:56.975064    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:56.977878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:56.977857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"]
Jul 24 16:14:57.007076 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:57.007042    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:57.020606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.020579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k424\" (UniqueName: \"kubernetes.io/projected/65b603eb-339e-4402-ad2d-acebca92cc6a-kube-api-access-7k424\") pod \"limitador-operator-controller-manager-859d7b78bd-b2gh2\" (UID: \"65b603eb-339e-4402-ad2d-acebca92cc6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:57.023065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.023032    2581 generic.go:356] "Generic (PLEG): container finished" podID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" containerID="6b05f183c28ab638b5a13d6e67361484817770d42a5f722f701110882edc3e58" exitCode=0
Jul 24 16:14:57.122201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.121966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4kn8\" (UniqueName: \"kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.122201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.122021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.122201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.122091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k424\" (UniqueName: \"kubernetes.io/projected/65b603eb-339e-4402-ad2d-acebca92cc6a-kube-api-access-7k424\") pod \"limitador-operator-controller-manager-859d7b78bd-b2gh2\" (UID: \"65b603eb-339e-4402-ad2d-acebca92cc6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:57.147977 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.147941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k424\" (UniqueName: \"kubernetes.io/projected/65b603eb-339e-4402-ad2d-acebca92cc6a-kube-api-access-7k424\") pod \"limitador-operator-controller-manager-859d7b78bd-b2gh2\" (UID: \"65b603eb-339e-4402-ad2d-acebca92cc6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:57.171436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.171411    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:14:57.175188 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.175170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.177309 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:57.177283    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:57.180451 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.180432    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:57.183674 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.183657    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:57.190403 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.190383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:14:57.209209 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:57.209181    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:57.211239 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:57.211200    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-t5kzv\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:57.212810 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:57.212787    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r876g\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:57.223195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.223178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vlq\" (UniqueName: \"kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.223291 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.223258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4kn8\" (UniqueName: \"kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.223351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.223289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.223351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.223313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.223602 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.223579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.232317 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.232294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4kn8\" (UniqueName: \"kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gpxvc\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.323936 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.323902    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl9c9\" (UniqueName: \"kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9\") pod \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") "
Jul 24 16:14:57.324119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.323994    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l59jz\" (UniqueName: \"kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz\") pod \"42b7ec34-d72a-4f39-8426-227947fa4112\" (UID: \"42b7ec34-d72a-4f39-8426-227947fa4112\") "
Jul 24 16:14:57.324119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.324039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume\") pod \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\" (UID: \"ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f\") "
Jul 24 16:14:57.324256 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.324135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.324256 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.324210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vlq\" (UniqueName: \"kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.324547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.324506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" (UID: "ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:14:57.324652 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.324611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.326126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.326105    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz" (OuterVolumeSpecName: "kube-api-access-l59jz") pod "42b7ec34-d72a-4f39-8426-227947fa4112" (UID: "42b7ec34-d72a-4f39-8426-227947fa4112"). InnerVolumeSpecName "kube-api-access-l59jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:57.326196 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.326123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9" (OuterVolumeSpecName: "kube-api-access-kl9c9") pod "ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" (UID: "ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f"). InnerVolumeSpecName "kube-api-access-kl9c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:14:57.338640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.338616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vlq\" (UniqueName: \"kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq\") pod \"kuadrant-operator-controller-manager-86878c769f-xc48h\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.351833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.351810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:57.358906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.358886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:57.425047 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.425015    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-extensions-socket-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:14:57.425191 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.425050    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl9c9\" (UniqueName: \"kubernetes.io/projected/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f-kube-api-access-kl9c9\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:14:57.425191 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.425069    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l59jz\" (UniqueName: \"kubernetes.io/projected/42b7ec34-d72a-4f39-8426-227947fa4112-kube-api-access-l59jz\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:14:57.490561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.490521    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b7ec34-d72a-4f39-8426-227947fa4112" path="/var/lib/kubelet/pods/42b7ec34-d72a-4f39-8426-227947fa4112/volumes"
Jul 24 16:14:57.491135 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.491114    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f" path="/var/lib/kubelet/pods/ef0cc0b9-87a7-4ae2-99d2-9be68a60cf8f/volumes"
Jul 24 16:14:57.491695 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.491663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:57.515218 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.514298    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:14:57.518163 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:57.518133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d653c3c_6583_4844_9ac0_2f59831ad011.slice/crio-81a5cdf31964a023c27ce4e80cb119b5e64f34a023d461a87e2413aefa9b9245 WatchSource:0}: Error finding container 81a5cdf31964a023c27ce4e80cb119b5e64f34a023d461a87e2413aefa9b9245: Status 404 returned error can't find the container with id 81a5cdf31964a023c27ce4e80cb119b5e64f34a023d461a87e2413aefa9b9245
Jul 24 16:14:57.544313 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.544284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"]
Jul 24 16:14:57.560905 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:57.558719    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b603eb_339e_4402_ad2d_acebca92cc6a.slice/crio-add3d75f557a6d7b81df45776684d620d67e74bf5cbd2941a857004c8e1851d2 WatchSource:0}: Error finding container add3d75f557a6d7b81df45776684d620d67e74bf5cbd2941a857004c8e1851d2: Status 404 returned error can't find the container with id add3d75f557a6d7b81df45776684d620d67e74bf5cbd2941a857004c8e1851d2
Jul 24 16:14:57.667971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:57.667948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:14:57.670005 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:14:57.669979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049591d0_32d4_4483_8d02_d3546575381c.slice/crio-cd089cd829050c33e71d4249f9e97a3ffcac3a049acbb4f76fd231397982f84f WatchSource:0}: Error finding container cd089cd829050c33e71d4249f9e97a3ffcac3a049acbb4f76fd231397982f84f: Status 404 returned error can't find the container with id cd089cd829050c33e71d4249f9e97a3ffcac3a049acbb4f76fd231397982f84f
Jul 24 16:14:58.029556 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.029521    2581 generic.go:356] "Generic (PLEG): container finished" podID="42b7ec34-d72a-4f39-8426-227947fa4112" containerID="59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5" exitCode=0
Jul 24 16:14:58.029974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.029564    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t5kzv"
Jul 24 16:14:58.029974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.029622    2581 scope.go:117] "RemoveContainer" containerID="59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5"
Jul 24 16:14:58.031834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.031506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" event={"ID":"049591d0-32d4-4483-8d02-d3546575381c","Type":"ContainerStarted","Data":"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"}
Jul 24 16:14:58.031834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.031569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" event={"ID":"049591d0-32d4-4483-8d02-d3546575381c","Type":"ContainerStarted","Data":"cd089cd829050c33e71d4249f9e97a3ffcac3a049acbb4f76fd231397982f84f"}
Jul 24 16:14:58.031834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.031605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:14:58.033457 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.033437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" event={"ID":"9d653c3c-6583-4844-9ac0-2f59831ad011","Type":"ContainerStarted","Data":"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"}
Jul 24 16:14:58.033560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.033474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" event={"ID":"9d653c3c-6583-4844-9ac0-2f59831ad011","Type":"ContainerStarted","Data":"81a5cdf31964a023c27ce4e80cb119b5e64f34a023d461a87e2413aefa9b9245"}
Jul 24 16:14:58.033560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.033529    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:14:58.034752 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.034727    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r876g"
Jul 24 16:14:58.036458 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.036434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2" event={"ID":"65b603eb-339e-4402-ad2d-acebca92cc6a","Type":"ContainerStarted","Data":"a846af0a9875ac606f94043b27ff4821a11f484da07ea150689dd5861b480380"}
Jul 24 16:14:58.036544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.036483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2" event={"ID":"65b603eb-339e-4402-ad2d-acebca92cc6a","Type":"ContainerStarted","Data":"add3d75f557a6d7b81df45776684d620d67e74bf5cbd2941a857004c8e1851d2"}
Jul 24 16:14:58.036602 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.036546    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:14:58.040054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.040034    2581 scope.go:117] "RemoveContainer" containerID="59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5"
Jul 24 16:14:58.041552 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:14:58.041530    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5\": container with ID starting with 59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5 not found: ID does not exist" containerID="59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5"
Jul 24 16:14:58.041623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.041559    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5"} err="failed to get container status \"59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5\": rpc error: code = NotFound desc = could not find container \"59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5\": container with ID starting with 59362fcc54e6a6a4b37fad4718f0e4e40226985f76a10066bc73f34953305ff5 not found: ID does not exist"
Jul 24 16:14:58.041623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.041582    2581 scope.go:117] "RemoveContainer" containerID="6b05f183c28ab638b5a13d6e67361484817770d42a5f722f701110882edc3e58"
Jul 24 16:14:58.064188 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.064145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" podStartSLOduration=1.064132487 podStartE2EDuration="1.064132487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:58.063089994 +0000 UTC m=+543.008870291" watchObservedRunningTime="2026-07-24 16:14:58.064132487 +0000 UTC m=+543.009912785"
Jul 24 16:14:58.086588 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.086388    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" podStartSLOduration=2.086370941 podStartE2EDuration="2.086370941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:58.085695109 +0000 UTC m=+543.031475407" watchObservedRunningTime="2026-07-24 16:14:58.086370941 +0000 UTC m=+543.032151239"
Jul 24 16:14:58.103739 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:14:58.103673    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2" podStartSLOduration=2.103662372 podStartE2EDuration="2.103662372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:14:58.102431254 +0000 UTC m=+543.048211552" watchObservedRunningTime="2026-07-24 16:14:58.103662372 +0000 UTC m=+543.049442669"
Jul 24 16:15:09.046550 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.046513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:15:09.047074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.046599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b2gh2"
Jul 24 16:15:09.047074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.046704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:15:09.136311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.136280    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:15:09.136486 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.136456    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" podUID="9d653c3c-6583-4844-9ac0-2f59831ad011" containerName="manager" containerID="cri-o://499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7" gracePeriod=10
Jul 24 16:15:09.386111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.386088    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:15:09.417407 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.417370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume\") pod \"9d653c3c-6583-4844-9ac0-2f59831ad011\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") "
Jul 24 16:15:09.417544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.417482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4kn8\" (UniqueName: \"kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8\") pod \"9d653c3c-6583-4844-9ac0-2f59831ad011\" (UID: \"9d653c3c-6583-4844-9ac0-2f59831ad011\") "
Jul 24 16:15:09.417718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.417697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d653c3c-6583-4844-9ac0-2f59831ad011" (UID: "9d653c3c-6583-4844-9ac0-2f59831ad011"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:15:09.419570 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.419549    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8" (OuterVolumeSpecName: "kube-api-access-j4kn8") pod "9d653c3c-6583-4844-9ac0-2f59831ad011" (UID: "9d653c3c-6583-4844-9ac0-2f59831ad011"). InnerVolumeSpecName "kube-api-access-j4kn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:09.519051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.519022    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4kn8\" (UniqueName: \"kubernetes.io/projected/9d653c3c-6583-4844-9ac0-2f59831ad011-kube-api-access-j4kn8\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:15:09.519051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:09.519047    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d653c3c-6583-4844-9ac0-2f59831ad011-extensions-socket-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:15:10.100682 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.100648    2581 generic.go:356] "Generic (PLEG): container finished" podID="9d653c3c-6583-4844-9ac0-2f59831ad011" containerID="499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7" exitCode=0
Jul 24 16:15:10.100682 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.100683    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"
Jul 24 16:15:10.101190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.100738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" event={"ID":"9d653c3c-6583-4844-9ac0-2f59831ad011","Type":"ContainerDied","Data":"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"}
Jul 24 16:15:10.101190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.100788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc" event={"ID":"9d653c3c-6583-4844-9ac0-2f59831ad011","Type":"ContainerDied","Data":"81a5cdf31964a023c27ce4e80cb119b5e64f34a023d461a87e2413aefa9b9245"}
Jul 24 16:15:10.101190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.100808    2581 scope.go:117] "RemoveContainer" containerID="499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"
Jul 24 16:15:10.109312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.109299    2581 scope.go:117] "RemoveContainer" containerID="499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"
Jul 24 16:15:10.109558 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:15:10.109540    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7\": container with ID starting with 499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7 not found: ID does not exist" containerID="499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"
Jul 24 16:15:10.109612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.109569    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7"} err="failed to get container status \"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7\": rpc error: code = NotFound desc = could not find container \"499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7\": container with ID starting with 499a97e49bb4379ccb6c72e3dae273fb375350983bdda67e86896df158ae2ef7 not found: ID does not exist"
Jul 24 16:15:10.140062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.140033    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:15:10.146205 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:10.146181    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gpxvc"]
Jul 24 16:15:11.487238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:11.487189    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d653c3c-6583-4844-9ac0-2f59831ad011" path="/var/lib/kubelet/pods/9d653c3c-6583-4844-9ac0-2f59831ad011/volumes"
Jul 24 16:15:25.649424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.649390    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"]
Jul 24 16:15:25.649993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.649765    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d653c3c-6583-4844-9ac0-2f59831ad011" containerName="manager"
Jul 24 16:15:25.649993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.649776    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d653c3c-6583-4844-9ac0-2f59831ad011" containerName="manager"
Jul 24 16:15:25.649993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.649848    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d653c3c-6583-4844-9ac0-2f59831ad011" containerName="manager"
Jul 24 16:15:25.653062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.653038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.656273 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.656253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2gq7l\""
Jul 24 16:15:25.675197 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.675171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"]
Jul 24 16:15:25.760907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.760872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.760907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.760911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n8kp\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-kube-api-access-7n8kp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.760952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.761351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.761277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862503 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862503 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n8kp\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-kube-api-access-7n8kp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.862760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.863044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.862773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.863373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.863345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.869915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.863571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.869915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.863621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.869915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.863778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.869915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.863876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.869915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.865766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.870473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.870454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.872777 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.872755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n8kp\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-kube-api-access-7n8kp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.872917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.872895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7f20ed-66be-4a98-8409-cd90d7b6716e-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-s5z69\" (UID: \"ae7f20ed-66be-4a98-8409-cd90d7b6716e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:25.963694 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:25.963581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:26.122272 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:26.122246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"]
Jul 24 16:15:26.125250 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:15:26.125207    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7f20ed_66be_4a98_8409_cd90d7b6716e.slice/crio-a6f499301914e29b030f5003dd51c31b4d05e2410b1c6cb9cddc041596f0f845 WatchSource:0}: Error finding container a6f499301914e29b030f5003dd51c31b4d05e2410b1c6cb9cddc041596f0f845: Status 404 returned error can't find the container with id a6f499301914e29b030f5003dd51c31b4d05e2410b1c6cb9cddc041596f0f845
Jul 24 16:15:26.127906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:26.127875    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:15:26.127989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:26.127937    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:15:26.127989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:26.127965    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:15:26.179955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:26.179921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" event={"ID":"ae7f20ed-66be-4a98-8409-cd90d7b6716e","Type":"ContainerStarted","Data":"a6f499301914e29b030f5003dd51c31b4d05e2410b1c6cb9cddc041596f0f845"}
Jul 24 16:15:27.186018 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:27.185981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" event={"ID":"ae7f20ed-66be-4a98-8409-cd90d7b6716e","Type":"ContainerStarted","Data":"3e9ee3286c7b91eab175c0ffdb0ea7544acb159e7109b345301b511f15915e83"}
Jul 24 16:15:27.212036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:27.211987    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" podStartSLOduration=2.21197172 podStartE2EDuration="2.21197172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:27.209612302 +0000 UTC m=+572.155392599" watchObservedRunningTime="2026-07-24 16:15:27.21197172 +0000 UTC m=+572.157752018"
Jul 24 16:15:27.964211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:27.964178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:27.969288 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:27.969264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:28.191434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:28.191402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:28.192473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:28.192455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:15:29.220697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.220654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:29.225323 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.225301    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:29.228038 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.228017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w5pns\""
Jul 24 16:15:29.235303 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.235279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:29.292250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.292196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6brb\" (UniqueName: \"kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb\") pod \"authorino-58cd955675-hp6fl\" (UID: \"adbc0bff-3aed-47ca-920e-144748bd39bf\") " pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:29.393335 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.393298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6brb\" (UniqueName: \"kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb\") pod \"authorino-58cd955675-hp6fl\" (UID: \"adbc0bff-3aed-47ca-920e-144748bd39bf\") " pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:29.401630 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.401598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6brb\" (UniqueName: \"kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb\") pod \"authorino-58cd955675-hp6fl\" (UID: \"adbc0bff-3aed-47ca-920e-144748bd39bf\") " pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:29.535725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.535686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:29.673342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:29.673311    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:29.675257 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:15:29.675199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadbc0bff_3aed_47ca_920e_144748bd39bf.slice/crio-c30ec114ee317ec5fc970f18e5e5f830fce00f2b60fc611c9d60ad67806ba658 WatchSource:0}: Error finding container c30ec114ee317ec5fc970f18e5e5f830fce00f2b60fc611c9d60ad67806ba658: Status 404 returned error can't find the container with id c30ec114ee317ec5fc970f18e5e5f830fce00f2b60fc611c9d60ad67806ba658
Jul 24 16:15:30.201482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:30.201446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hp6fl" event={"ID":"adbc0bff-3aed-47ca-920e-144748bd39bf","Type":"ContainerStarted","Data":"c30ec114ee317ec5fc970f18e5e5f830fce00f2b60fc611c9d60ad67806ba658"}
Jul 24 16:15:33.220342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:33.220254    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hp6fl" event={"ID":"adbc0bff-3aed-47ca-920e-144748bd39bf","Type":"ContainerStarted","Data":"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"}
Jul 24 16:15:33.238781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:33.238723    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hp6fl" podStartSLOduration=1.142772854 podStartE2EDuration="4.23870955s" totalImagesPullingTime="3.095936696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:15:33.237552923 +0000 UTC m=+578.183333221" watchObservedRunningTime="2026-07-24 16:15:33.23870955 +0000 UTC m=+578.184489847"
Jul 24 16:15:33.810934 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:33.810903    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:35.229986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:35.229949    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hp6fl" podUID="adbc0bff-3aed-47ca-920e-144748bd39bf" containerName="authorino" containerID="cri-o://c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b" gracePeriod=30
Jul 24 16:15:35.484542 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:35.484480    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:35.552107 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:35.552081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6brb\" (UniqueName: \"kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb\") pod \"adbc0bff-3aed-47ca-920e-144748bd39bf\" (UID: \"adbc0bff-3aed-47ca-920e-144748bd39bf\") "
Jul 24 16:15:35.554080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:35.554058    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb" (OuterVolumeSpecName: "kube-api-access-t6brb") pod "adbc0bff-3aed-47ca-920e-144748bd39bf" (UID: "adbc0bff-3aed-47ca-920e-144748bd39bf"). InnerVolumeSpecName "kube-api-access-t6brb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:15:35.653618 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:35.653576    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6brb\" (UniqueName: \"kubernetes.io/projected/adbc0bff-3aed-47ca-920e-144748bd39bf-kube-api-access-t6brb\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:15:36.235886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.235855    2581 generic.go:356] "Generic (PLEG): container finished" podID="adbc0bff-3aed-47ca-920e-144748bd39bf" containerID="c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b" exitCode=0
Jul 24 16:15:36.236315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.235908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hp6fl"
Jul 24 16:15:36.236315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.235948    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hp6fl" event={"ID":"adbc0bff-3aed-47ca-920e-144748bd39bf","Type":"ContainerDied","Data":"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"}
Jul 24 16:15:36.236315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.235990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hp6fl" event={"ID":"adbc0bff-3aed-47ca-920e-144748bd39bf","Type":"ContainerDied","Data":"c30ec114ee317ec5fc970f18e5e5f830fce00f2b60fc611c9d60ad67806ba658"}
Jul 24 16:15:36.236315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.236014    2581 scope.go:117] "RemoveContainer" containerID="c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"
Jul 24 16:15:36.244951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.244934    2581 scope.go:117] "RemoveContainer" containerID="c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"
Jul 24 16:15:36.245199 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:15:36.245182    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b\": container with ID starting with c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b not found: ID does not exist" containerID="c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"
Jul 24 16:15:36.245281 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.245206    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b"} err="failed to get container status \"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b\": rpc error: code = NotFound desc = could not find container \"c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b\": container with ID starting with c83371440fd957e9af047056e757513870b4b305fd544e43111c37d57f5caf7b not found: ID does not exist"
Jul 24 16:15:36.258853 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.258829    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:36.268128 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:36.268102    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hp6fl"]
Jul 24 16:15:37.486687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:37.486654    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adbc0bff-3aed-47ca-920e-144748bd39bf" path="/var/lib/kubelet/pods/adbc0bff-3aed-47ca-920e-144748bd39bf/volumes"
Jul 24 16:15:55.412056 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:55.412025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:15:55.425167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:15:55.425147    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:16:02.452722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.452685    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:02.453289 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.453269    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbc0bff-3aed-47ca-920e-144748bd39bf" containerName="authorino"
Jul 24 16:16:02.453384 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.453290    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbc0bff-3aed-47ca-920e-144748bd39bf" containerName="authorino"
Jul 24 16:16:02.453440 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.453401    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="adbc0bff-3aed-47ca-920e-144748bd39bf" containerName="authorino"
Jul 24 16:16:02.457820 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.457798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:02.460013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.459992    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w5pns\""
Jul 24 16:16:02.462743 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.462721    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:02.488998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.488968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gwj\" (UniqueName: \"kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj\") pod \"authorino-5d4b67c446-mwb5k\" (UID: \"ea83dc65-a454-45f9-b2d2-63520e1771ed\") " pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:02.590512 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.590472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gwj\" (UniqueName: \"kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj\") pod \"authorino-5d4b67c446-mwb5k\" (UID: \"ea83dc65-a454-45f9-b2d2-63520e1771ed\") " pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:02.598940 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.598913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gwj\" (UniqueName: \"kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj\") pod \"authorino-5d4b67c446-mwb5k\" (UID: \"ea83dc65-a454-45f9-b2d2-63520e1771ed\") " pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:02.706249 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.706149    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:02.706431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.706418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:02.748990 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.748959    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:02.754745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.754722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:02.767852 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.767828    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:02.792615 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.792589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grghz\" (UniqueName: \"kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz\") pod \"authorino-f474d8f66-8w8ww\" (UID: \"da82f51e-f5f8-487b-a6da-a09b339702f4\") " pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:02.848669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.848643    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:02.853033 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:16:02.853005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea83dc65_a454_45f9_b2d2_63520e1771ed.slice/crio-809ac9cf6c58fc8856792328f9d3b3a3c3f9793c4a60ed6da7d06d570ec7c2f9 WatchSource:0}: Error finding container 809ac9cf6c58fc8856792328f9d3b3a3c3f9793c4a60ed6da7d06d570ec7c2f9: Status 404 returned error can't find the container with id 809ac9cf6c58fc8856792328f9d3b3a3c3f9793c4a60ed6da7d06d570ec7c2f9
Jul 24 16:16:02.893907 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.893884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grghz\" (UniqueName: \"kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz\") pod \"authorino-f474d8f66-8w8ww\" (UID: \"da82f51e-f5f8-487b-a6da-a09b339702f4\") " pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:02.902857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:02.902833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grghz\" (UniqueName: \"kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz\") pod \"authorino-f474d8f66-8w8ww\" (UID: \"da82f51e-f5f8-487b-a6da-a09b339702f4\") " pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:03.011304 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.011259    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:03.011569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.011552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:03.038370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.038343    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:16:03.042888 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.042867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.045060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.045041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 16:16:03.049816 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.049796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:16:03.096281 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.096255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rr9\" (UniqueName: \"kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.096426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.096358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.149538 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.149514    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:03.151849 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:16:03.151824    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda82f51e_f5f8_487b_a6da_a09b339702f4.slice/crio-e301f706e65175bc5087c189d0fe4cd7098e7034119bd68ad9d4b01c5ddcf1be WatchSource:0}: Error finding container e301f706e65175bc5087c189d0fe4cd7098e7034119bd68ad9d4b01c5ddcf1be: Status 404 returned error can't find the container with id e301f706e65175bc5087c189d0fe4cd7098e7034119bd68ad9d4b01c5ddcf1be
Jul 24 16:16:03.197109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.197082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rr9\" (UniqueName: \"kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.197286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.197137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.199507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.199477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.205773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.205748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rr9\" (UniqueName: \"kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9\") pod \"authorino-6f5bfcf674-82qx7\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") " pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.354764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.354734    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:16:03.373667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.373620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f474d8f66-8w8ww" event={"ID":"da82f51e-f5f8-487b-a6da-a09b339702f4","Type":"ContainerStarted","Data":"e301f706e65175bc5087c189d0fe4cd7098e7034119bd68ad9d4b01c5ddcf1be"}
Jul 24 16:16:03.375515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.375482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" event={"ID":"ea83dc65-a454-45f9-b2d2-63520e1771ed","Type":"ContainerStarted","Data":"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"}
Jul 24 16:16:03.375635 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.375527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" event={"ID":"ea83dc65-a454-45f9-b2d2-63520e1771ed","Type":"ContainerStarted","Data":"809ac9cf6c58fc8856792328f9d3b3a3c3f9793c4a60ed6da7d06d570ec7c2f9"}
Jul 24 16:16:03.375635 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.375578    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" podUID="ea83dc65-a454-45f9-b2d2-63520e1771ed" containerName="authorino" containerID="cri-o://93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c" gracePeriod=30
Jul 24 16:16:03.391527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.390987    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" podStartSLOduration=0.998789388 podStartE2EDuration="1.390966298s" totalImagesPullingTime="392.17691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:03.390137819 +0000 UTC m=+608.335918117" watchObservedRunningTime="2026-07-24 16:16:03.390966298 +0000 UTC m=+608.336746596"
Jul 24 16:16:03.493051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.493028    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:16:03.494814 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:16:03.494784    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883ef34f_081f_4cdc_a1cb_9bafc5817a11.slice/crio-e7aecc4929bd21f4d7ccbef689e178a0cf350ad088584bc8d744c09f43ce14e8 WatchSource:0}: Error finding container e7aecc4929bd21f4d7ccbef689e178a0cf350ad088584bc8d744c09f43ce14e8: Status 404 returned error can't find the container with id e7aecc4929bd21f4d7ccbef689e178a0cf350ad088584bc8d744c09f43ce14e8
Jul 24 16:16:03.649869 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.649842    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:03.713434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.713412    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4gwj\" (UniqueName: \"kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj\") pod \"ea83dc65-a454-45f9-b2d2-63520e1771ed\" (UID: \"ea83dc65-a454-45f9-b2d2-63520e1771ed\") "
Jul 24 16:16:03.715483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.715459    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj" (OuterVolumeSpecName: "kube-api-access-f4gwj") pod "ea83dc65-a454-45f9-b2d2-63520e1771ed" (UID: "ea83dc65-a454-45f9-b2d2-63520e1771ed"). InnerVolumeSpecName "kube-api-access-f4gwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:03.814422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:03.814350    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4gwj\" (UniqueName: \"kubernetes.io/projected/ea83dc65-a454-45f9-b2d2-63520e1771ed-kube-api-access-f4gwj\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:16:04.381971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.381937    2581 generic.go:356] "Generic (PLEG): container finished" podID="ea83dc65-a454-45f9-b2d2-63520e1771ed" containerID="93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c" exitCode=0
Jul 24 16:16:04.382118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.381989    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwb5k"
Jul 24 16:16:04.382118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.382012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" event={"ID":"ea83dc65-a454-45f9-b2d2-63520e1771ed","Type":"ContainerDied","Data":"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"}
Jul 24 16:16:04.382118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.382057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mwb5k" event={"ID":"ea83dc65-a454-45f9-b2d2-63520e1771ed","Type":"ContainerDied","Data":"809ac9cf6c58fc8856792328f9d3b3a3c3f9793c4a60ed6da7d06d570ec7c2f9"}
Jul 24 16:16:04.382118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.382075    2581 scope.go:117] "RemoveContainer" containerID="93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"
Jul 24 16:16:04.384108 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.384085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f474d8f66-8w8ww" event={"ID":"da82f51e-f5f8-487b-a6da-a09b339702f4","Type":"ContainerStarted","Data":"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"}
Jul 24 16:16:04.384339 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.384139    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f474d8f66-8w8ww" podUID="da82f51e-f5f8-487b-a6da-a09b339702f4" containerName="authorino" containerID="cri-o://3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d" gracePeriod=30
Jul 24 16:16:04.386455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.385947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" event={"ID":"883ef34f-081f-4cdc-a1cb-9bafc5817a11","Type":"ContainerStarted","Data":"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"}
Jul 24 16:16:04.386455 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.385981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" event={"ID":"883ef34f-081f-4cdc-a1cb-9bafc5817a11","Type":"ContainerStarted","Data":"e7aecc4929bd21f4d7ccbef689e178a0cf350ad088584bc8d744c09f43ce14e8"}
Jul 24 16:16:04.395091 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.395003    2581 scope.go:117] "RemoveContainer" containerID="93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"
Jul 24 16:16:04.396118 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:16:04.396088    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c\": container with ID starting with 93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c not found: ID does not exist" containerID="93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"
Jul 24 16:16:04.396248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.396129    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c"} err="failed to get container status \"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c\": rpc error: code = NotFound desc = could not find container \"93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c\": container with ID starting with 93d59521dbc5515d665b353f11dab7f9d3ab40fcd2ffc34cb1f5cc5fc8585b5c not found: ID does not exist"
Jul 24 16:16:04.400660 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.400620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f474d8f66-8w8ww" podStartSLOduration=1.8520855109999999 podStartE2EDuration="2.400607296s" totalImagesPullingTime="548.521785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:04.399612468 +0000 UTC m=+609.345392765" watchObservedRunningTime="2026-07-24 16:16:04.400607296 +0000 UTC m=+609.346387593"
Jul 24 16:16:04.414621 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.414576    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" podStartSLOduration=0.605255784 podStartE2EDuration="1.414560994s" totalImagesPullingTime="809.30521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:04.413203761 +0000 UTC m=+609.358984062" watchObservedRunningTime="2026-07-24 16:16:04.414560994 +0000 UTC m=+609.360341291"
Jul 24 16:16:04.430449 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.430418    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:04.433173 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.433141    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwb5k"]
Jul 24 16:16:04.644175 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.644148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:04.723600 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.723563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grghz\" (UniqueName: \"kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz\") pod \"da82f51e-f5f8-487b-a6da-a09b339702f4\" (UID: \"da82f51e-f5f8-487b-a6da-a09b339702f4\") "
Jul 24 16:16:04.725663 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.725631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz" (OuterVolumeSpecName: "kube-api-access-grghz") pod "da82f51e-f5f8-487b-a6da-a09b339702f4" (UID: "da82f51e-f5f8-487b-a6da-a09b339702f4"). InnerVolumeSpecName "kube-api-access-grghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:16:04.824638 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:04.824606    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grghz\" (UniqueName: \"kubernetes.io/projected/da82f51e-f5f8-487b-a6da-a09b339702f4-kube-api-access-grghz\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:16:05.393144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.393110    2581 generic.go:356] "Generic (PLEG): container finished" podID="da82f51e-f5f8-487b-a6da-a09b339702f4" containerID="3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d" exitCode=0
Jul 24 16:16:05.393330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.393162    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f474d8f66-8w8ww"
Jul 24 16:16:05.393330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.393186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f474d8f66-8w8ww" event={"ID":"da82f51e-f5f8-487b-a6da-a09b339702f4","Type":"ContainerDied","Data":"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"}
Jul 24 16:16:05.393330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.393244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f474d8f66-8w8ww" event={"ID":"da82f51e-f5f8-487b-a6da-a09b339702f4","Type":"ContainerDied","Data":"e301f706e65175bc5087c189d0fe4cd7098e7034119bd68ad9d4b01c5ddcf1be"}
Jul 24 16:16:05.393330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.393250    2581 scope.go:117] "RemoveContainer" containerID="3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"
Jul 24 16:16:05.402013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.401995    2581 scope.go:117] "RemoveContainer" containerID="3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"
Jul 24 16:16:05.402302 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:16:05.402283    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d\": container with ID starting with 3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d not found: ID does not exist" containerID="3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"
Jul 24 16:16:05.402370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.402310    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d"} err="failed to get container status \"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d\": rpc error: code = NotFound desc = could not find container \"3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d\": container with ID starting with 3be88d202424027bfaf96c3744f27d2175146f0f5ada8664c8e503c9e3cb843d not found: ID does not exist"
Jul 24 16:16:05.416068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.416045    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:05.421535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.421512    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f474d8f66-8w8ww"]
Jul 24 16:16:05.488022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.487986    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da82f51e-f5f8-487b-a6da-a09b339702f4" path="/var/lib/kubelet/pods/da82f51e-f5f8-487b-a6da-a09b339702f4/volumes"
Jul 24 16:16:05.488453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:05.488433    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea83dc65-a454-45f9-b2d2-63520e1771ed" path="/var/lib/kubelet/pods/ea83dc65-a454-45f9-b2d2-63520e1771ed/volumes"
Jul 24 16:16:45.203971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.203930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"]
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204353    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da82f51e-f5f8-487b-a6da-a09b339702f4" containerName="authorino"
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204365    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="da82f51e-f5f8-487b-a6da-a09b339702f4" containerName="authorino"
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea83dc65-a454-45f9-b2d2-63520e1771ed" containerName="authorino"
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea83dc65-a454-45f9-b2d2-63520e1771ed" containerName="authorino"
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204451    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="da82f51e-f5f8-487b-a6da-a09b339702f4" containerName="authorino"
Jul 24 16:16:45.205369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.204459    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea83dc65-a454-45f9-b2d2-63520e1771ed" containerName="authorino"
Jul 24 16:16:45.206151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.206136    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.208485 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.208459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m7flr\""
Jul 24 16:16:45.208485 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.208459    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 24 16:16:45.216879 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.216859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"]
Jul 24 16:16:45.282710 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.282673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr7cl\" (UniqueName: \"kubernetes.io/projected/142de5a6-67aa-41fd-b731-36fa2c3abaeb-kube-api-access-sr7cl\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.282710 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.282711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142de5a6-67aa-41fd-b731-36fa2c3abaeb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.383972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.383936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr7cl\" (UniqueName: \"kubernetes.io/projected/142de5a6-67aa-41fd-b731-36fa2c3abaeb-kube-api-access-sr7cl\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.384167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.383978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142de5a6-67aa-41fd-b731-36fa2c3abaeb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.384731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.384712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/142de5a6-67aa-41fd-b731-36fa2c3abaeb-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.398281 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.398252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr7cl\" (UniqueName: \"kubernetes.io/projected/142de5a6-67aa-41fd-b731-36fa2c3abaeb-kube-api-access-sr7cl\") pod \"payload-pre-processing-687dbb6cf6-p76rl\" (UID: \"142de5a6-67aa-41fd-b731-36fa2c3abaeb\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.517774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.517750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:45.667118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:45.667086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"]
Jul 24 16:16:45.668819 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:16:45.668788    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142de5a6_67aa_41fd_b731_36fa2c3abaeb.slice/crio-7038a1fe0ce084f2ff4f2caacbbb250c7c4b77fb6d11977a93739435248273ef WatchSource:0}: Error finding container 7038a1fe0ce084f2ff4f2caacbbb250c7c4b77fb6d11977a93739435248273ef: Status 404 returned error can't find the container with id 7038a1fe0ce084f2ff4f2caacbbb250c7c4b77fb6d11977a93739435248273ef
Jul 24 16:16:46.619858 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:46.619795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl" event={"ID":"142de5a6-67aa-41fd-b731-36fa2c3abaeb","Type":"ContainerStarted","Data":"7038a1fe0ce084f2ff4f2caacbbb250c7c4b77fb6d11977a93739435248273ef"}
Jul 24 16:16:47.626787 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:47.626749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl" event={"ID":"142de5a6-67aa-41fd-b731-36fa2c3abaeb","Type":"ContainerStarted","Data":"cdc4e9452fdd74410dd1fd4142eda5950f5be4080ed2387c501d0fefe4c701a3"}
Jul 24 16:16:47.627282 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:47.626829    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:47.654972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:47.654921    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl" podStartSLOduration=0.890922737 podStartE2EDuration="2.654907288s" totalImagesPullingTime="1.763984551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:16:47.654303646 +0000 UTC m=+652.600083944" watchObservedRunningTime="2026-07-24 16:16:47.654907288 +0000 UTC m=+652.600687585"
Jul 24 16:16:53.659894 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.659864    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae7f20ed-66be-4a98-8409-cd90d7b6716e" containerID="3e9ee3286c7b91eab175c0ffdb0ea7544acb159e7109b345301b511f15915e83" exitCode=0
Jul 24 16:16:53.660333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.659946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" event={"ID":"ae7f20ed-66be-4a98-8409-cd90d7b6716e","Type":"ContainerDied","Data":"3e9ee3286c7b91eab175c0ffdb0ea7544acb159e7109b345301b511f15915e83"}
Jul 24 16:16:53.660333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.660315    2581 scope.go:117] "RemoveContainer" containerID="3e9ee3286c7b91eab175c0ffdb0ea7544acb159e7109b345301b511f15915e83"
Jul 24 16:16:53.661428 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.661391    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:16:53.661518 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.661475    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:16:53.661564 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:53.661520    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:16:54.666927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:54.666889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" event={"ID":"ae7f20ed-66be-4a98-8409-cd90d7b6716e","Type":"ContainerStarted","Data":"6b75f9943ef7f4a76965b9ee44c3cafbbd31599479dc8552e18449f0cb0fbfa3"}
Jul 24 16:16:54.963770 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:54.963683    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:16:54.964903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:54.964879    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s5z69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 16:16:54.965017 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:54.964927    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" podUID="ae7f20ed-66be-4a98-8409-cd90d7b6716e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 16:16:55.964208 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:55.964171    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s5z69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 16:16:55.964627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:55.964259    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" podUID="ae7f20ed-66be-4a98-8409-cd90d7b6716e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 16:16:56.964413 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:56.964373    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s5z69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 16:16:56.964836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:56.964427    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" podUID="ae7f20ed-66be-4a98-8409-cd90d7b6716e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 16:16:57.964456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:57.964423    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-s5z69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 24 16:16:57.964848 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:57.964472    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69" podUID="ae7f20ed-66be-4a98-8409-cd90d7b6716e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 24 16:16:58.200355 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:58.200318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:16:58.634969 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:58.634938    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p76rl"
Jul 24 16:16:58.968237 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:58.968148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:16:58.969153 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:16:58.969132    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s5z69"
Jul 24 16:17:11.147817 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.147773    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"]
Jul 24 16:17:11.155925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.155896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.158528 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.158488    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7bv6s\""
Jul 24 16:17:11.158975 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.158951    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 16:17:11.159198 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.159162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 16:17:11.159315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.159207    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 16:17:11.161363 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.161341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"]
Jul 24 16:17:11.246641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.246829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.246829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.246829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.246829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.246829 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.246814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpk85\" (UniqueName: \"kubernetes.io/projected/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-kube-api-access-rpk85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348240 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpk85\" (UniqueName: \"kubernetes.io/projected/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-kube-api-access-rpk85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348792 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.348792 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.348783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.350756 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.350738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.351015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.350997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.356209 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.356190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpk85\" (UniqueName: \"kubernetes.io/projected/cb250e84-99a3-45d1-ac8c-7f65f3a7eba2-kube-api-access-rpk85\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6hzdc\" (UID: \"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.467327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.467209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:11.605093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.605070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"]
Jul 24 16:17:11.607160 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:17:11.607133    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb250e84_99a3_45d1_ac8c_7f65f3a7eba2.slice/crio-05416088462ad99cc84f6e5e50328368e0c364ad41e1130df2da6c81eb4d5d8b WatchSource:0}: Error finding container 05416088462ad99cc84f6e5e50328368e0c364ad41e1130df2da6c81eb4d5d8b: Status 404 returned error can't find the container with id 05416088462ad99cc84f6e5e50328368e0c364ad41e1130df2da6c81eb4d5d8b
Jul 24 16:17:11.608646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.608627    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:17:11.755321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:11.755214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc" event={"ID":"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2","Type":"ContainerStarted","Data":"05416088462ad99cc84f6e5e50328368e0c364ad41e1130df2da6c81eb4d5d8b"}
Jul 24 16:17:13.767551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:13.767506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc" event={"ID":"cb250e84-99a3-45d1-ac8c-7f65f3a7eba2","Type":"ContainerStarted","Data":"44602ee78a3ebd5d0d618e44a47d4424c19db0a5c49b23cf8a6edb747ee337c5"}
Jul 24 16:17:13.788915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:13.788862    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc" podStartSLOduration=1.526947646 podStartE2EDuration="2.788843934s" totalImagesPullingTime="1.261896288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:13.786511277 +0000 UTC m=+678.732291575" watchObservedRunningTime="2026-07-24 16:17:13.788843934 +0000 UTC m=+678.734624231"
Jul 24 16:17:21.467740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:21.467700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:21.468388 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:21.467770    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:21.480477 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:21.480452    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:21.818491 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:21.818456    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6hzdc"
Jul 24 16:17:22.750797 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.750763    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"]
Jul 24 16:17:22.754238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.754206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.756478 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.756458    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 24 16:17:22.763387 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.763364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"]
Jul 24 16:17:22.844738 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.844738 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.844932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.844932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.844932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd08598-ca27-4d81-acd3-5644be9b871e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.845037 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.844937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6v65\" (UniqueName: \"kubernetes.io/projected/fdd08598-ca27-4d81-acd3-5644be9b871e-kube-api-access-f6v65\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946305 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946495 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946495 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946495 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946495 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd08598-ca27-4d81-acd3-5644be9b871e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946710 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6v65\" (UniqueName: \"kubernetes.io/projected/fdd08598-ca27-4d81-acd3-5644be9b871e-kube-api-access-f6v65\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.946885 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.946822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.948779 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.948757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdd08598-ca27-4d81-acd3-5644be9b871e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.949160 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.949139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdd08598-ca27-4d81-acd3-5644be9b871e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:22.954293 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:22.954268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6v65\" (UniqueName: \"kubernetes.io/projected/fdd08598-ca27-4d81-acd3-5644be9b871e-kube-api-access-f6v65\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5m8v9\" (UID: \"fdd08598-ca27-4d81-acd3-5644be9b871e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:23.064851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:23.064812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:23.200422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:23.200395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"]
Jul 24 16:17:23.202061 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:17:23.202027    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd08598_ca27_4d81_acd3_5644be9b871e.slice/crio-abee6ef9a7e684f4c5945a9dd9171c532abf7bb57c0ffb53631c5e26425c442b WatchSource:0}: Error finding container abee6ef9a7e684f4c5945a9dd9171c532abf7bb57c0ffb53631c5e26425c442b: Status 404 returned error can't find the container with id abee6ef9a7e684f4c5945a9dd9171c532abf7bb57c0ffb53631c5e26425c442b
Jul 24 16:17:23.818420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:23.818383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9" event={"ID":"fdd08598-ca27-4d81-acd3-5644be9b871e","Type":"ContainerStarted","Data":"bdeaab34c9ac7e1bc96b7e8de78f5ec1d0546a5d03f7a31fb732042bed315f3c"}
Jul 24 16:17:23.818816 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:23.818448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9" event={"ID":"fdd08598-ca27-4d81-acd3-5644be9b871e","Type":"ContainerStarted","Data":"abee6ef9a7e684f4c5945a9dd9171c532abf7bb57c0ffb53631c5e26425c442b"}
Jul 24 16:17:23.838998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:23.838954    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9" podStartSLOduration=1.577669471 podStartE2EDuration="1.838938837s" totalImagesPullingTime="261.269366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:23.837866479 +0000 UTC m=+688.783646802" watchObservedRunningTime="2026-07-24 16:17:23.838938837 +0000 UTC m=+688.784719156"
Jul 24 16:17:33.065400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:33.065345    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:33.065990 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:33.065459    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:33.078204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:33.078178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:33.879008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:33.878977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5m8v9"
Jul 24 16:17:50.343516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.343437    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"]
Jul 24 16:17:50.349433 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.349409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.351771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.351749    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 16:17:50.359438 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.359413    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"]
Jul 24 16:17:50.505723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4xk\" (UniqueName: \"kubernetes.io/projected/ce12cd3f-800a-4928-84f5-ebada2acfdd9-kube-api-access-lx4xk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.505881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.505881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.505881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.505987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.505987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.505911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.606599 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.606501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4xk\" (UniqueName: \"kubernetes.io/projected/ce12cd3f-800a-4928-84f5-ebada2acfdd9-kube-api-access-lx4xk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.606811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.606782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.606903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.606880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.607502 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.607462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.607615 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.607574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.607684 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.607627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.607871 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.607845    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.607964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.607919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.608178 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.608154    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.610446 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.610415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce12cd3f-800a-4928-84f5-ebada2acfdd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.610616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.610597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce12cd3f-800a-4928-84f5-ebada2acfdd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.615043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.615018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4xk\" (UniqueName: \"kubernetes.io/projected/ce12cd3f-800a-4928-84f5-ebada2acfdd9-kube-api-access-lx4xk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-54kvs\" (UID: \"ce12cd3f-800a-4928-84f5-ebada2acfdd9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.660354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.660320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:17:50.825625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.825599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"]
Jul 24 16:17:50.828621 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:17:50.828588    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce12cd3f_800a_4928_84f5_ebada2acfdd9.slice/crio-f3bc14a5967411a53f0fdf03da237d4fd4ccc5a7d4574f9600d1dcd7346dad2e WatchSource:0}: Error finding container f3bc14a5967411a53f0fdf03da237d4fd4ccc5a7d4574f9600d1dcd7346dad2e: Status 404 returned error can't find the container with id f3bc14a5967411a53f0fdf03da237d4fd4ccc5a7d4574f9600d1dcd7346dad2e
Jul 24 16:17:50.960497 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:50.960414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs" event={"ID":"ce12cd3f-800a-4928-84f5-ebada2acfdd9","Type":"ContainerStarted","Data":"f3bc14a5967411a53f0fdf03da237d4fd4ccc5a7d4574f9600d1dcd7346dad2e"}
Jul 24 16:17:51.968125 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:51.968083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs" event={"ID":"ce12cd3f-800a-4928-84f5-ebada2acfdd9","Type":"ContainerStarted","Data":"6f48d7e1fb7dbaa05aa461a6503af5161566244855b6fe8b5feba260654e8459"}
Jul 24 16:17:51.989247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:17:51.986574    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs" podStartSLOduration=1.685042438 podStartE2EDuration="1.986552387s" totalImagesPullingTime="301.509949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:17:51.985253529 +0000 UTC m=+716.931033828" watchObservedRunningTime="2026-07-24 16:17:51.986552387 +0000 UTC m=+716.932332686"
Jul 24 16:18:00.661218 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:00.661179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:18:00.661643 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:00.661261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:18:00.674112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:00.674084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:18:01.027571 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:01.027540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-54kvs"
Jul 24 16:18:57.858120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:57.858077    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:18:57.858721 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:57.858322    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" podUID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" containerName="authorino" containerID="cri-o://10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38" gracePeriod=30
Jul 24 16:18:58.125599 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.125577    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:18:58.233698 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.233665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89rr9\" (UniqueName: \"kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9\") pod \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") "
Jul 24 16:18:58.233888 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.233734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert\") pod \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\" (UID: \"883ef34f-081f-4cdc-a1cb-9bafc5817a11\") "
Jul 24 16:18:58.235913 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.235884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9" (OuterVolumeSpecName: "kube-api-access-89rr9") pod "883ef34f-081f-4cdc-a1cb-9bafc5817a11" (UID: "883ef34f-081f-4cdc-a1cb-9bafc5817a11"). InnerVolumeSpecName "kube-api-access-89rr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:18:58.244702 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.244679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "883ef34f-081f-4cdc-a1cb-9bafc5817a11" (UID: "883ef34f-081f-4cdc-a1cb-9bafc5817a11"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:18:58.311964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.311932    2581 generic.go:356] "Generic (PLEG): container finished" podID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" containerID="10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38" exitCode=0
Jul 24 16:18:58.312124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.311990    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f5bfcf674-82qx7"
Jul 24 16:18:58.312124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.312023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" event={"ID":"883ef34f-081f-4cdc-a1cb-9bafc5817a11","Type":"ContainerDied","Data":"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"}
Jul 24 16:18:58.312124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.312067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f5bfcf674-82qx7" event={"ID":"883ef34f-081f-4cdc-a1cb-9bafc5817a11","Type":"ContainerDied","Data":"e7aecc4929bd21f4d7ccbef689e178a0cf350ad088584bc8d744c09f43ce14e8"}
Jul 24 16:18:58.312124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.312087    2581 scope.go:117] "RemoveContainer" containerID="10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"
Jul 24 16:18:58.321662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.321645    2581 scope.go:117] "RemoveContainer" containerID="10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"
Jul 24 16:18:58.321966 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:18:58.321948    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38\": container with ID starting with 10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38 not found: ID does not exist" containerID="10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"
Jul 24 16:18:58.322016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.321976    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38"} err="failed to get container status \"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38\": rpc error: code = NotFound desc = could not find container \"10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38\": container with ID starting with 10e7b5cc5cbceef58206d672cb23137c51bfdacf83a5499f66725d94a2271a38 not found: ID does not exist"
Jul 24 16:18:58.335091 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.335061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:18:58.335424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.335393    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89rr9\" (UniqueName: \"kubernetes.io/projected/883ef34f-081f-4cdc-a1cb-9bafc5817a11-kube-api-access-89rr9\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:18:58.335424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.335427    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/883ef34f-081f-4cdc-a1cb-9bafc5817a11-tls-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:18:58.339019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:58.338999    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f5bfcf674-82qx7"]
Jul 24 16:18:59.487843 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:18:59.487811    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" path="/var/lib/kubelet/pods/883ef34f-081f-4cdc-a1cb-9bafc5817a11/volumes"
Jul 24 16:19:55.485737 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:19:55.485697    2581 scope.go:117] "RemoveContainer" containerID="072aaf88f58989376f8b54bfd0197d343d9cbcbc9372d3337fc6401bf31d48f2"
Jul 24 16:20:55.447877 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:20:55.447795    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:20:55.457729 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:20:55.457701    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:25:50.124630 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:50.124595    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:25:50.125184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:50.124804    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" podUID="049591d0-32d4-4483-8d02-d3546575381c" containerName="manager" containerID="cri-o://da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd" gracePeriod=10
Jul 24 16:25:52.790764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:52.790736    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:25:52.905866 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:52.905783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume\") pod \"049591d0-32d4-4483-8d02-d3546575381c\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") "
Jul 24 16:25:52.906028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:52.905880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8vlq\" (UniqueName: \"kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq\") pod \"049591d0-32d4-4483-8d02-d3546575381c\" (UID: \"049591d0-32d4-4483-8d02-d3546575381c\") "
Jul 24 16:25:52.906279 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:52.906217    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "049591d0-32d4-4483-8d02-d3546575381c" (UID: "049591d0-32d4-4483-8d02-d3546575381c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:25:52.907919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:52.907895    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq" (OuterVolumeSpecName: "kube-api-access-m8vlq") pod "049591d0-32d4-4483-8d02-d3546575381c" (UID: "049591d0-32d4-4483-8d02-d3546575381c"). InnerVolumeSpecName "kube-api-access-m8vlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:25:53.007537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.007498    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8vlq\" (UniqueName: \"kubernetes.io/projected/049591d0-32d4-4483-8d02-d3546575381c-kube-api-access-m8vlq\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:25:53.007537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.007530    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/049591d0-32d4-4483-8d02-d3546575381c-extensions-socket-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:25:53.420670 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.420636    2581 generic.go:356] "Generic (PLEG): container finished" podID="049591d0-32d4-4483-8d02-d3546575381c" containerID="da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd" exitCode=0
Jul 24 16:25:53.420837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.420694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" event={"ID":"049591d0-32d4-4483-8d02-d3546575381c","Type":"ContainerDied","Data":"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"}
Jul 24 16:25:53.420837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.420699    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"
Jul 24 16:25:53.420837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.420757    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h" event={"ID":"049591d0-32d4-4483-8d02-d3546575381c","Type":"ContainerDied","Data":"cd089cd829050c33e71d4249f9e97a3ffcac3a049acbb4f76fd231397982f84f"}
Jul 24 16:25:53.420837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.420778    2581 scope.go:117] "RemoveContainer" containerID="da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"
Jul 24 16:25:53.431344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.431321    2581 scope.go:117] "RemoveContainer" containerID="da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"
Jul 24 16:25:53.431601 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:25:53.431581    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd\": container with ID starting with da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd not found: ID does not exist" containerID="da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"
Jul 24 16:25:53.431672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.431612    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd"} err="failed to get container status \"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd\": rpc error: code = NotFound desc = could not find container \"da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd\": container with ID starting with da487aac5a88625335b316bb09f87eb3e7eb00b1c9ae066896fbfe45fb4d31bd not found: ID does not exist"
Jul 24 16:25:53.442857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.442836    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:25:53.446491 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.446466    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc48h"]
Jul 24 16:25:53.487067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:53.487033    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049591d0-32d4-4483-8d02-d3546575381c" path="/var/lib/kubelet/pods/049591d0-32d4-4483-8d02-d3546575381c/volumes"
Jul 24 16:25:55.481714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:55.481686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:25:55.489909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:25:55.489887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:26:51.239897 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.239822    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"]
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240214    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" containerName="authorino"
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240238    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" containerName="authorino"
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240263    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049591d0-32d4-4483-8d02-d3546575381c" containerName="manager"
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240268    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="049591d0-32d4-4483-8d02-d3546575381c" containerName="manager"
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240331    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="049591d0-32d4-4483-8d02-d3546575381c" containerName="manager"
Jul 24 16:26:51.240358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.240341    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="883ef34f-081f-4cdc-a1cb-9bafc5817a11" containerName="authorino"
Jul 24 16:26:51.243319 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.243303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.246099 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.246082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6s624\""
Jul 24 16:26:51.257551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.257529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"]
Jul 24 16:26:51.337005 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.336976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.337156 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.337058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59xh\" (UniqueName: \"kubernetes.io/projected/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-kube-api-access-r59xh\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.437929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.437894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.438098 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.437989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59xh\" (UniqueName: \"kubernetes.io/projected/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-kube-api-access-r59xh\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.438302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.438283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.447655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.447626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59xh\" (UniqueName: \"kubernetes.io/projected/a019ef64-a03d-44f1-8b4b-cadcf9d65c60-kube-api-access-r59xh\") pod \"kuadrant-operator-controller-manager-86878c769f-vjdrh\" (UID: \"a019ef64-a03d-44f1-8b4b-cadcf9d65c60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.552969 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.552921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:51.693322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.693295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"]
Jul 24 16:26:51.695828 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:26:51.695792    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda019ef64_a03d_44f1_8b4b_cadcf9d65c60.slice/crio-e43bcd3a2c64189dcea5e00b908120125b22a583d6b7c4ef638dce64e454cb5d WatchSource:0}: Error finding container e43bcd3a2c64189dcea5e00b908120125b22a583d6b7c4ef638dce64e454cb5d: Status 404 returned error can't find the container with id e43bcd3a2c64189dcea5e00b908120125b22a583d6b7c4ef638dce64e454cb5d
Jul 24 16:26:51.713602 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:51.713571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh" event={"ID":"a019ef64-a03d-44f1-8b4b-cadcf9d65c60","Type":"ContainerStarted","Data":"e43bcd3a2c64189dcea5e00b908120125b22a583d6b7c4ef638dce64e454cb5d"}
Jul 24 16:26:52.720303 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:52.720267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh" event={"ID":"a019ef64-a03d-44f1-8b4b-cadcf9d65c60","Type":"ContainerStarted","Data":"ed5557e9cbe2711193c3856b449ef27d6b349fb140cca9ec4e597d8b3884bf26"}
Jul 24 16:26:52.720786 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:52.720329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:26:52.742026 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:26:52.741977    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh" podStartSLOduration=1.741957634 podStartE2EDuration="1.741957634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:26:52.740383246 +0000 UTC m=+1257.686163556" watchObservedRunningTime="2026-07-24 16:26:52.741957634 +0000 UTC m=+1257.687737931"
Jul 24 16:27:03.727847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:27:03.727815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjdrh"
Jul 24 16:29:25.161352 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.161318    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:29:25.164886 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.164870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.167105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.167082    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-c3d15822-kserve-self-signed-certs\""
Jul 24 16:29:25.183387 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.183361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:29:25.248857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.248827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.249016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.248880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbpf\" (UniqueName: \"kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.249016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.248984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.249093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.249057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.249093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.249077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.249166 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.249099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.349986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.349950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.350174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.349996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.350174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.350025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.350174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.350128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.350371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.350195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbpf\" (UniqueName: \"kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.350371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.350277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.351104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.351078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.351332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.351264    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.351503 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.351480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.353304 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.353278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.353416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.353306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.360038 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.360019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbpf\" (UniqueName: \"kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf\") pod \"e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") " pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.473810 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.473741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:25.621343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:25.621309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:29:25.624525 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:29:25.624495    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bf860e5_33a5_49f7_8ca8_1d03996f6f30.slice/crio-1f976f5667413db9c62c232c84dde0dc410c85c92a57d356bcd5b47ff2c5de55 WatchSource:0}: Error finding container 1f976f5667413db9c62c232c84dde0dc410c85c92a57d356bcd5b47ff2c5de55: Status 404 returned error can't find the container with id 1f976f5667413db9c62c232c84dde0dc410c85c92a57d356bcd5b47ff2c5de55
Jul 24 16:29:26.509656 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:26.509620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" event={"ID":"9bf860e5-33a5-49f7-8ca8-1d03996f6f30","Type":"ContainerStarted","Data":"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"}
Jul 24 16:29:26.509656 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:26.509663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" event={"ID":"9bf860e5-33a5-49f7-8ca8-1d03996f6f30","Type":"ContainerStarted","Data":"1f976f5667413db9c62c232c84dde0dc410c85c92a57d356bcd5b47ff2c5de55"}
Jul 24 16:29:35.474386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:35.474290    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:35.474386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:35.474335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:35.488282 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:35.488254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:35.505019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:35.504973    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" podStartSLOduration=10.504959101 podStartE2EDuration="10.504959101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:29:26.526989476 +0000 UTC m=+1411.472769775" watchObservedRunningTime="2026-07-24 16:29:35.504959101 +0000 UTC m=+1420.450739399"
Jul 24 16:29:35.570819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:35.570793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:29:42.942532 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:42.942492    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:29:42.946575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:42.946554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:42.948709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:42.948690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-c3d15822-kserve-self-signed-certs\""
Jul 24 16:29:42.957251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:42.957211    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:29:43.015707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.015890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.015890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.015890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015809    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.015890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.015890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.015864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kx2\" (UniqueName: \"kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117488 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117677 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117677 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kx2\" (UniqueName: \"kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117677 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.117849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.117746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.118143 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.118111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.118273 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.118168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.118404 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.118376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.120480 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.120443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.120902 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.120866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.124800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.124778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kx2\" (UniqueName: \"kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2\") pod \"e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") " pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.257073 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.256995    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:43.397445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.397414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:29:43.399483 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:29:43.399447    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08668fd4_c3b2_494c_8efe_2b2c937b19a8.slice/crio-11561e272ea407fec33f87ef824cc13005de9a010636eb33224915098c4e1756 WatchSource:0}: Error finding container 11561e272ea407fec33f87ef824cc13005de9a010636eb33224915098c4e1756: Status 404 returned error can't find the container with id 11561e272ea407fec33f87ef824cc13005de9a010636eb33224915098c4e1756
Jul 24 16:29:43.602425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.602389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" event={"ID":"08668fd4-c3b2-494c-8efe-2b2c937b19a8","Type":"ContainerStarted","Data":"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"}
Jul 24 16:29:43.602425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.602427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" event={"ID":"08668fd4-c3b2-494c-8efe-2b2c937b19a8","Type":"ContainerStarted","Data":"11561e272ea407fec33f87ef824cc13005de9a010636eb33224915098c4e1756"}
Jul 24 16:29:43.621141 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:43.621094    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" podStartSLOduration=1.621079285 podStartE2EDuration="1.621079285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:29:43.619201145 +0000 UTC m=+1428.564981445" watchObservedRunningTime="2026-07-24 16:29:43.621079285 +0000 UTC m=+1428.566859583"
Jul 24 16:29:53.258248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:53.258153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:53.258248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:53.258198    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:53.270773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:53.270753    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:29:53.671269 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:29:53.671208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:30:27.801837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:27.801799    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:30:29.368448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:29.368411    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:30:42.820989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:42.820931    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" podUID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" containerName="main" containerID="cri-o://328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848" gracePeriod=45
Jul 24 16:30:43.079587 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.079528    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:30:43.200889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.200854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.200930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzbpf\" (UniqueName: \"kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.200992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201036    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache" (OuterVolumeSpecName: "model-cache") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:43.201330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir\") pod \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\" (UID: \"9bf860e5-33a5-49f7-8ca8-1d03996f6f30\") "
Jul 24 16:30:43.201330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201292    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home" (OuterVolumeSpecName: "home") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:43.201489 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:43.201592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201568    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.201592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201593    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.201757 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.201605    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.203272 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.203242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:30:43.203272 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.203265    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf" (OuterVolumeSpecName: "kube-api-access-hzbpf") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "kube-api-access-hzbpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:30:43.203440 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.203287    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm" (OuterVolumeSpecName: "dshm") pod "9bf860e5-33a5-49f7-8ca8-1d03996f6f30" (UID: "9bf860e5-33a5-49f7-8ca8-1d03996f6f30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:43.302137 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.302105    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzbpf\" (UniqueName: \"kubernetes.io/projected/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-kube-api-access-hzbpf\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.302137 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.302133    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.302350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.302143    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bf860e5-33a5-49f7-8ca8-1d03996f6f30-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:43.933795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.933760    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" containerID="328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848" exitCode=0
Jul 24 16:30:43.934193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.933801    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"
Jul 24 16:30:43.934193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.933839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" event={"ID":"9bf860e5-33a5-49f7-8ca8-1d03996f6f30","Type":"ContainerDied","Data":"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"}
Jul 24 16:30:43.934193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.933881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t" event={"ID":"9bf860e5-33a5-49f7-8ca8-1d03996f6f30","Type":"ContainerDied","Data":"1f976f5667413db9c62c232c84dde0dc410c85c92a57d356bcd5b47ff2c5de55"}
Jul 24 16:30:43.934193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.933897    2581 scope.go:117] "RemoveContainer" containerID="328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"
Jul 24 16:30:43.942552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.942533    2581 scope.go:117] "RemoveContainer" containerID="328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"
Jul 24 16:30:43.942819 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:30:43.942800    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848\": container with ID starting with 328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848 not found: ID does not exist" containerID="328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"
Jul 24 16:30:43.942892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.942831    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848"} err="failed to get container status \"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848\": rpc error: code = NotFound desc = could not find container \"328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848\": container with ID starting with 328527733fab501cca20b40aa8b9acb5c84dc9a9a4aeaf70a97435d6307e7848 not found: ID does not exist"
Jul 24 16:30:43.951360 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.951336    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:30:43.955424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:43.955403    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-c3d15822-kserve-6cd86474c-8p27t"]
Jul 24 16:30:44.388190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.388142    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" podUID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" containerName="main" containerID="cri-o://33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3" gracePeriod=45
Jul 24 16:30:44.646450 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.646390    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:30:44.813810 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.813775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.813974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.813821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.813974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.813842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.813974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.813912    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.814110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2kx2\" (UniqueName: \"kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.814110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814076    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache\") pod \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\" (UID: \"08668fd4-c3b2-494c-8efe-2b2c937b19a8\") "
Jul 24 16:30:44.814110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814073    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:44.814284 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814157    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home" (OuterVolumeSpecName: "home") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:44.814418 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814393    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:44.814516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814490    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.814516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814507    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.814596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.814520    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.815936 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.815915    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:30:44.816340 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.816321    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2" (OuterVolumeSpecName: "kube-api-access-l2kx2") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "kube-api-access-l2kx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:30:44.816399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.816347    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm" (OuterVolumeSpecName: "dshm") pod "08668fd4-c3b2-494c-8efe-2b2c937b19a8" (UID: "08668fd4-c3b2-494c-8efe-2b2c937b19a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:30:44.915252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.915145    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08668fd4-c3b2-494c-8efe-2b2c937b19a8-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.915252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.915173    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08668fd4-c3b2-494c-8efe-2b2c937b19a8-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.915252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.915185    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2kx2\" (UniqueName: \"kubernetes.io/projected/08668fd4-c3b2-494c-8efe-2b2c937b19a8-kube-api-access-l2kx2\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:30:44.940881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.940845    2581 generic.go:356] "Generic (PLEG): container finished" podID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" containerID="33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3" exitCode=0
Jul 24 16:30:44.941347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.940896    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"
Jul 24 16:30:44.941347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.940935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" event={"ID":"08668fd4-c3b2-494c-8efe-2b2c937b19a8","Type":"ContainerDied","Data":"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"}
Jul 24 16:30:44.941347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.940988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr" event={"ID":"08668fd4-c3b2-494c-8efe-2b2c937b19a8","Type":"ContainerDied","Data":"11561e272ea407fec33f87ef824cc13005de9a010636eb33224915098c4e1756"}
Jul 24 16:30:44.941347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.941013    2581 scope.go:117] "RemoveContainer" containerID="33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"
Jul 24 16:30:44.950219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.950202    2581 scope.go:117] "RemoveContainer" containerID="33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"
Jul 24 16:30:44.950495 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:30:44.950473    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3\": container with ID starting with 33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3 not found: ID does not exist" containerID="33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"
Jul 24 16:30:44.950548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.950501    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3"} err="failed to get container status \"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3\": rpc error: code = NotFound desc = could not find container \"33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3\": container with ID starting with 33de2cf655ce3169bc4a5c2ebdb9f2b8ea84055f903589a7c2f1c8f31c6adca3 not found: ID does not exist"
Jul 24 16:30:44.962425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.962405    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:30:44.966263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:44.966244    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-c3d15822-kserve-65bcd88d7-5f4gr"]
Jul 24 16:30:45.494608 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:45.494569    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" path="/var/lib/kubelet/pods/08668fd4-c3b2-494c-8efe-2b2c937b19a8/volumes"
Jul 24 16:30:45.494973 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:45.494958    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" path="/var/lib/kubelet/pods/9bf860e5-33a5-49f7-8ca8-1d03996f6f30/volumes"
Jul 24 16:30:55.517097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:55.517071    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:30:55.517912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:30:55.517892    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:34:08.920864 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.920827    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921264    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" containerName="main"
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921276    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" containerName="main"
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921297    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" containerName="main"
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921302    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" containerName="main"
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921372    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf860e5-33a5-49f7-8ca8-1d03996f6f30" containerName="main"
Jul 24 16:34:08.921419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.921380    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="08668fd4-c3b2-494c-8efe-2b2c937b19a8" containerName="main"
Jul 24 16:34:08.924707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.924689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.927415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.927394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3ee04f89-openshift-default-dockercfg-zblnq\""
Jul 24 16:34:08.953780 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.953751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:08.995068 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995096    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvrr\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:08.995543 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:08.995440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvrr\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.096847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.096920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.097194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.097255    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.097301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097518 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.097472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.097653 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.097638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.099115 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.099088    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.099443 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.099423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.104876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.104856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.105151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.105131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvrr\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr\") pod \"e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") " pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.234667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.234587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:09.376746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.376721    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:09.378871 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:09.378844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1ddd1a_2305_4df4_ac81_fd3cd17d6291.slice/crio-dbb421a60a118ad2e29377eecbebb4abbeb5a4718b8bc020ee9c9c62b31cf577 WatchSource:0}: Error finding container dbb421a60a118ad2e29377eecbebb4abbeb5a4718b8bc020ee9c9c62b31cf577: Status 404 returned error can't find the container with id dbb421a60a118ad2e29377eecbebb4abbeb5a4718b8bc020ee9c9c62b31cf577
Jul 24 16:34:09.381045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.381014    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:09.381109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.381081    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:09.381151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.381109    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:09.966647 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.966614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerStarted","Data":"79344ddf89b44167b5ecbba5b2a3646e6799f98cc222b90ea8f65525889b9679"}
Jul 24 16:34:09.967046 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.966667    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerStarted","Data":"dbb421a60a118ad2e29377eecbebb4abbeb5a4718b8bc020ee9c9c62b31cf577"}
Jul 24 16:34:09.990404 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:09.990354    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podStartSLOduration=1.9903396199999999 podStartE2EDuration="1.99033962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:09.98794459 +0000 UTC m=+1694.933724889" watchObservedRunningTime="2026-07-24 16:34:09.99033962 +0000 UTC m=+1694.936119917"
Jul 24 16:34:10.235111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:10.235022    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:10.240265 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:10.240242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:10.974775 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:10.974745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:10.975659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:10.975642    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:12.117058 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.117021    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:12.120220 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.120203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.122393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.122370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3ee04f89\""
Jul 24 16:34:12.122523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.122374    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3ee04f89-dockercfg-55hp9\""
Jul 24 16:34:12.130802 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.130777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:12.144958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.144929    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:12.148586 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.148567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.157607 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.157573    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:12.227181 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.227142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xql2\" (UniqueName: \"kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.227400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.227216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.227400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.227291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwt5\" (UniqueName: \"kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.227400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.227353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.328648 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.328613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xql2\" (UniqueName: \"kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.328832 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.328676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.328832 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.328704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwt5\" (UniqueName: \"kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.328832 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.328725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.329423 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.329401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.329559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.329452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.337024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.336999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwt5\" (UniqueName: \"kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5\") pod \"payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.337144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.337008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xql2\" (UniqueName: \"kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2\") pod \"payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") " pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.432047 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.431958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.460327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.460299    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:12.598940 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.598897    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:12.600683 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:12.600648    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341f87e7_063a_4423_a0a6_4b81a64ffddd.slice/crio-9f28b6ad805d730e86bb36300d709e2d24985b74e21c0d52c8f76d95253f5474 WatchSource:0}: Error finding container 9f28b6ad805d730e86bb36300d709e2d24985b74e21c0d52c8f76d95253f5474: Status 404 returned error can't find the container with id 9f28b6ad805d730e86bb36300d709e2d24985b74e21c0d52c8f76d95253f5474
Jul 24 16:34:12.628943 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.628922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:12.634304 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:12.634277    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88f0138_a7d1_41ca_b578_bf6e543b5afe.slice/crio-7f534f579fd4aeae1802f884e90e3caca7134a716ab387f8aff8e0a1293bcc3c WatchSource:0}: Error finding container 7f534f579fd4aeae1802f884e90e3caca7134a716ab387f8aff8e0a1293bcc3c: Status 404 returned error can't find the container with id 7f534f579fd4aeae1802f884e90e3caca7134a716ab387f8aff8e0a1293bcc3c
Jul 24 16:34:12.986065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.986033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" event={"ID":"341f87e7-063a-4423-a0a6-4b81a64ffddd","Type":"ContainerStarted","Data":"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"}
Jul 24 16:34:12.986297 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.986083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" event={"ID":"341f87e7-063a-4423-a0a6-4b81a64ffddd","Type":"ContainerStarted","Data":"9f28b6ad805d730e86bb36300d709e2d24985b74e21c0d52c8f76d95253f5474"}
Jul 24 16:34:12.986297 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.986196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:12.987983 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.987951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" event={"ID":"b88f0138-a7d1-41ca-b578-bf6e543b5afe","Type":"ContainerStarted","Data":"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"}
Jul 24 16:34:12.988118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:12.987997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" event={"ID":"b88f0138-a7d1-41ca-b578-bf6e543b5afe","Type":"ContainerStarted","Data":"7f534f579fd4aeae1802f884e90e3caca7134a716ab387f8aff8e0a1293bcc3c"}
Jul 24 16:34:13.003206 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:13.003159    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" podStartSLOduration=1.003143404 podStartE2EDuration="1.003143404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:13.000843768 +0000 UTC m=+1697.946624123" watchObservedRunningTime="2026-07-24 16:34:13.003143404 +0000 UTC m=+1697.948923727"
Jul 24 16:34:13.016442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:13.016395    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" podStartSLOduration=1.01638117 podStartE2EDuration="1.01638117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:13.016050257 +0000 UTC m=+1697.961830545" watchObservedRunningTime="2026-07-24 16:34:13.01638117 +0000 UTC m=+1697.962161452"
Jul 24 16:34:13.994305 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:13.994270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:23.056005 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.055970    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerID="79344ddf89b44167b5ecbba5b2a3646e6799f98cc222b90ea8f65525889b9679" exitCode=0
Jul 24 16:34:23.056544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.056049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerDied","Data":"79344ddf89b44167b5ecbba5b2a3646e6799f98cc222b90ea8f65525889b9679"}
Jul 24 16:34:23.056613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.056566    2581 scope.go:117] "RemoveContainer" containerID="79344ddf89b44167b5ecbba5b2a3646e6799f98cc222b90ea8f65525889b9679"
Jul 24 16:34:23.057606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.057578    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:23.057667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.057653    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:23.057716 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.057688    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:23.996666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:23.996558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:24.063794 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:24.063766    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerStarted","Data":"9bb4b670ec1fd76c201f24ec04fded67a6f5da90e2620dfa19da9df223516d28"}
Jul 24 16:34:24.235730 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:24.235694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:24.236918 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:24.236892    2581 patch_prober.go:28] interesting pod/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 24 16:34:24.237043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:24.236946    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 24 16:34:25.002529 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:25.002426    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:25.235709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:25.235670    2581 patch_prober.go:28] interesting pod/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 24 16:34:25.236103 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:25.235738    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 24 16:34:25.975547 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:25.975513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:26.235680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:26.235582    2581 patch_prober.go:28] interesting pod/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 24 16:34:26.235680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:26.235643    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 24 16:34:27.235672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:27.235636    2581 patch_prober.go:28] interesting pod/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 24 16:34:27.235853 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:27.235708    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 24 16:34:28.240505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:28.240473    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:28.241523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:28.241503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:47.368492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.368458    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:47.369081 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.368693    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" podUID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" containerName="payload-processing" containerID="cri-o://1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c" gracePeriod=30
Jul 24 16:34:47.373811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.373784    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:47.374054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.374025    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" podUID="341f87e7-063a-4423-a0a6-4b81a64ffddd" containerName="payload-pre-processing" containerID="cri-o://3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc" gracePeriod=30
Jul 24 16:34:47.643700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.643664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:47.675080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.675052    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:47.677029 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.677009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume\") pod \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") "
Jul 24 16:34:47.677171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.677081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xql2\" (UniqueName: \"kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2\") pod \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\" (UID: \"b88f0138-a7d1-41ca-b578-bf6e543b5afe\") "
Jul 24 16:34:47.677472 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.677439    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b88f0138-a7d1-41ca-b578-bf6e543b5afe" (UID: "b88f0138-a7d1-41ca-b578-bf6e543b5afe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:47.679119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.679097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2" (OuterVolumeSpecName: "kube-api-access-7xql2") pod "b88f0138-a7d1-41ca-b578-bf6e543b5afe" (UID: "b88f0138-a7d1-41ca-b578-bf6e543b5afe"). InnerVolumeSpecName "kube-api-access-7xql2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:47.778298 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.778263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkwt5\" (UniqueName: \"kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5\") pod \"341f87e7-063a-4423-a0a6-4b81a64ffddd\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") "
Jul 24 16:34:47.778473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.778407    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume\") pod \"341f87e7-063a-4423-a0a6-4b81a64ffddd\" (UID: \"341f87e7-063a-4423-a0a6-4b81a64ffddd\") "
Jul 24 16:34:47.778761 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.778737    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f0138-a7d1-41ca-b578-bf6e543b5afe-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.778761 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.778761    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xql2\" (UniqueName: \"kubernetes.io/projected/b88f0138-a7d1-41ca-b578-bf6e543b5afe-kube-api-access-7xql2\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.778967 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.778804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "341f87e7-063a-4423-a0a6-4b81a64ffddd" (UID: "341f87e7-063a-4423-a0a6-4b81a64ffddd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:47.780469 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.780447    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5" (OuterVolumeSpecName: "kube-api-access-vkwt5") pod "341f87e7-063a-4423-a0a6-4b81a64ffddd" (UID: "341f87e7-063a-4423-a0a6-4b81a64ffddd"). InnerVolumeSpecName "kube-api-access-vkwt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:47.880101 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.880011    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/341f87e7-063a-4423-a0a6-4b81a64ffddd-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:47.880101 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:47.880044    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkwt5\" (UniqueName: \"kubernetes.io/projected/341f87e7-063a-4423-a0a6-4b81a64ffddd-kube-api-access-vkwt5\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:48.191708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.191612    2581 generic.go:356] "Generic (PLEG): container finished" podID="341f87e7-063a-4423-a0a6-4b81a64ffddd" containerID="3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc" exitCode=0
Jul 24 16:34:48.191708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.191658    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"
Jul 24 16:34:48.191708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.191700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" event={"ID":"341f87e7-063a-4423-a0a6-4b81a64ffddd","Type":"ContainerDied","Data":"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"}
Jul 24 16:34:48.191989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.191750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5" event={"ID":"341f87e7-063a-4423-a0a6-4b81a64ffddd","Type":"ContainerDied","Data":"9f28b6ad805d730e86bb36300d709e2d24985b74e21c0d52c8f76d95253f5474"}
Jul 24 16:34:48.191989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.191768    2581 scope.go:117] "RemoveContainer" containerID="3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"
Jul 24 16:34:48.193232 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.193205    2581 generic.go:356] "Generic (PLEG): container finished" podID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" containerID="1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c" exitCode=0
Jul 24 16:34:48.193348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.193281    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"
Jul 24 16:34:48.193401 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.193257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" event={"ID":"b88f0138-a7d1-41ca-b578-bf6e543b5afe","Type":"ContainerDied","Data":"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"}
Jul 24 16:34:48.193441 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.193413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl" event={"ID":"b88f0138-a7d1-41ca-b578-bf6e543b5afe","Type":"ContainerDied","Data":"7f534f579fd4aeae1802f884e90e3caca7134a716ab387f8aff8e0a1293bcc3c"}
Jul 24 16:34:48.201137 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.201118    2581 scope.go:117] "RemoveContainer" containerID="3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"
Jul 24 16:34:48.201436 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:34:48.201412    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc\": container with ID starting with 3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc not found: ID does not exist" containerID="3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"
Jul 24 16:34:48.201531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.201443    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc"} err="failed to get container status \"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc\": rpc error: code = NotFound desc = could not find container \"3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc\": container with ID starting with 3db57ec6459b91525dde49547289a8b4799f8b55be8a67fe896e3183950ecdcc not found: ID does not exist"
Jul 24 16:34:48.201531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.201460    2581 scope.go:117] "RemoveContainer" containerID="1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"
Jul 24 16:34:48.209830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.209812    2581 scope.go:117] "RemoveContainer" containerID="1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"
Jul 24 16:34:48.210044 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:34:48.210026    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c\": container with ID starting with 1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c not found: ID does not exist" containerID="1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"
Jul 24 16:34:48.210090 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.210052    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c"} err="failed to get container status \"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c\": rpc error: code = NotFound desc = could not find container \"1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c\": container with ID starting with 1078266b3b3477007da7b26875146eab9d6cb917f62c16d3e2570a3256a4109c not found: ID does not exist"
Jul 24 16:34:48.214653 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.214632    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:48.218528 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.218507    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3ee04f89-6fc48dfffb-mgmm5"]
Jul 24 16:34:48.229171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.229152    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:48.232644 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:48.232623    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3ee04f89-78fcff7f5b-6m9gl"]
Jul 24 16:34:49.487332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:49.487293    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="341f87e7-063a-4423-a0a6-4b81a64ffddd" path="/var/lib/kubelet/pods/341f87e7-063a-4423-a0a6-4b81a64ffddd/volumes"
Jul 24 16:34:49.487870 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:49.487850    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" path="/var/lib/kubelet/pods/b88f0138-a7d1-41ca-b578-bf6e543b5afe/volumes"
Jul 24 16:34:52.112892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:52.112853    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:52.113329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:52.113076    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy" containerID="cri-o://9bb4b670ec1fd76c201f24ec04fded67a6f5da90e2620dfa19da9df223516d28" gracePeriod=30
Jul 24 16:34:53.103014 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.102973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:34:53.103453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103437    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" containerName="payload-processing"
Jul 24 16:34:53.103453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103455    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" containerName="payload-processing"
Jul 24 16:34:53.103611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103477    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341f87e7-063a-4423-a0a6-4b81a64ffddd" containerName="payload-pre-processing"
Jul 24 16:34:53.103611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103483    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="341f87e7-063a-4423-a0a6-4b81a64ffddd" containerName="payload-pre-processing"
Jul 24 16:34:53.103611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103551    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f0138-a7d1-41ca-b578-bf6e543b5afe" containerName="payload-processing"
Jul 24 16:34:53.103611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.103560    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="341f87e7-063a-4423-a0a6-4b81a64ffddd" containerName="payload-pre-processing"
Jul 24 16:34:53.108370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.108348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.111334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.111299    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b12e1c2f-gw-openshift-default-dockercfg-dvhqc\""
Jul 24 16:34:53.121354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.121332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:34:53.232986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.232953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.232986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.232988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.233483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.233386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llkdh\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llkdh\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334642 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.334903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.335050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.335050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.334969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.335122 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.335094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.335184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.335166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.335520 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.335496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.337023 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.337002    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.337109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.337056    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.343036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.343009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.343631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.343608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llkdh\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh\") pod \"e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") " pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.419431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.419351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:53.568625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.568598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:34:53.570363 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:53.570335    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf115b4e3_a077_44ad_8779_fbeba301a522.slice/crio-dbf8adb29545fdaa5bb41fa1664948021a91d1facbf26031e96e2a92d19d8ac2 WatchSource:0}: Error finding container dbf8adb29545fdaa5bb41fa1664948021a91d1facbf26031e96e2a92d19d8ac2: Status 404 returned error can't find the container with id dbf8adb29545fdaa5bb41fa1664948021a91d1facbf26031e96e2a92d19d8ac2
Jul 24 16:34:53.572963 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.572924    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:53.573074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.572999    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:53.573074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:53.573047    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:34:54.230214 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:54.230177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerStarted","Data":"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"}
Jul 24 16:34:54.230637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:54.230269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerStarted","Data":"dbf8adb29545fdaa5bb41fa1664948021a91d1facbf26031e96e2a92d19d8ac2"}
Jul 24 16:34:54.251849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:54.251802    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podStartSLOduration=1.251788279 podStartE2EDuration="1.251788279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:54.249351942 +0000 UTC m=+1739.195132239" watchObservedRunningTime="2026-07-24 16:34:54.251788279 +0000 UTC m=+1739.197568577"
Jul 24 16:34:54.420612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:54.420582    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:54.425674 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:54.425648    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:55.235093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:55.235062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:55.236022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:55.236005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:34:56.458942 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.458907    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:34:56.463744 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.463719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.466320 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.466303    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b12e1c2f-dockercfg-4cqfl\""
Jul 24 16:34:56.466436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.466423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b12e1c2f\""
Jul 24 16:34:56.471632 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.471609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:34:56.499689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.499654    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:34:56.505364 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.505337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.515818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.515427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:34:56.567827 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.567787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.568045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.567854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.568045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.567940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpq2\" (UniqueName: \"kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.568045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.568029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qww\" (UniqueName: \"kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.669249 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.669183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.669432 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.669269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.669432 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.669297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpq2\" (UniqueName: \"kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.669432 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.669349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qww\" (UniqueName: \"kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.670036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.670014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.670125 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.670101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.678731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.678699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qww\" (UniqueName: \"kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww\") pod \"payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") " pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.678831 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.678743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpq2\" (UniqueName: \"kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2\") pod \"payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.775734 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.775702    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:56.820142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.820112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:56.937011 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.936776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:34:56.938751 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:56.938708    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e7072a_6528_4fcc_a3ba_5ce00ef92f5e.slice/crio-770bd644e58c2d18b5283c6acc23ef0a1287dbaeb8669b8b5abbf3fd10f7964f WatchSource:0}: Error finding container 770bd644e58c2d18b5283c6acc23ef0a1287dbaeb8669b8b5abbf3fd10f7964f: Status 404 returned error can't find the container with id 770bd644e58c2d18b5283c6acc23ef0a1287dbaeb8669b8b5abbf3fd10f7964f
Jul 24 16:34:56.997054 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:56.997025    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:34:56.998247 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:34:56.998206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06250cd4_481f_4948_b6e0_c6877efb24d9.slice/crio-cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668 WatchSource:0}: Error finding container cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668: Status 404 returned error can't find the container with id cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668
Jul 24 16:34:57.247234 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.247179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" event={"ID":"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e","Type":"ContainerStarted","Data":"149f485d33fc4b00d3ed173f84fd34158c92c2662ca452d66e2375881fdb9dce"}
Jul 24 16:34:57.247395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.247275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:34:57.247395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.247311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" event={"ID":"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e","Type":"ContainerStarted","Data":"770bd644e58c2d18b5283c6acc23ef0a1287dbaeb8669b8b5abbf3fd10f7964f"}
Jul 24 16:34:57.249178 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.249151    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerID="9bb4b670ec1fd76c201f24ec04fded67a6f5da90e2620dfa19da9df223516d28" exitCode=0
Jul 24 16:34:57.249302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.249250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerDied","Data":"9bb4b670ec1fd76c201f24ec04fded67a6f5da90e2620dfa19da9df223516d28"}
Jul 24 16:34:57.249302 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.249299    2581 scope.go:117] "RemoveContainer" containerID="79344ddf89b44167b5ecbba5b2a3646e6799f98cc222b90ea8f65525889b9679"
Jul 24 16:34:57.250940 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.250912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" event={"ID":"06250cd4-481f-4948-b6e0-c6877efb24d9","Type":"ContainerStarted","Data":"4f01f87c99106808c1c42fa28f426b6ff815f0e967655c5d27db27cb40e84631"}
Jul 24 16:34:57.251023 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.250970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" event={"ID":"06250cd4-481f-4948-b6e0-c6877efb24d9","Type":"ContainerStarted","Data":"cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668"}
Jul 24 16:34:57.251023 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.251001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:34:57.266057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.266010    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" podStartSLOduration=1.265995634 podStartE2EDuration="1.265995634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:57.264093235 +0000 UTC m=+1742.209873538" watchObservedRunningTime="2026-07-24 16:34:57.265995634 +0000 UTC m=+1742.211776010"
Jul 24 16:34:57.281468 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.281427    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" podStartSLOduration=1.281408494 podStartE2EDuration="1.281408494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:34:57.279874771 +0000 UTC m=+1742.225655070" watchObservedRunningTime="2026-07-24 16:34:57.281408494 +0000 UTC m=+1742.227188792"
Jul 24 16:34:57.356856 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.356830    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:57.476665 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476764    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476785    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476921    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.476991    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgvrr\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr\") pod \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\" (UID: \"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291\") "
Jul 24 16:34:57.477121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477083    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477178    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477400    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477461    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477488    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477497    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.477717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.477516    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.479190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.479165    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:57.479190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.479174    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:34:57.479354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.479197    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr" (OuterVolumeSpecName: "kube-api-access-jgvrr") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "kube-api-access-jgvrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:34:57.479354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.479210    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" (UID: "6f1ddd1a-2305-4df4-ac81-fd3cd17d6291"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:34:57.578328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578295    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.578328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578323    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.578328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578333    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.578546 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578341    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.578546 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578349    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:57.578546 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:57.578360    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgvrr\" (UniqueName: \"kubernetes.io/projected/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291-kube-api-access-jgvrr\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:34:58.257559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:58.257519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64" event={"ID":"6f1ddd1a-2305-4df4-ac81-fd3cd17d6291","Type":"ContainerDied","Data":"dbb421a60a118ad2e29377eecbebb4abbeb5a4718b8bc020ee9c9c62b31cf577"}
Jul 24 16:34:58.257763 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:58.257584    2581 scope.go:117] "RemoveContainer" containerID="9bb4b670ec1fd76c201f24ec04fded67a6f5da90e2620dfa19da9df223516d28"
Jul 24 16:34:58.257763 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:58.257585    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"
Jul 24 16:34:58.276080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:58.276055    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:58.283811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:58.283787    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3ee04f89-openshift-default-7f458b88fb-9wk64"]
Jul 24 16:34:59.488797 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:34:59.488758    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" path="/var/lib/kubelet/pods/6f1ddd1a-2305-4df4-ac81-fd3cd17d6291/volumes"
Jul 24 16:35:08.260356 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:08.260324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:35:08.260771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:08.260398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:35:10.236688 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.236650    2581 patch_prober.go:28] interesting pod/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 24 16:35:10.237096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.236716    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 24 16:35:10.340515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.340485    2581 generic.go:356] "Generic (PLEG): container finished" podID="f115b4e3-a077-44ad-8779-fbeba301a522" containerID="6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d" exitCode=0
Jul 24 16:35:10.340685 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.340555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerDied","Data":"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"}
Jul 24 16:35:10.341002 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.340983    2581 scope.go:117] "RemoveContainer" containerID="6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"
Jul 24 16:35:10.342008 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.341980    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:10.342059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.342048    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:10.342095 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:10.342087    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:11.348934 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:11.348900    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerStarted","Data":"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"}
Jul 24 16:35:11.419949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:11.419915    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:11.420192 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:11.420163    2581 patch_prober.go:28] interesting pod/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 24 16:35:11.420276 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:11.420236    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 24 16:35:12.420159 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:12.420125    2581 patch_prober.go:28] interesting pod/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 24 16:35:12.420600 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:12.420179    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 24 16:35:13.420532 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:13.420497    2581 patch_prober.go:28] interesting pod/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 24 16:35:13.420908 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:13.420558    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 24 16:35:14.420110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:14.420065    2581 patch_prober.go:28] interesting pod/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 24 16:35:14.420315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:14.420129    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 24 16:35:15.423378 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:15.423351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:15.423827 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:15.423783    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:15.424434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:15.424414    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:31.179389 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.179353    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:35:31.179972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.179603    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" podUID="06250cd4-481f-4948-b6e0-c6877efb24d9" containerName="payload-processing" containerID="cri-o://4f01f87c99106808c1c42fa28f426b6ff815f0e967655c5d27db27cb40e84631" gracePeriod=30
Jul 24 16:35:31.187415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.187375    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:35:31.187650 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.187606    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" podUID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" containerName="payload-pre-processing" containerID="cri-o://149f485d33fc4b00d3ed173f84fd34158c92c2662ca452d66e2375881fdb9dce" gracePeriod=30
Jul 24 16:35:31.453124 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.453097    2581 generic.go:356] "Generic (PLEG): container finished" podID="06250cd4-481f-4948-b6e0-c6877efb24d9" containerID="4f01f87c99106808c1c42fa28f426b6ff815f0e967655c5d27db27cb40e84631" exitCode=0
Jul 24 16:35:31.453295 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.453135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" event={"ID":"06250cd4-481f-4948-b6e0-c6877efb24d9","Type":"ContainerDied","Data":"4f01f87c99106808c1c42fa28f426b6ff815f0e967655c5d27db27cb40e84631"}
Jul 24 16:35:31.453295 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.453188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch" event={"ID":"06250cd4-481f-4948-b6e0-c6877efb24d9","Type":"ContainerDied","Data":"cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668"}
Jul 24 16:35:31.453295 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.453204    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbd3a99f876f20b65f67f48a63869649bdc08724682cc0a27983b2126ab3a668"
Jul 24 16:35:31.454917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.454895    2581 generic.go:356] "Generic (PLEG): container finished" podID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" containerID="149f485d33fc4b00d3ed173f84fd34158c92c2662ca452d66e2375881fdb9dce" exitCode=0
Jul 24 16:35:31.455026 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.454926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" event={"ID":"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e","Type":"ContainerDied","Data":"149f485d33fc4b00d3ed173f84fd34158c92c2662ca452d66e2375881fdb9dce"}
Jul 24 16:35:31.462373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.462354    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:35:31.493576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.493550    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:35:31.516250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.516211    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume\") pod \"06250cd4-481f-4948-b6e0-c6877efb24d9\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") "
Jul 24 16:35:31.516395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.516317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9qww\" (UniqueName: \"kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww\") pod \"06250cd4-481f-4948-b6e0-c6877efb24d9\" (UID: \"06250cd4-481f-4948-b6e0-c6877efb24d9\") "
Jul 24 16:35:31.516636 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.516604    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06250cd4-481f-4948-b6e0-c6877efb24d9" (UID: "06250cd4-481f-4948-b6e0-c6877efb24d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:31.518485 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.518458    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww" (OuterVolumeSpecName: "kube-api-access-z9qww") pod "06250cd4-481f-4948-b6e0-c6877efb24d9" (UID: "06250cd4-481f-4948-b6e0-c6877efb24d9"). InnerVolumeSpecName "kube-api-access-z9qww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:31.617120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.617087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wpq2\" (UniqueName: \"kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2\") pod \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") "
Jul 24 16:35:31.617316 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.617192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume\") pod \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\" (UID: \"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e\") "
Jul 24 16:35:31.617582 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.617562    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06250cd4-481f-4948-b6e0-c6877efb24d9-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.617582 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.617583    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9qww\" (UniqueName: \"kubernetes.io/projected/06250cd4-481f-4948-b6e0-c6877efb24d9-kube-api-access-z9qww\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.617729 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.617571    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" (UID: "15e7072a-6528-4fcc-a3ba-5ce00ef92f5e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:31.619540 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.619519    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2" (OuterVolumeSpecName: "kube-api-access-2wpq2") pod "15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" (UID: "15e7072a-6528-4fcc-a3ba-5ce00ef92f5e"). InnerVolumeSpecName "kube-api-access-2wpq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:31.719123 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.719035    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:31.719123 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:31.719065    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wpq2\" (UniqueName: \"kubernetes.io/projected/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e-kube-api-access-2wpq2\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:32.461911 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.461825    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"
Jul 24 16:35:32.461911 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.461870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7" event={"ID":"15e7072a-6528-4fcc-a3ba-5ce00ef92f5e","Type":"ContainerDied","Data":"770bd644e58c2d18b5283c6acc23ef0a1287dbaeb8669b8b5abbf3fd10f7964f"}
Jul 24 16:35:32.462525 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.461922    2581 scope.go:117] "RemoveContainer" containerID="149f485d33fc4b00d3ed173f84fd34158c92c2662ca452d66e2375881fdb9dce"
Jul 24 16:35:32.462525 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.462055    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"
Jul 24 16:35:32.485409 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.485387    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:35:32.489486 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.489463    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b12e1c2f-6f6d5bcc85-jwbch"]
Jul 24 16:35:32.497844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.497821    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:35:32.499675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:32.499654    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b12e1c2f-5765857b96-z7xt7"]
Jul 24 16:35:33.488459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:33.488422    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06250cd4-481f-4948-b6e0-c6877efb24d9" path="/var/lib/kubelet/pods/06250cd4-481f-4948-b6e0-c6877efb24d9/volumes"
Jul 24 16:35:33.488921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:33.488903    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" path="/var/lib/kubelet/pods/15e7072a-6528-4fcc-a3ba-5ce00ef92f5e/volumes"
Jul 24 16:35:35.912322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:35.912287    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:35:35.912796 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:35.912532    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy" containerID="cri-o://13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b" gracePeriod=30
Jul 24 16:35:36.704482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.704447    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:35:36.705072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705053    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" containerName="payload-pre-processing"
Jul 24 16:35:36.705072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705073    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" containerName="payload-pre-processing"
Jul 24 16:35:36.705250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705092    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06250cd4-481f-4948-b6e0-c6877efb24d9" containerName="payload-processing"
Jul 24 16:35:36.705250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705101    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06250cd4-481f-4948-b6e0-c6877efb24d9" containerName="payload-processing"
Jul 24 16:35:36.705250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705118    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:36.705250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705127    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:36.705474 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705253    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:36.705474 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705271    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e7072a-6528-4fcc-a3ba-5ce00ef92f5e" containerName="payload-pre-processing"
Jul 24 16:35:36.705474 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.705280    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06250cd4-481f-4948-b6e0-c6877efb24d9" containerName="payload-processing"
Jul 24 16:35:36.709668 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.709644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.712095 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.712074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9c399289-openshift-default-dockercfg-qd88r\""
Jul 24 16:35:36.722435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.722407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:35:36.769698 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.769834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.769834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.769834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.769834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.769834 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.770004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.770004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.770004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.769940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvdd\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871199 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871199 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871517 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvdd\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871978 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.871978 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.871822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.872364 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.872343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.873884 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.873754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.874360 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.874333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.879958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.879936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:36.880165 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:36.880145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvdd\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd\") pod \"e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") " pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:37.022957 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.022925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:37.164648 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.164618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:35:37.165915 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:35:37.165889    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab3b4ab_5225_4cd5_ace7_752acaeebc74.slice/crio-9cd9a16c8bdea6afd9e95c0fe099c8385b9b22e63b82ca524e8f0e54649895c9 WatchSource:0}: Error finding container 9cd9a16c8bdea6afd9e95c0fe099c8385b9b22e63b82ca524e8f0e54649895c9: Status 404 returned error can't find the container with id 9cd9a16c8bdea6afd9e95c0fe099c8385b9b22e63b82ca524e8f0e54649895c9
Jul 24 16:35:37.168111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.168062    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:37.168208 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.168157    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:37.168275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.168201    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:37.490641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.490544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerStarted","Data":"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"}
Jul 24 16:35:37.490641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.490602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerStarted","Data":"9cd9a16c8bdea6afd9e95c0fe099c8385b9b22e63b82ca524e8f0e54649895c9"}
Jul 24 16:35:37.508865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:37.508812    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podStartSLOduration=1.508796549 podStartE2EDuration="1.508796549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:35:37.50762152 +0000 UTC m=+1782.453401818" watchObservedRunningTime="2026-07-24 16:35:37.508796549 +0000 UTC m=+1782.454576847"
Jul 24 16:35:38.023955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:38.023925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:38.028806 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:38.028782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:38.497036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:38.496957    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:38.498057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:38.498041    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:39.746913 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.746879    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:35:39.747362 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.747348    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:39.747415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.747363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:39.747451 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.747421    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ddd1a-2305-4df4-ac81-fd3cd17d6291" containerName="istio-proxy"
Jul 24 16:35:39.750544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.750527    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:39.752832 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.752812    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9c399289\""
Jul 24 16:35:39.752946 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.752859    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9c399289-dockercfg-gql45\""
Jul 24 16:35:39.762764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.762745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:35:39.901774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.901743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:39.901935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:39.901814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbfvd\" (UniqueName: \"kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.002484 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.002395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.002484 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.002458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbfvd\" (UniqueName: \"kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.003067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.003046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.014809 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.014779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbfvd\" (UniqueName: \"kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd\") pod \"payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.061894 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.061867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.216163 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.216141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:35:40.218100 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:35:40.218080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8a9a09_95a3_4755_9574_c592773529e2.slice/crio-62b84e386ac877d06844e72b9b03323d5cd262f415a7bc9b64a3cd9b9e90f521 WatchSource:0}: Error finding container 62b84e386ac877d06844e72b9b03323d5cd262f415a7bc9b64a3cd9b9e90f521: Status 404 returned error can't find the container with id 62b84e386ac877d06844e72b9b03323d5cd262f415a7bc9b64a3cd9b9e90f521
Jul 24 16:35:40.508043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.508007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" event={"ID":"1a8a9a09-95a3-4755-9574-c592773529e2","Type":"ContainerStarted","Data":"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"}
Jul 24 16:35:40.508203 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.508070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" event={"ID":"1a8a9a09-95a3-4755-9574-c592773529e2","Type":"ContainerStarted","Data":"62b84e386ac877d06844e72b9b03323d5cd262f415a7bc9b64a3cd9b9e90f521"}
Jul 24 16:35:40.508203 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.508193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:40.525626 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:40.525523    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" podStartSLOduration=1.525507305 podStartE2EDuration="1.525507305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:35:40.523767999 +0000 UTC m=+1785.469548296" watchObservedRunningTime="2026-07-24 16:35:40.525507305 +0000 UTC m=+1785.471287602"
Jul 24 16:35:41.174995 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.174921    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:41.316793 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316765    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316925    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.316966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316946    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.317345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.316999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.317345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llkdh\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh\") pod \"f115b4e3-a077-44ad-8779-fbeba301a522\" (UID: \"f115b4e3-a077-44ad-8779-fbeba301a522\") "
Jul 24 16:35:41.317345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:35:41.317345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:35:41.317541 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317449    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.317603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:35:41.317603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317466    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f115b4e3-a077-44ad-8779-fbeba301a522-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.317603 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:35:41.317825 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.317805    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data" (OuterVolumeSpecName: "istio-data") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:35:41.319053 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.319021    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:35:41.319271 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.319248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:35:41.319506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.319488    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh" (OuterVolumeSpecName: "kube-api-access-llkdh") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "kube-api-access-llkdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:41.319597 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.319578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token" (OuterVolumeSpecName: "istio-token") pod "f115b4e3-a077-44ad-8779-fbeba301a522" (UID: "f115b4e3-a077-44ad-8779-fbeba301a522"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:35:41.418394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418362    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418390    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llkdh\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-kube-api-access-llkdh\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418399    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418408    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418416    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f115b4e3-a077-44ad-8779-fbeba301a522-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418424    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f115b4e3-a077-44ad-8779-fbeba301a522-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.418613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.418431    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f115b4e3-a077-44ad-8779-fbeba301a522-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:35:41.515076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.515040    2581 generic.go:356] "Generic (PLEG): container finished" podID="f115b4e3-a077-44ad-8779-fbeba301a522" containerID="13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b" exitCode=0
Jul 24 16:35:41.515253 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.515104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerDied","Data":"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"}
Jul 24 16:35:41.515253 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.515132    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"
Jul 24 16:35:41.515253 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.515156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq" event={"ID":"f115b4e3-a077-44ad-8779-fbeba301a522","Type":"ContainerDied","Data":"dbf8adb29545fdaa5bb41fa1664948021a91d1facbf26031e96e2a92d19d8ac2"}
Jul 24 16:35:41.515253 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.515189    2581 scope.go:117] "RemoveContainer" containerID="13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"
Jul 24 16:35:41.524487 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.524466    2581 scope.go:117] "RemoveContainer" containerID="6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"
Jul 24 16:35:41.533843 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.533825    2581 scope.go:117] "RemoveContainer" containerID="13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"
Jul 24 16:35:41.534131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.534108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:35:41.534214 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:35:41.534107    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b\": container with ID starting with 13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b not found: ID does not exist" containerID="13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"
Jul 24 16:35:41.534214 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.534168    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b"} err="failed to get container status \"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b\": rpc error: code = NotFound desc = could not find container \"13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b\": container with ID starting with 13f79b5c043251c65715923aa9a0cf1111636816583ad1314be9296383b2e64b not found: ID does not exist"
Jul 24 16:35:41.534214 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.534190    2581 scope.go:117] "RemoveContainer" containerID="6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"
Jul 24 16:35:41.534532 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:35:41.534503    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d\": container with ID starting with 6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d not found: ID does not exist" containerID="6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"
Jul 24 16:35:41.534612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.534553    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d"} err="failed to get container status \"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d\": rpc error: code = NotFound desc = could not find container \"6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d\": container with ID starting with 6706d2a5d3b2c013e04dfb2c240276c43ed34bfc98bdac82b43a2d693da7e28d not found: ID does not exist"
Jul 24 16:35:41.537376 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:41.537352    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b12e1c2f-gw-openshift-default-597545df4d-h4jtq"]
Jul 24 16:35:43.488159 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:43.488124    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" path="/var/lib/kubelet/pods/f115b4e3-a077-44ad-8779-fbeba301a522/volumes"
Jul 24 16:35:51.517781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:51.517745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:35:53.826324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:53.825954    2581 patch_prober.go:28] interesting pod/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:51116->10.132.0.60:15021: read: connection reset by peer" start-of-body=
Jul 24 16:35:53.826324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:53.826030    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": read tcp 10.132.0.2:51116->10.132.0.60:15021: read: connection reset by peer"
Jul 24 16:35:54.587409 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.587377    2581 generic.go:356] "Generic (PLEG): container finished" podID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerID="f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93" exitCode=0
Jul 24 16:35:54.587626 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.587443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerDied","Data":"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"}
Jul 24 16:35:54.587909 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.587892    2581 scope.go:117] "RemoveContainer" containerID="f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"
Jul 24 16:35:54.589094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.589064    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:54.589171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.589147    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:54.589212 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:54.589185    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:35:55.551386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:55.551355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:35:55.552659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:55.552637    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:35:55.611673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:55.611632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerStarted","Data":"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"}
Jul 24 16:35:56.023596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:56.023553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:35:56.023809 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:56.023787    2581 patch_prober.go:28] interesting pod/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:35:56.023859 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:56.023836    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 16:35:57.023906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:57.023872    2581 patch_prober.go:28] interesting pod/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:35:57.024357 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:57.023943    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 16:35:58.024000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:58.023963    2581 patch_prober.go:28] interesting pod/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:35:58.024461 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:58.024018    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 16:35:59.024459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:59.024419    2581 patch_prober.go:28] interesting pod/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 24 16:35:59.024947 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:35:59.024489    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 24 16:36:00.027555 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:00.027523    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:36:00.028015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:00.027833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:36:00.028666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:00.028648    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:36:15.152862 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.152826    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:36:15.153628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.153129    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" podUID="1a8a9a09-95a3-4755-9574-c592773529e2" containerName="payload-pre-processing" containerID="cri-o://698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395" gracePeriod=30
Jul 24 16:36:15.420332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.420302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:36:15.539189 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.539158    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbfvd\" (UniqueName: \"kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd\") pod \"1a8a9a09-95a3-4755-9574-c592773529e2\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") "
Jul 24 16:36:15.539401 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.539327    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume\") pod \"1a8a9a09-95a3-4755-9574-c592773529e2\" (UID: \"1a8a9a09-95a3-4755-9574-c592773529e2\") "
Jul 24 16:36:15.539725 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.539702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a8a9a09-95a3-4755-9574-c592773529e2" (UID: "1a8a9a09-95a3-4755-9574-c592773529e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:15.541412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.541381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd" (OuterVolumeSpecName: "kube-api-access-mbfvd") pod "1a8a9a09-95a3-4755-9574-c592773529e2" (UID: "1a8a9a09-95a3-4755-9574-c592773529e2"). InnerVolumeSpecName "kube-api-access-mbfvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:15.640477 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.640447    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a8a9a09-95a3-4755-9574-c592773529e2-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.640477 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.640472    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbfvd\" (UniqueName: \"kubernetes.io/projected/1a8a9a09-95a3-4755-9574-c592773529e2-kube-api-access-mbfvd\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:15.715379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.715288    2581 generic.go:356] "Generic (PLEG): container finished" podID="1a8a9a09-95a3-4755-9574-c592773529e2" containerID="698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395" exitCode=0
Jul 24 16:36:15.715379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.715354    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"
Jul 24 16:36:15.715551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.715365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" event={"ID":"1a8a9a09-95a3-4755-9574-c592773529e2","Type":"ContainerDied","Data":"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"}
Jul 24 16:36:15.715551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.715436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq" event={"ID":"1a8a9a09-95a3-4755-9574-c592773529e2","Type":"ContainerDied","Data":"62b84e386ac877d06844e72b9b03323d5cd262f415a7bc9b64a3cd9b9e90f521"}
Jul 24 16:36:15.715551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.715461    2581 scope.go:117] "RemoveContainer" containerID="698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"
Jul 24 16:36:15.725212 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.725196    2581 scope.go:117] "RemoveContainer" containerID="698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"
Jul 24 16:36:15.725511 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:36:15.725491    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395\": container with ID starting with 698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395 not found: ID does not exist" containerID="698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"
Jul 24 16:36:15.725577 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.725519    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395"} err="failed to get container status \"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395\": rpc error: code = NotFound desc = could not find container \"698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395\": container with ID starting with 698232d8ba335298a3feecc10d419ecec5705d0c59f42246e0ada2bd804ff395 not found: ID does not exist"
Jul 24 16:36:15.737156 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.737123    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:36:15.741324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:15.741303    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9c399289-78d58bc9d4-94hwq"]
Jul 24 16:36:17.488332 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:17.488294    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8a9a09-95a3-4755-9574-c592773529e2" path="/var/lib/kubelet/pods/1a8a9a09-95a3-4755-9574-c592773529e2/volumes"
Jul 24 16:36:20.918245 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:20.918185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:36:20.918747 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:20.918413    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy" containerID="cri-o://a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5" gracePeriod=30
Jul 24 16:36:21.711275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.711210    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:36:21.711919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.711896    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8a9a09-95a3-4755-9574-c592773529e2" containerName="payload-pre-processing"
Jul 24 16:36:21.712103 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712080    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8a9a09-95a3-4755-9574-c592773529e2" containerName="payload-pre-processing"
Jul 24 16:36:21.712247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712110    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.712247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712120    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.712247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712130    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.712247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712139    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.712483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712305    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.712483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8a9a09-95a3-4755-9574-c592773529e2" containerName="payload-pre-processing"
Jul 24 16:36:21.712483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.712331    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f115b4e3-a077-44ad-8779-fbeba301a522" containerName="istio-proxy"
Jul 24 16:36:21.717147 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.717122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.719598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.719577    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-13a053f7-openshift-default-dockercfg-sd5ls\""
Jul 24 16:36:21.739421 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.732871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:36:21.799940 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.799902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.799940 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.799942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.799979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800211 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800461 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800461 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlmj\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.800461 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.800313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.900815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901003 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901003 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlmj\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901003 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901003 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901003 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.900970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901562 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901533    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901685 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901753 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.901818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.901794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.903219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.903201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.903483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.903463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.908520 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.908492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:21.908791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:21.908775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlmj\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj\") pod \"e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") " pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:22.028924 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.028890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:22.174560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.174534    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:36:22.176395 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:36:22.176369    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3052a31e_aebb_4841_bc42_20442d8b4de5.slice/crio-7029620d41bf21d9600db2dade151df61869f6e60a20a15eae4060b960f6bf2a WatchSource:0}: Error finding container 7029620d41bf21d9600db2dade151df61869f6e60a20a15eae4060b960f6bf2a: Status 404 returned error can't find the container with id 7029620d41bf21d9600db2dade151df61869f6e60a20a15eae4060b960f6bf2a
Jul 24 16:36:22.179190 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.179146    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:22.179340 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.179253    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:22.179340 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.179299    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:22.769482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.769449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerStarted","Data":"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"}
Jul 24 16:36:22.769720 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.769511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerStarted","Data":"7029620d41bf21d9600db2dade151df61869f6e60a20a15eae4060b960f6bf2a"}
Jul 24 16:36:22.791473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:22.791415    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podStartSLOduration=1.791396969 podStartE2EDuration="1.791396969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:22.789373456 +0000 UTC m=+1827.735153756" watchObservedRunningTime="2026-07-24 16:36:22.791396969 +0000 UTC m=+1827.737177267"
Jul 24 16:36:23.029670 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:23.029583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:23.034721 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:23.034694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:23.774817 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:23.774788    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:23.775808 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:23.775789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:26.169889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.169863    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:36:26.245074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.244993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245036    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245300 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245300 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245300 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245168    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245300 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttvdd\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245350    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245351    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:26.245506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:26.245506 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245427    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo\") pod \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\" (UID: \"2ab3b4ab-5225-4cd5-ace7-752acaeebc74\") "
Jul 24 16:36:26.245749 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245573    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:26.245749 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245639    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:26.245847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245796    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.245847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245815    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.245847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245838    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.245986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.245856    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.246148 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.246121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:26.247558 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.247530    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd" (OuterVolumeSpecName: "kube-api-access-ttvdd") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "kube-api-access-ttvdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:26.247558 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.247546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:36:26.247816 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.247785    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:36:26.247911 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.247851    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ab3b4ab-5225-4cd5-ace7-752acaeebc74" (UID: "2ab3b4ab-5225-4cd5-ace7-752acaeebc74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:36:26.346811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.346776    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttvdd\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-kube-api-access-ttvdd\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.346811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.346804    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.346811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.346815    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.347060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.346827    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.347060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.346836    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ab3b4ab-5225-4cd5-ace7-752acaeebc74-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:26.793136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.793097    2581 generic.go:356] "Generic (PLEG): container finished" podID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerID="a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5" exitCode=0
Jul 24 16:36:26.793136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.793141    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"
Jul 24 16:36:26.793406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.793174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerDied","Data":"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"}
Jul 24 16:36:26.793406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.793237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc" event={"ID":"2ab3b4ab-5225-4cd5-ace7-752acaeebc74","Type":"ContainerDied","Data":"9cd9a16c8bdea6afd9e95c0fe099c8385b9b22e63b82ca524e8f0e54649895c9"}
Jul 24 16:36:26.793406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.793259    2581 scope.go:117] "RemoveContainer" containerID="a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"
Jul 24 16:36:26.810957 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.810938    2581 scope.go:117] "RemoveContainer" containerID="f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"
Jul 24 16:36:26.818816 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.818795    2581 scope.go:117] "RemoveContainer" containerID="a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"
Jul 24 16:36:26.819087 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:36:26.819067    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5\": container with ID starting with a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5 not found: ID does not exist" containerID="a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"
Jul 24 16:36:26.819167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.819096    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5"} err="failed to get container status \"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5\": rpc error: code = NotFound desc = could not find container \"a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5\": container with ID starting with a0adba0919f3031b0bbe74803d20c93eb88b34cdefa649e1165602eb2542d9e5 not found: ID does not exist"
Jul 24 16:36:26.819167 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.819115    2581 scope.go:117] "RemoveContainer" containerID="f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"
Jul 24 16:36:26.819497 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:36:26.819472    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93\": container with ID starting with f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93 not found: ID does not exist" containerID="f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"
Jul 24 16:36:26.819569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.819503    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93"} err="failed to get container status \"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93\": rpc error: code = NotFound desc = could not find container \"f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93\": container with ID starting with f33ed1539b65ccd655c9dfeae750bad567a67a73f3980d36b638378682877d93 not found: ID does not exist"
Jul 24 16:36:26.820984 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.820961    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:36:26.825661 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:26.825641    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9c399289-openshift-default-6d4cffd78d-k4vsc"]
Jul 24 16:36:27.487085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:27.487052    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" path="/var/lib/kubelet/pods/2ab3b4ab-5225-4cd5-ace7-752acaeebc74/volumes"
Jul 24 16:36:35.849052 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.849016    2581 generic.go:356] "Generic (PLEG): container finished" podID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerID="995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef" exitCode=0
Jul 24 16:36:35.849511 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.849092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerDied","Data":"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"}
Jul 24 16:36:35.849511 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.849500    2581 scope.go:117] "RemoveContainer" containerID="995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"
Jul 24 16:36:35.850453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.850424    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:35.850561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.850491    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:35.850561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:35.850532    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:36:36.856728 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:36.856698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerStarted","Data":"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"}
Jul 24 16:36:37.029632 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:37.029598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:37.030821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:37.030799    2581 patch_prober.go:28] interesting pod/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:36:37.030888 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:37.030849    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 16:36:38.030026 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:38.029990    2581 patch_prober.go:28] interesting pod/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:36:38.030475 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:38.030044    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 16:36:38.775096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:38.775066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:39.029576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:39.029477    2581 patch_prober.go:28] interesting pod/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:36:39.029576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:39.029554    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 16:36:40.029570 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:40.029538    2581 patch_prober.go:28] interesting pod/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 24 16:36:40.029970 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:40.029592    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 24 16:36:41.033183 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:41.033150    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:41.034189 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:41.034165    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:36:49.024727 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.024691    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"]
Jul 24 16:36:49.025150 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025136    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.025150 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025151    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.025250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025164    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.025250 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025169    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.025318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025248    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.025318 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.025259    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab3b4ab-5225-4cd5-ace7-752acaeebc74" containerName="istio-proxy"
Jul 24 16:36:49.028754 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.028738    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:49.031242 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.031209    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 16:36:49.031393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.031282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wtjsm\""
Jul 24 16:36:49.034824 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.034801    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"]
Jul 24 16:36:49.063413 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.063390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h\" (UID: \"cbe95402-85ff-46b2-b85d-64f62e3da8ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:49.164086 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.164048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h\" (UID: \"cbe95402-85ff-46b2-b85d-64f62e3da8ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:49.164704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.164680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h\" (UID: \"cbe95402-85ff-46b2-b85d-64f62e3da8ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:49.341251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.341141    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:49.479034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.479006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"]
Jul 24 16:36:49.480721 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:36:49.480690    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe95402_85ff_46b2_b85d_64f62e3da8ca.slice/crio-de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878 WatchSource:0}: Error finding container de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878: Status 404 returned error can't find the container with id de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878
Jul 24 16:36:49.482748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.482730    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:36:49.923352 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:49.923315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h" event={"ID":"cbe95402-85ff-46b2-b85d-64f62e3da8ca","Type":"ContainerStarted","Data":"de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878"}
Jul 24 16:36:51.936620 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:51.936576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h" event={"ID":"cbe95402-85ff-46b2-b85d-64f62e3da8ca","Type":"ContainerStarted","Data":"25b0ef6cfcb20ab7c1ddd1794f90d9ec616225434dfbab1e599ef76ae06317a7"}
Jul 24 16:36:51.956166 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:51.956113    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h" podStartSLOduration=0.866763664 podStartE2EDuration="2.956097201s" totalImagesPullingTime="2.089333537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:36:51.953285479 +0000 UTC m=+1856.899065771" watchObservedRunningTime="2026-07-24 16:36:51.956097201 +0000 UTC m=+1856.901877498"
Jul 24 16:36:52.943504 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:52.943465    2581 generic.go:356] "Generic (PLEG): container finished" podID="cbe95402-85ff-46b2-b85d-64f62e3da8ca" containerID="25b0ef6cfcb20ab7c1ddd1794f90d9ec616225434dfbab1e599ef76ae06317a7" exitCode=0
Jul 24 16:36:52.943899 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:52.943552    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h" event={"ID":"cbe95402-85ff-46b2-b85d-64f62e3da8ca","Type":"ContainerDied","Data":"25b0ef6cfcb20ab7c1ddd1794f90d9ec616225434dfbab1e599ef76ae06317a7"}
Jul 24 16:36:54.091272 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.091241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:54.212657 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.212564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca\") pod \"cbe95402-85ff-46b2-b85d-64f62e3da8ca\" (UID: \"cbe95402-85ff-46b2-b85d-64f62e3da8ca\") "
Jul 24 16:36:54.212931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.212908    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbe95402-85ff-46b2-b85d-64f62e3da8ca" (UID: "cbe95402-85ff-46b2-b85d-64f62e3da8ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:36:54.313932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.313893    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe95402-85ff-46b2-b85d-64f62e3da8ca-maas-api-service-ca\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:36:54.954611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.954586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"
Jul 24 16:36:54.954611 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.954594    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h" event={"ID":"cbe95402-85ff-46b2-b85d-64f62e3da8ca","Type":"ContainerDied","Data":"de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878"}
Jul 24 16:36:54.954835 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:36:54.954644    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de3133bc531434d3924ff3f4943c5a3e02e36eae132e8b74a896207a6f1c3878"
Jul 24 16:37:04.102883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:04.102850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"]
Jul 24 16:37:04.106530 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:04.106498    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-13a053f7-c7c7h"]
Jul 24 16:37:04.234053 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:04.234019    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:37:04.234286 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:04.234262    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy" containerID="cri-o://5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322" gracePeriod=30
Jul 24 16:37:05.488239 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:05.488190    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbe95402-85ff-46b2-b85d-64f62e3da8ca" path="/var/lib/kubelet/pods/cbe95402-85ff-46b2-b85d-64f62e3da8ca/volumes"
Jul 24 16:37:09.491325 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.491287    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:37:09.559602 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559578    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.559764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559613    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.559764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.559764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559702    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.559764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.559764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.560030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.560030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.560030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.559919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:37:09.560198 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:37:09.560198 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560100    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:37:09.560352 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrlmj\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj\") pod \"3052a31e-aebb-4841-bc42-20442d8b4de5\" (UID: \"3052a31e-aebb-4841-bc42-20442d8b4de5\") "
Jul 24 16:37:09.560352 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:37:09.560740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560573    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.560740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560593    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.560740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560602    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3052a31e-aebb-4841-bc42-20442d8b4de5-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.560740 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560610    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.561016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.560865    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data" (OuterVolumeSpecName: "istio-data") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:37:09.561910 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.561887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token" (OuterVolumeSpecName: "istio-token") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:37:09.562115 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.562098    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:37:09.562334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.562312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:37:09.562435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.562416    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj" (OuterVolumeSpecName: "kube-api-access-qrlmj") pod "3052a31e-aebb-4841-bc42-20442d8b4de5" (UID: "3052a31e-aebb-4841-bc42-20442d8b4de5"). InnerVolumeSpecName "kube-api-access-qrlmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:37:09.661955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.661918    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.661955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.661948    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.661955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.661957    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.661955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.661965    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3052a31e-aebb-4841-bc42-20442d8b4de5-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:09.662259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:09.661974    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrlmj\" (UniqueName: \"kubernetes.io/projected/3052a31e-aebb-4841-bc42-20442d8b4de5-kube-api-access-qrlmj\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:37:10.032906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.032875    2581 generic.go:356] "Generic (PLEG): container finished" podID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerID="5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322" exitCode=0
Jul 24 16:37:10.033076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.032926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"
Jul 24 16:37:10.033076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.032960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerDied","Data":"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"}
Jul 24 16:37:10.033076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.033013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl" event={"ID":"3052a31e-aebb-4841-bc42-20442d8b4de5","Type":"ContainerDied","Data":"7029620d41bf21d9600db2dade151df61869f6e60a20a15eae4060b960f6bf2a"}
Jul 24 16:37:10.033076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.033035    2581 scope.go:117] "RemoveContainer" containerID="5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"
Jul 24 16:37:10.042365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.042347    2581 scope.go:117] "RemoveContainer" containerID="995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"
Jul 24 16:37:10.050143 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.050127    2581 scope.go:117] "RemoveContainer" containerID="5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"
Jul 24 16:37:10.050428 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:37:10.050410    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322\": container with ID starting with 5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322 not found: ID does not exist" containerID="5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"
Jul 24 16:37:10.050482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.050435    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322"} err="failed to get container status \"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322\": rpc error: code = NotFound desc = could not find container \"5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322\": container with ID starting with 5b8291bf0fca1496f7d0ff35114fe3cd39b6f5bc995588dcfd508233f75d6322 not found: ID does not exist"
Jul 24 16:37:10.050482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.050452    2581 scope.go:117] "RemoveContainer" containerID="995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"
Jul 24 16:37:10.050663 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:37:10.050644    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef\": container with ID starting with 995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef not found: ID does not exist" containerID="995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"
Jul 24 16:37:10.050718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.050671    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef"} err="failed to get container status \"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef\": rpc error: code = NotFound desc = could not find container \"995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef\": container with ID starting with 995de0bd7ffb747bbc1f66a0c802a2405abeefa66060b0a012f12cd919ca10ef not found: ID does not exist"
Jul 24 16:37:10.053616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.053597    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:37:10.058377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:10.058353    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-13a053f7-openshift-default-555cfdffd4-b4jkl"]
Jul 24 16:37:11.488369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:37:11.488333    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" path="/var/lib/kubelet/pods/3052a31e-aebb-4841-bc42-20442d8b4de5/volumes"
Jul 24 16:38:41.119359 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.119319    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:38:41.119969 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.119949    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.120057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.119972    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.120057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.119988    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.120057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.119996    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.120057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.120019    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe95402-85ff-46b2-b85d-64f62e3da8ca" containerName="revoke-keys"
Jul 24 16:38:41.120057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.120028    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe95402-85ff-46b2-b85d-64f62e3da8ca" containerName="revoke-keys"
Jul 24 16:38:41.120321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.120153    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe95402-85ff-46b2-b85d-64f62e3da8ca" containerName="revoke-keys"
Jul 24 16:38:41.120321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.120169    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.120321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.120183    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3052a31e-aebb-4841-bc42-20442d8b4de5" containerName="istio-proxy"
Jul 24 16:38:41.123366 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.123345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.126066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.126048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ebaa9e95-openshift-default-dockercfg-xlxw9\""
Jul 24 16:38:41.146610 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.146582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:38:41.235388 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235594 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235594 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235594 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235594 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235803 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235803 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvbhd\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235803 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.235803 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.235689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.336993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.336950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvbhd\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.337746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.338013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.337994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.339580 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.339563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.339791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.339774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.345434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.345414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.345542 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.345524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvbhd\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd\") pod \"e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") " pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.433551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.433461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:41.573737 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.573711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:38:41.575549 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:38:41.575523    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a987dcd_1ae7_4889_be92_bb7dfc7c9575.slice/crio-b2eee6cfd7f48b14d4de93444e70df823fd60713a539a6a472d54dae8034ebba WatchSource:0}: Error finding container b2eee6cfd7f48b14d4de93444e70df823fd60713a539a6a472d54dae8034ebba: Status 404 returned error can't find the container with id b2eee6cfd7f48b14d4de93444e70df823fd60713a539a6a472d54dae8034ebba
Jul 24 16:38:41.577805 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.577764    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:41.577879 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.577858    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:41.577914 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:41.577904    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:42.528266 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:42.528219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerStarted","Data":"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"}
Jul 24 16:38:42.528710 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:42.528292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerStarted","Data":"b2eee6cfd7f48b14d4de93444e70df823fd60713a539a6a472d54dae8034ebba"}
Jul 24 16:38:42.550097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:42.550050    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" podStartSLOduration=1.550034123 podStartE2EDuration="1.550034123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:38:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:38:42.547993765 +0000 UTC m=+1967.493774064" watchObservedRunningTime="2026-07-24 16:38:42.550034123 +0000 UTC m=+1967.495814500"
Jul 24 16:38:43.434291 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:43.434257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:43.439319 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:43.439287    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:43.534241 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:43.534196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:43.535120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:43.535104    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:45.510065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.510032    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:38:45.513833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.513811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.516358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.516339    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ebaa9e95\""
Jul 24 16:38:45.516490 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.516337    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ebaa9e95-dockercfg-sp6m7\""
Jul 24 16:38:45.522446 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.522426    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:38:45.676672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.676632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cb4k\" (UniqueName: \"kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.676846 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.676718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.778035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.777959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cb4k\" (UniqueName: \"kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.778035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.777999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.778739 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.778720    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.786618 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.786579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cb4k\" (UniqueName: \"kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k\") pod \"payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.826288 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.826249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:45.988572 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:45.988494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:38:46.557433 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:46.557393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" event={"ID":"e7bcefdc-5cd6-4703-ab36-a153bf126878","Type":"ContainerStarted","Data":"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"}
Jul 24 16:38:46.557826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:46.557466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" event={"ID":"e7bcefdc-5cd6-4703-ab36-a153bf126878","Type":"ContainerStarted","Data":"002ec991731dd39a933eba524614e9556b0e1ac6107caeae061d60fbc48c6187"}
Jul 24 16:38:46.557826 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:46.557592    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:38:46.574010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:46.573962    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" podStartSLOduration=1.573947284 podStartE2EDuration="1.573947284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:38:46.571406332 +0000 UTC m=+1971.517186640" watchObservedRunningTime="2026-07-24 16:38:46.573947284 +0000 UTC m=+1971.519727647"
Jul 24 16:38:57.564259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.564194    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.65:9004: connect: connection refused"
Jul 24 16:38:57.621174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.621143    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerID="ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19" exitCode=0
Jul 24 16:38:57.621355 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.621249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerDied","Data":"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"}
Jul 24 16:38:57.621679 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.621664    2581 scope.go:117] "RemoveContainer" containerID="ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"
Jul 24 16:38:57.622680 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.622654    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:57.622742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.622718    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:57.622780 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:57.622748    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:38:58.534428 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:58.534391    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:58.627830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:58.627793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerStarted","Data":"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"}
Jul 24 16:38:59.434414 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:59.434373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:38:59.435728 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:59.435698    2581 patch_prober.go:28] interesting pod/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 16:38:59.435863 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:38:59.435747    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 16:39:00.434815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:00.434781    2581 patch_prober.go:28] interesting pod/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 16:39:00.435264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:00.434833    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 16:39:01.433917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:01.433885    2581 patch_prober.go:28] interesting pod/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 24 16:39:01.434098 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:01.433934    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 24 16:39:02.438601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:02.438564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:39:02.438979 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:02.438827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:39:02.439580 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:02.439561    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:39:06.610457 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.610421    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:39:06.610958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.610675    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerName="payload-pre-processing" containerID="cri-o://3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971" gracePeriod=30
Jul 24 16:39:06.611561 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.611318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:39:06.880659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.880635    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:39:06.985780 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.985744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume\") pod \"e7bcefdc-5cd6-4703-ab36-a153bf126878\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") "
Jul 24 16:39:06.985987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.985806    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cb4k\" (UniqueName: \"kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k\") pod \"e7bcefdc-5cd6-4703-ab36-a153bf126878\" (UID: \"e7bcefdc-5cd6-4703-ab36-a153bf126878\") "
Jul 24 16:39:06.986120 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.986097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7bcefdc-5cd6-4703-ab36-a153bf126878" (UID: "e7bcefdc-5cd6-4703-ab36-a153bf126878"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:39:06.988527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:06.988489    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k" (OuterVolumeSpecName: "kube-api-access-9cb4k") pod "e7bcefdc-5cd6-4703-ab36-a153bf126878" (UID: "e7bcefdc-5cd6-4703-ab36-a153bf126878"). InnerVolumeSpecName "kube-api-access-9cb4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:07.086905 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.086871    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7bcefdc-5cd6-4703-ab36-a153bf126878-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.086905 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.086904    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cb4k\" (UniqueName: \"kubernetes.io/projected/e7bcefdc-5cd6-4703-ab36-a153bf126878-kube-api-access-9cb4k\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:07.676062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.676027    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerID="3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971" exitCode=0
Jul 24 16:39:07.676476 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.676074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"
Jul 24 16:39:07.676476 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.676104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" event={"ID":"e7bcefdc-5cd6-4703-ab36-a153bf126878","Type":"ContainerDied","Data":"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"}
Jul 24 16:39:07.676476 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.676166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4" event={"ID":"e7bcefdc-5cd6-4703-ab36-a153bf126878","Type":"ContainerDied","Data":"002ec991731dd39a933eba524614e9556b0e1ac6107caeae061d60fbc48c6187"}
Jul 24 16:39:07.676476 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.676190    2581 scope.go:117] "RemoveContainer" containerID="3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"
Jul 24 16:39:07.684985 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.684969    2581 scope.go:117] "RemoveContainer" containerID="3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"
Jul 24 16:39:07.685252 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:39:07.685214    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971\": container with ID starting with 3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971 not found: ID does not exist" containerID="3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"
Jul 24 16:39:07.685348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.685262    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971"} err="failed to get container status \"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971\": rpc error: code = NotFound desc = could not find container \"3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971\": container with ID starting with 3e9530290501af6113c4e5feba5e6d39d76a301d0198cf45bd040dfd60ae9971 not found: ID does not exist"
Jul 24 16:39:07.691945 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.691924    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:39:07.695742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:07.695723    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-ebaa9e95-695fc4d4c6-vr9v4"]
Jul 24 16:39:09.487721 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:09.487689    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" path="/var/lib/kubelet/pods/e7bcefdc-5cd6-4703-ab36-a153bf126878/volumes"
Jul 24 16:39:17.860813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:17.860780    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:39:17.861402 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:17.861041    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy" containerID="cri-o://86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14" gracePeriod=30
Jul 24 16:39:23.123596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.123569    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:39:23.250010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.249924    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.249974    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvbhd\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250132    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:23.250505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250428    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:23.250505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250482    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:39:23.250505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250483    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:23.250690 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250690 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo\") pod \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\" (UID: \"0a987dcd-1ae7-4889-be92-bb7dfc7c9575\") "
Jul 24 16:39:23.250901 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250872    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.250901 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250898    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.251066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250911    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.251066 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.250919    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.251243 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.251199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:23.252472 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.252449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:23.252581 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.252538    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:39:23.252821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.252786    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:39:23.252821 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.252805    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd" (OuterVolumeSpecName: "kube-api-access-cvbhd") pod "0a987dcd-1ae7-4889-be92-bb7dfc7c9575" (UID: "0a987dcd-1ae7-4889-be92-bb7dfc7c9575"). InnerVolumeSpecName "kube-api-access-cvbhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:39:23.351935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.351902    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.351935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.351929    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.351935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.351937    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.351935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.351946    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.352197 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.351954    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvbhd\" (UniqueName: \"kubernetes.io/projected/0a987dcd-1ae7-4889-be92-bb7dfc7c9575-kube-api-access-cvbhd\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:39:23.765583 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.765547    2581 generic.go:356] "Generic (PLEG): container finished" podID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerID="86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14" exitCode=0
Jul 24 16:39:23.765731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.765597    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"
Jul 24 16:39:23.765731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.765591    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerDied","Data":"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"}
Jul 24 16:39:23.765731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.765715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs" event={"ID":"0a987dcd-1ae7-4889-be92-bb7dfc7c9575","Type":"ContainerDied","Data":"b2eee6cfd7f48b14d4de93444e70df823fd60713a539a6a472d54dae8034ebba"}
Jul 24 16:39:23.765860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.765738    2581 scope.go:117] "RemoveContainer" containerID="86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"
Jul 24 16:39:23.777027 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.777009    2581 scope.go:117] "RemoveContainer" containerID="ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"
Jul 24 16:39:23.784468 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.784447    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:39:23.785492 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.785474    2581 scope.go:117] "RemoveContainer" containerID="86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"
Jul 24 16:39:23.785765 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:39:23.785744    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14\": container with ID starting with 86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14 not found: ID does not exist" containerID="86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"
Jul 24 16:39:23.785812 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.785773    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14"} err="failed to get container status \"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14\": rpc error: code = NotFound desc = could not find container \"86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14\": container with ID starting with 86bfedec876db8806881633fafba62407fea803e5433d487406cf73855b67b14 not found: ID does not exist"
Jul 24 16:39:23.785812 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.785790    2581 scope.go:117] "RemoveContainer" containerID="ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"
Jul 24 16:39:23.786002 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:39:23.785985    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19\": container with ID starting with ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19 not found: ID does not exist" containerID="ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"
Jul 24 16:39:23.786044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.786008    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19"} err="failed to get container status \"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19\": rpc error: code = NotFound desc = could not find container \"ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19\": container with ID starting with ff95a5b3dad63aedd90350022a2587f4cb9033935871959e242b415931f5cc19 not found: ID does not exist"
Jul 24 16:39:23.788859 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:23.788840    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ebaa9e95-openshift-default-5d9f4c574d-6qrhs"]
Jul 24 16:39:25.488093 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:25.488057    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" path="/var/lib/kubelet/pods/0a987dcd-1ae7-4889-be92-bb7dfc7c9575/volumes"
Jul 24 16:39:37.428493 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.428455    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:39:37.429094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429075    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429118    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429144 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429127    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429145    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerName="payload-pre-processing"
Jul 24 16:39:37.429275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429156    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerName="payload-pre-processing"
Jul 24 16:39:37.429348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429302    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429314    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a987dcd-1ae7-4889-be92-bb7dfc7c9575" containerName="istio-proxy"
Jul 24 16:39:37.429348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.429327    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7bcefdc-5cd6-4703-ab36-a153bf126878" containerName="payload-pre-processing"
Jul 24 16:39:37.432883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.432859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.435132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.435109    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-14b05861-openshift-default-dockercfg-ljdhw\""
Jul 24 16:39:37.442284 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.442262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:39:37.473473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs6gz\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.473815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.473700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574381 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574566 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574566 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574566 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574566 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574737 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574790 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs6gz\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.574972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.575078 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.574988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.575214 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.575190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.575511 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.575491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.576707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.576683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.577330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.577310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.584175 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.584146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.584333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.584312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs6gz\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz\") pod \"e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") " pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.745148 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.745059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:37.889278 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.889252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:39:37.891962 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:39:37.891931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ebed90_0f44_4761_a92f_6ba3bf521220.slice/crio-a0e2b18d34b43d3584a808f5436f9fcffa0b6272ddfa59e78615669d732dc9a7 WatchSource:0}: Error finding container a0e2b18d34b43d3584a808f5436f9fcffa0b6272ddfa59e78615669d732dc9a7: Status 404 returned error can't find the container with id a0e2b18d34b43d3584a808f5436f9fcffa0b6272ddfa59e78615669d732dc9a7
Jul 24 16:39:37.894105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.894068    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:37.894218 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.894136    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:37.894218 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:37.894164    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:38.847876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:38.847842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerStarted","Data":"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"}
Jul 24 16:39:38.848378 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:38.847888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerStarted","Data":"a0e2b18d34b43d3584a808f5436f9fcffa0b6272ddfa59e78615669d732dc9a7"}
Jul 24 16:39:38.869064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:38.869021    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podStartSLOduration=1.869003746 podStartE2EDuration="1.869003746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:39:38.867574628 +0000 UTC m=+2023.813354936" watchObservedRunningTime="2026-07-24 16:39:38.869003746 +0000 UTC m=+2023.814784093"
Jul 24 16:39:39.746160 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:39.746122    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:39.751204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:39.751178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:39.853469 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:39.853439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:39.854494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:39.854471    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:55.895433 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:55.895375    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:39:55.895988 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:55.895464    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:39:56.952187 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.952156    2581 generic.go:356] "Generic (PLEG): container finished" podID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerID="ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d" exitCode=0
Jul 24 16:39:56.952625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.952235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerDied","Data":"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"}
Jul 24 16:39:56.952669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.952650    2581 scope.go:117] "RemoveContainer" containerID="ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"
Jul 24 16:39:56.953733 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.953707    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:56.953801 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.953773    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:56.953842 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:56.953803    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:39:57.958861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:57.958825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerStarted","Data":"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"}
Jul 24 16:39:58.745191 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:58.745154    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:39:58.745557 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:58.745532    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 16:39:58.745607 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:58.745592    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 16:39:59.745560 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.745518    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 16:39:59.745977 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.745578    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 16:39:59.766509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.766481    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:39:59.770011 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.769992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.772453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.772433    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-14b05861\"/\"kube-root-ca.crt\""
Jul 24 16:39:59.773187 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.773169    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-14b05861\"/\"openshift-service-ca.crt\""
Jul 24 16:39:59.773287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.773181    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-14b05861\"/\"e2e-lifecycle-model-14b05861-kserve-self-signed-certs\""
Jul 24 16:39:59.773287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.773184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-14b05861\"/\"default-dockercfg-rs6xg\""
Jul 24 16:39:59.777393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.777342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:39:59.900784 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.900744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpfq\" (UniqueName: \"kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.901044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.901019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.901174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.901158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.901359 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.901342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.901502 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.901485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:39:59.901617 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:39:59.901603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpfq\" (UniqueName: \"kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002641 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002928 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002928 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.002928 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.002776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.003358 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.003330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.004268 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.004240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.004395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.004333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.010405 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.009824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.010790 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.010769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.013143 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.013097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpfq\" (UniqueName: \"kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq\") pod \"e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") " pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.081534 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.081497    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:00.266972 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.266947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:40:00.269108 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:40:00.269075    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf447830e_5938_49d0_a112_771f1a60c143.slice/crio-1e5e6bd5328cb7f39ef7f22b51df0228f9db8b4b3ad66dd3b6d1faddaf677d18 WatchSource:0}: Error finding container 1e5e6bd5328cb7f39ef7f22b51df0228f9db8b4b3ad66dd3b6d1faddaf677d18: Status 404 returned error can't find the container with id 1e5e6bd5328cb7f39ef7f22b51df0228f9db8b4b3ad66dd3b6d1faddaf677d18
Jul 24 16:40:00.746552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.746462    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 16:40:00.746552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.746528    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 16:40:00.975721 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.975685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" event={"ID":"f447830e-5938-49d0-a112-771f1a60c143","Type":"ContainerStarted","Data":"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"}
Jul 24 16:40:00.975899 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.975729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" event={"ID":"f447830e-5938-49d0-a112-771f1a60c143","Type":"ContainerStarted","Data":"1e5e6bd5328cb7f39ef7f22b51df0228f9db8b4b3ad66dd3b6d1faddaf677d18"}
Jul 24 16:40:00.999235 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:00.999102    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" podStartSLOduration=1.999083779 podStartE2EDuration="1.999083779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:40:00.994471086 +0000 UTC m=+2045.940251387" watchObservedRunningTime="2026-07-24 16:40:00.999083779 +0000 UTC m=+2045.944864077"
Jul 24 16:40:01.745612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:01.745577    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 24 16:40:01.745791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:01.745628    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 24 16:40:02.749632 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:02.749602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:40:02.749999 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:02.749977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:40:02.750685 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:02.750665    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:40:10.081995 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:10.081957    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:10.082462 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:10.082030    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:10.094970 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:10.094944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:11.044076 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:11.044046    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:40:48.020637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:48.020602    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:40:55.584841 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:55.584811    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:40:55.587036 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:40:55.587013    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:41:03.040306 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.040242    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" podUID="f447830e-5938-49d0-a112-771f1a60c143" containerName="main" containerID="cri-o://aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b" gracePeriod=45
Jul 24 16:41:03.298444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.298393    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:41:03.303946 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.303923    2581 generic.go:356] "Generic (PLEG): container finished" podID="f447830e-5938-49d0-a112-771f1a60c143" containerID="aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b" exitCode=0
Jul 24 16:41:03.304045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.303961    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"
Jul 24 16:41:03.304045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.303966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" event={"ID":"f447830e-5938-49d0-a112-771f1a60c143","Type":"ContainerDied","Data":"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"}
Jul 24 16:41:03.304045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.303994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9" event={"ID":"f447830e-5938-49d0-a112-771f1a60c143","Type":"ContainerDied","Data":"1e5e6bd5328cb7f39ef7f22b51df0228f9db8b4b3ad66dd3b6d1faddaf677d18"}
Jul 24 16:41:03.304045 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.304013    2581 scope.go:117] "RemoveContainer" containerID="aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"
Jul 24 16:41:03.316772 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.316709    2581 scope.go:117] "RemoveContainer" containerID="aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"
Jul 24 16:41:03.317055 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:41:03.316997    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b\": container with ID starting with aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b not found: ID does not exist" containerID="aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"
Jul 24 16:41:03.317142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.317067    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b"} err="failed to get container status \"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b\": rpc error: code = NotFound desc = could not find container \"aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b\": container with ID starting with aeafc6ed0f65117ff53a9e92015d0f346d6de640ef7820ec42bcba553d06d11b not found: ID does not exist"
Jul 24 16:41:03.328713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328695    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hpfq\" (UniqueName: \"kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.328818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.328818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.328933 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328900    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.328989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.329051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.328999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs\") pod \"f447830e-5938-49d0-a112-771f1a60c143\" (UID: \"f447830e-5938-49d0-a112-771f1a60c143\") "
Jul 24 16:41:03.329051 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329036    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache" (OuterVolumeSpecName: "model-cache") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:03.329179 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329155    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home" (OuterVolumeSpecName: "home") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:03.329277 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:03.329415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329385    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.329415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329403    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.329415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.329416    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.331441 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.331409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq" (OuterVolumeSpecName: "kube-api-access-2hpfq") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "kube-api-access-2hpfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:03.331535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.331478    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm" (OuterVolumeSpecName: "dshm") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:03.331535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.331496    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f447830e-5938-49d0-a112-771f1a60c143" (UID: "f447830e-5938-49d0-a112-771f1a60c143"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:41:03.430351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.430325    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hpfq\" (UniqueName: \"kubernetes.io/projected/f447830e-5938-49d0-a112-771f1a60c143-kube-api-access-2hpfq\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.430351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.430349    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f447830e-5938-49d0-a112-771f1a60c143-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.430524 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.430358    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f447830e-5938-49d0-a112-771f1a60c143-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:03.620613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.620533    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:41:03.624563 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:03.624536    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-14b05861/e2e-lifecycle-model-14b05861-kserve-7f7b65dff-fkvl9"]
Jul 24 16:41:05.488921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:05.488890    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f447830e-5938-49d0-a112-771f1a60c143" path="/var/lib/kubelet/pods/f447830e-5938-49d0-a112-771f1a60c143/volumes"
Jul 24 16:41:44.845605 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:44.845573    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:41:44.846134 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:44.845811    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" containerID="cri-o://1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6" gracePeriod=30
Jul 24 16:41:47.752892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:47.752809    2581 patch_prober.go:28] interesting pod/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:41:47.752892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:47.752881    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:41:50.109849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.109794    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:41:50.149913 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.149889    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.149947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.149993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs6gz\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150099    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150168    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150201    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150257    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket\") pod \"b2ebed90-0f44-4761-a92f-6ba3bf521220\" (UID: \"b2ebed90-0f44-4761-a92f-6ba3bf521220\") "
Jul 24 16:41:50.150527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:50.150527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150452    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:41:50.150647 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150616    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.150647 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150636    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2ebed90-0f44-4761-a92f-6ba3bf521220-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.150755 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:50.150814 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.150773    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:50.151392 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.151364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:50.152554 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.152530    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:41:50.152681 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.152568    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:50.152930 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.152910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:41:50.153013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.152913    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz" (OuterVolumeSpecName: "kube-api-access-bs6gz") pod "b2ebed90-0f44-4761-a92f-6ba3bf521220" (UID: "b2ebed90-0f44-4761-a92f-6ba3bf521220"). InnerVolumeSpecName "kube-api-access-bs6gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:41:50.251751 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251717    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251751 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251743    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs6gz\" (UniqueName: \"kubernetes.io/projected/b2ebed90-0f44-4761-a92f-6ba3bf521220-kube-api-access-bs6gz\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251751 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251753    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251761    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251770    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251778    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.251958 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.251785    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2ebed90-0f44-4761-a92f-6ba3bf521220-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:41:50.555719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.555690    2581 generic.go:356] "Generic (PLEG): container finished" podID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerID="1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6" exitCode=0
Jul 24 16:41:50.555921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.555739    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"
Jul 24 16:41:50.555921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.555768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerDied","Data":"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"}
Jul 24 16:41:50.555921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.555818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx" event={"ID":"b2ebed90-0f44-4761-a92f-6ba3bf521220","Type":"ContainerDied","Data":"a0e2b18d34b43d3584a808f5436f9fcffa0b6272ddfa59e78615669d732dc9a7"}
Jul 24 16:41:50.555921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.555840    2581 scope.go:117] "RemoveContainer" containerID="1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"
Jul 24 16:41:50.572587 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.572567    2581 scope.go:117] "RemoveContainer" containerID="ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"
Jul 24 16:41:50.581719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.581696    2581 scope.go:117] "RemoveContainer" containerID="1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"
Jul 24 16:41:50.581999 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:41:50.581978    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6\": container with ID starting with 1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6 not found: ID does not exist" containerID="1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"
Jul 24 16:41:50.582085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.582006    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6"} err="failed to get container status \"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6\": rpc error: code = NotFound desc = could not find container \"1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6\": container with ID starting with 1e5884ba5a26d42253df6c80e3f3ea2fb0486c689bc1fb0a9ae6abd953cfd0c6 not found: ID does not exist"
Jul 24 16:41:50.582085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.582024    2581 scope.go:117] "RemoveContainer" containerID="ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"
Jul 24 16:41:50.582283 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:41:50.582261    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d\": container with ID starting with ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d not found: ID does not exist" containerID="ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"
Jul 24 16:41:50.582351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.582292    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d"} err="failed to get container status \"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d\": rpc error: code = NotFound desc = could not find container \"ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d\": container with ID starting with ddb434f844955523cc35e76ddf90a3161dc357f92bf8db483538b6338fa7b99d not found: ID does not exist"
Jul 24 16:41:50.582351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.582342    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:41:50.586372 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:50.586351    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-14b05861-openshift-default-5894dcbcb-qd6hx"]
Jul 24 16:41:51.488324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:51.488289    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" path="/var/lib/kubelet/pods/b2ebed90-0f44-4761-a92f-6ba3bf521220/volumes"
Jul 24 16:41:55.731082 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:41:55.731054    2581 scope.go:117] "RemoveContainer" containerID="4f01f87c99106808c1c42fa28f426b6ff815f0e967655c5d27db27cb40e84631"
Jul 24 16:42:40.845640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.845610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.845991    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846001    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846012    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846018    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846041    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f447830e-5938-49d0-a112-771f1a60c143" containerName="main"
Jul 24 16:42:40.846065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846047    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f447830e-5938-49d0-a112-771f1a60c143" containerName="main"
Jul 24 16:42:40.846303 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846098    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:40.846303 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.846105    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f447830e-5938-49d0-a112-771f1a60c143" containerName="main"
Jul 24 16:42:40.849161 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.849144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.851977 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.851959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ef1797-openshift-default-dockercfg-xznk9\""
Jul 24 16:42:40.862976 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.862950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:42:40.917676 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917676 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7crv\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.917887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.918058 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:40.918058 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:40.917962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.018657 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.018619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.018657 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.018658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.018912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.018783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.018974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.018926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.018974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.018962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019078 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7crv\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019078 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019728 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.019784 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.019711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.021146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.021126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.021460 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.021441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.031115 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.031085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.031301 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.031281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7crv\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv\") pod \"e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") " pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.159288 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.159178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:41.299379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.299334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:42:41.301655 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:42:41.301628    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3df2ccc_4849_47d8_acaf_3a273e413029.slice/crio-7db6a6e9ef2d5a0d2fa957d3c44c958894abef8d77c9610ea27dd81b12833b67 WatchSource:0}: Error finding container 7db6a6e9ef2d5a0d2fa957d3c44c958894abef8d77c9610ea27dd81b12833b67: Status 404 returned error can't find the container with id 7db6a6e9ef2d5a0d2fa957d3c44c958894abef8d77c9610ea27dd81b12833b67
Jul 24 16:42:41.303732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.303700    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:41.303811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.303763    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:41.303811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.303791    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:41.819550 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.819512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerStarted","Data":"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"}
Jul 24 16:42:41.819732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.819598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerStarted","Data":"7db6a6e9ef2d5a0d2fa957d3c44c958894abef8d77c9610ea27dd81b12833b67"}
Jul 24 16:42:41.839404 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:41.839348    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podStartSLOduration=1.8393329029999999 podStartE2EDuration="1.839332903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:41.838051643 +0000 UTC m=+2206.783831941" watchObservedRunningTime="2026-07-24 16:42:41.839332903 +0000 UTC m=+2206.785113201"
Jul 24 16:42:42.159625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:42.159541    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:42.164141 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:42.164116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:42.826925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:42.826892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:42.827857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:42.827833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:42:44.523665 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.523634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:42:44.524319 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.524301    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ebed90-0f44-4761-a92f-6ba3bf521220" containerName="istio-proxy"
Jul 24 16:42:44.527613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.527591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.529867 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.529849    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-ef1797-dockercfg-5gvgp\""
Jul 24 16:42:44.529961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.529885    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ef1797\""
Jul 24 16:42:44.538986 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.538960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:42:44.654460 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.654430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwpgh\" (UniqueName: \"kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.654652 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.654508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.755236 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.755191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwpgh\" (UniqueName: \"kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.755422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.755281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.755911 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.755890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.763837 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.763813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwpgh\" (UniqueName: \"kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh\") pod \"payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:44.840585 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:44.840506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:45.186311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:45.186280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:42:45.188208 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:42:45.188173    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb87ed7_6af6_47d3_9f5b_f057547d54ca.slice/crio-6ba8b8480c4a0a752d4b0623a9690562f10bc4f35fc452135ceb4acfad644554 WatchSource:0}: Error finding container 6ba8b8480c4a0a752d4b0623a9690562f10bc4f35fc452135ceb4acfad644554: Status 404 returned error can't find the container with id 6ba8b8480c4a0a752d4b0623a9690562f10bc4f35fc452135ceb4acfad644554
Jul 24 16:42:45.843813 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:45.843781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" event={"ID":"6cb87ed7-6af6-47d3-9f5b-f057547d54ca","Type":"ContainerStarted","Data":"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"}
Jul 24 16:42:45.844271 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:45.843828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" event={"ID":"6cb87ed7-6af6-47d3-9f5b-f057547d54ca","Type":"ContainerStarted","Data":"6ba8b8480c4a0a752d4b0623a9690562f10bc4f35fc452135ceb4acfad644554"}
Jul 24 16:42:45.844271 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:45.843933    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:45.859007 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:45.858959    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" podStartSLOduration=1.858946655 podStartE2EDuration="1.858946655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:45.85792106 +0000 UTC m=+2210.803701357" watchObservedRunningTime="2026-07-24 16:42:45.858946655 +0000 UTC m=+2210.804726952"
Jul 24 16:42:49.012290 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.012260    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:42:49.015989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.015968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.018201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.018178    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3881c4-openshift-default-dockercfg-t6t49\""
Jul 24 16:42:49.029313 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.029289    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:42:49.100346 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100346 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100545 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100545 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100617 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100663 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100710 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100696    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100767 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.100806 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.100793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kp4g\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.201949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.201918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.201989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kp4g\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.202989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.203099 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.202990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.203276 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.203251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.203375 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.203291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.204650 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.204625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.205021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.205000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.211268 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.211248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.211453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.211435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kp4g\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g\") pod \"e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") " pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.327628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.327533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:49.468935 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.468909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:42:49.470597 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:42:49.470567    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d81338_be7a_450d_9732_fb63701c6745.slice/crio-7a64d18aa7e5f019e891b60ca0ff4e857d1f28fed8b2f5c4a977198b98f8d965 WatchSource:0}: Error finding container 7a64d18aa7e5f019e891b60ca0ff4e857d1f28fed8b2f5c4a977198b98f8d965: Status 404 returned error can't find the container with id 7a64d18aa7e5f019e891b60ca0ff4e857d1f28fed8b2f5c4a977198b98f8d965
Jul 24 16:42:49.473320 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.473290    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:49.473405 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.473353    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:49.473405 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.473380    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:49.866185 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.866146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerStarted","Data":"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"}
Jul 24 16:42:49.866386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.866211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerStarted","Data":"7a64d18aa7e5f019e891b60ca0ff4e857d1f28fed8b2f5c4a977198b98f8d965"}
Jul 24 16:42:49.887850 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:49.887800    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podStartSLOduration=1.8877860549999999 podStartE2EDuration="1.887786055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:42:49.885692644 +0000 UTC m=+2214.831472943" watchObservedRunningTime="2026-07-24 16:42:49.887786055 +0000 UTC m=+2214.833566353"
Jul 24 16:42:50.328121 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:50.328085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:50.333149 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:50.333125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:50.872457 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:50.872432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:50.873379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:50.873354    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:42:55.757877 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:55.757848    2581 scope.go:117] "RemoveContainer" containerID="25b0ef6cfcb20ab7c1ddd1794f90d9ec616225434dfbab1e599ef76ae06317a7"
Jul 24 16:42:56.851022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:56.850993    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:42:58.869363 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:58.869318    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:42:58.869891 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:58.869381    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:42:59.929386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.929352    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerID="c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013" exitCode=0
Jul 24 16:42:59.929881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.929394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerDied","Data":"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"}
Jul 24 16:42:59.929881 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.929756    2581 scope.go:117] "RemoveContainer" containerID="c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"
Jul 24 16:42:59.930782 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.930745    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:59.930865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.930829    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:42:59.930914 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:42:59.930873    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:43:00.941417 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:00.940585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerStarted","Data":"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"}
Jul 24 16:43:01.159585 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:01.159548    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:43:01.159779 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:01.159757    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:43:01.159824 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:01.159805    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 24 16:43:02.159746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:02.159709    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:43:02.160158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:02.159769    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 24 16:43:03.160070 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:03.160028    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:43:03.160508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:03.160085    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 24 16:43:04.160204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.160166    2581 patch_prober.go:28] interesting pod/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 24 16:43:04.160621 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.160244    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 24 16:43:04.476257 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.476118    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:43:04.480063 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.480040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.482420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.482401    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ef1797\"/\"kube-root-ca.crt\""
Jul 24 16:43:04.525248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.483084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ef1797\"/\"default-dockercfg-qbx74\""
Jul 24 16:43:04.525248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.483152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ef1797\"/\"test-model-ef1797-kserve-self-signed-certs\""
Jul 24 16:43:04.525248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.483534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ef1797\"/\"openshift-service-ca.crt\""
Jul 24 16:43:04.548362 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.548290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:43:04.566072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.566072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.566349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.566349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.566349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgt7\" (UniqueName: \"kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.566349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.566209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgt7\" (UniqueName: \"kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667587 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667636 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667588    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.667674 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.667648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.669601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.669564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.669774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.669753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.678889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.678864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgt7\" (UniqueName: \"kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7\") pod \"test-model-ef1797-kserve-858775cb4c-tfm6k\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") " pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.809889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.809838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:04.982840 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:04.982772    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:43:04.990605 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:43:04.988314    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8beaa8a9_c77d_4c8b_9be1_3c6f3e748d72.slice/crio-b8eb3b6cd27b34fe8238bb668f001753aaa6aa33c81f6900a93420055627f345 WatchSource:0}: Error finding container b8eb3b6cd27b34fe8238bb668f001753aaa6aa33c81f6900a93420055627f345: Status 404 returned error can't find the container with id b8eb3b6cd27b34fe8238bb668f001753aaa6aa33c81f6900a93420055627f345
Jul 24 16:43:05.163670 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.163592    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:43:05.164016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.163866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:43:05.164696 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.164680    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:43:05.974415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.974377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" event={"ID":"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72","Type":"ContainerStarted","Data":"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"}
Jul 24 16:43:05.974415 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.974419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" event={"ID":"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72","Type":"ContainerStarted","Data":"b8eb3b6cd27b34fe8238bb668f001753aaa6aa33c81f6900a93420055627f345"}
Jul 24 16:43:05.995037 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:05.994980    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" podStartSLOduration=1.994962432 podStartE2EDuration="1.994962432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:43:05.993284983 +0000 UTC m=+2230.939065279" watchObservedRunningTime="2026-07-24 16:43:05.994962432 +0000 UTC m=+2230.940742730"
Jul 24 16:43:06.914385 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:06.914344    2581 patch_prober.go:28] interesting pod/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:43:06.914812 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:06.914404    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:43:07.985399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.985306    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7d81338-be7a-450d-9732-fb63701c6745" containerID="d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32" exitCode=0
Jul 24 16:43:07.985399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.985374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerDied","Data":"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"}
Jul 24 16:43:07.985846 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.985789    2581 scope.go:117] "RemoveContainer" containerID="d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"
Jul 24 16:43:07.986890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.986861    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:43:07.987005 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.986928    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:43:07.987005 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:07.986963    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:43:08.997610 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:08.997560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerStarted","Data":"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"}
Jul 24 16:43:09.328743 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:09.328703    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:43:09.329010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:09.328988    2581 patch_prober.go:28] interesting pod/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 24 16:43:09.329057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:09.329034    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 24 16:43:10.328613 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:10.328574    2581 patch_prober.go:28] interesting pod/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 24 16:43:10.329007 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:10.328632    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 24 16:43:11.328399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:11.328363    2581 patch_prober.go:28] interesting pod/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 24 16:43:11.328576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:11.328430    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 24 16:43:12.328619 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:12.328582    2581 patch_prober.go:28] interesting pod/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 24 16:43:12.329034 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:12.328643    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 24 16:43:13.332238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:13.332195    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:43:13.332630 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:13.332463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:43:13.333161 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:13.333138    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:43:14.811146 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:14.811111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:14.811559 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:14.811164    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:14.823507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:14.823483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:43:15.047993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:43:15.047963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:44:16.025724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:16.025691    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:44:27.688673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.688637    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:44:27.689600 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.689545    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" podUID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" containerName="payload-pre-processing" containerID="cri-o://348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e" gracePeriod=30
Jul 24 16:44:27.968020 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.967995    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:44:27.990147 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.989463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwpgh\" (UniqueName: \"kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh\") pod \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") "
Jul 24 16:44:27.990147 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.989556    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume\") pod \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\" (UID: \"6cb87ed7-6af6-47d3-9f5b-f057547d54ca\") "
Jul 24 16:44:27.990672 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.990628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6cb87ed7-6af6-47d3-9f5b-f057547d54ca" (UID: "6cb87ed7-6af6-47d3-9f5b-f057547d54ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:27.992894 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:27.992871    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh" (OuterVolumeSpecName: "kube-api-access-lwpgh") pod "6cb87ed7-6af6-47d3-9f5b-f057547d54ca" (UID: "6cb87ed7-6af6-47d3-9f5b-f057547d54ca"). InnerVolumeSpecName "kube-api-access-lwpgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:28.091193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.091162    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.091193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.091192    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwpgh\" (UniqueName: \"kubernetes.io/projected/6cb87ed7-6af6-47d3-9f5b-f057547d54ca-kube-api-access-lwpgh\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:28.438169 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.438132    2581 generic.go:356] "Generic (PLEG): container finished" podID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" containerID="348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e" exitCode=0
Jul 24 16:44:28.438373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.438185    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"
Jul 24 16:44:28.438373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.438242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" event={"ID":"6cb87ed7-6af6-47d3-9f5b-f057547d54ca","Type":"ContainerDied","Data":"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"}
Jul 24 16:44:28.438373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.438299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm" event={"ID":"6cb87ed7-6af6-47d3-9f5b-f057547d54ca","Type":"ContainerDied","Data":"6ba8b8480c4a0a752d4b0623a9690562f10bc4f35fc452135ceb4acfad644554"}
Jul 24 16:44:28.438373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.438322    2581 scope.go:117] "RemoveContainer" containerID="348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"
Jul 24 16:44:28.447851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.447837    2581 scope.go:117] "RemoveContainer" containerID="348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"
Jul 24 16:44:28.448093 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:44:28.448076    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e\": container with ID starting with 348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e not found: ID does not exist" containerID="348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"
Jul 24 16:44:28.448138 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.448101    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e"} err="failed to get container status \"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e\": rpc error: code = NotFound desc = could not find container \"348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e\": container with ID starting with 348fa79db139baa737ef02a852746404b66a446db5b1a89535f7fec09a3aa26e not found: ID does not exist"
Jul 24 16:44:28.459330 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.459299    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:44:28.462887 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:28.462869    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ef1797-5c64ddb5bd-hrtdm"]
Jul 24 16:44:29.487313 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:29.487275    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" path="/var/lib/kubelet/pods/6cb87ed7-6af6-47d3-9f5b-f057547d54ca/volumes"
Jul 24 16:44:31.045016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.044958    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" podUID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" containerName="main" containerID="cri-o://af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26" gracePeriod=45
Jul 24 16:44:31.297732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.297672    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:44:31.319856 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.319829    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.319883    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.319904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.319931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.319966    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmgt7\" (UniqueName: \"kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320028 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm\") pod \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\" (UID: \"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72\") "
Jul 24 16:44:31.320333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home" (OuterVolumeSpecName: "home") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:31.320333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320188    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:31.320333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320209    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache" (OuterVolumeSpecName: "model-cache") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:31.320482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320440    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.320482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320461    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.320482 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.320474    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.322159 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.322138    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm" (OuterVolumeSpecName: "dshm") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:31.322274 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.322215    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:44:31.322324 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.322303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7" (OuterVolumeSpecName: "kube-api-access-fmgt7") pod "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" (UID: "8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72"). InnerVolumeSpecName "kube-api-access-fmgt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:31.421151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.421119    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.421151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.421149    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmgt7\" (UniqueName: \"kubernetes.io/projected/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-kube-api-access-fmgt7\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.421401 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.421160    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:31.456788 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.456756    2581 generic.go:356] "Generic (PLEG): container finished" podID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" containerID="af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26" exitCode=0
Jul 24 16:44:31.456961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.456808    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"
Jul 24 16:44:31.456961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.456827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" event={"ID":"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72","Type":"ContainerDied","Data":"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"}
Jul 24 16:44:31.456961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.456861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k" event={"ID":"8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72","Type":"ContainerDied","Data":"b8eb3b6cd27b34fe8238bb668f001753aaa6aa33c81f6900a93420055627f345"}
Jul 24 16:44:31.456961 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.456879    2581 scope.go:117] "RemoveContainer" containerID="af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"
Jul 24 16:44:31.465980 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.465960    2581 scope.go:117] "RemoveContainer" containerID="af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"
Jul 24 16:44:31.466246 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:44:31.466211    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26\": container with ID starting with af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26 not found: ID does not exist" containerID="af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"
Jul 24 16:44:31.466294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.466261    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26"} err="failed to get container status \"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26\": rpc error: code = NotFound desc = could not find container \"af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26\": container with ID starting with af21fe98f525b30d840c8ea78472d5aeb121ea3eb59a664691e3542d5b5b8d26 not found: ID does not exist"
Jul 24 16:44:31.489262 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.489219    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:44:31.489262 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:31.489269    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ef1797/test-model-ef1797-kserve-858775cb4c-tfm6k"]
Jul 24 16:44:33.487357 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:33.487324    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" path="/var/lib/kubelet/pods/8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72/volumes"
Jul 24 16:44:38.541384 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:38.541352    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:44:38.541849 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:38.541585    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy" containerID="cri-o://6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846" gracePeriod=30
Jul 24 16:44:43.805269 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.805157    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:44:43.947555 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947612    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947725    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7crv\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947768    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947843    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.947890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert\") pod \"b3df2ccc-4849-47d8-acaf-3a273e413029\" (UID: \"b3df2ccc-4849-47d8-acaf-3a273e413029\") "
Jul 24 16:44:43.948077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:43.948077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.947971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:43.948191 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948145    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:43.948335 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948312    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:43.948417 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948340    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:43.948417 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948353    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:43.948516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948469    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:43.948721 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.948691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:44:43.949968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.949941    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:43.950072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.950022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:44:43.950072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.950048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:44:43.950280 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:43.950258    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv" (OuterVolumeSpecName: "kube-api-access-g7crv") pod "b3df2ccc-4849-47d8-acaf-3a273e413029" (UID: "b3df2ccc-4849-47d8-acaf-3a273e413029"). InnerVolumeSpecName "kube-api-access-g7crv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:44:44.048851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048812    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.048851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048844    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3df2ccc-4849-47d8-acaf-3a273e413029-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.048851 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048858    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.049104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048870    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.049104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048881    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.049104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.048892    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7crv\" (UniqueName: \"kubernetes.io/projected/b3df2ccc-4849-47d8-acaf-3a273e413029-kube-api-access-g7crv\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:44:44.527794 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.527759    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerID="6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846" exitCode=0
Jul 24 16:44:44.527993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.527806    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"
Jul 24 16:44:44.527993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.527808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerDied","Data":"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"}
Jul 24 16:44:44.527993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.527921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw" event={"ID":"b3df2ccc-4849-47d8-acaf-3a273e413029","Type":"ContainerDied","Data":"7db6a6e9ef2d5a0d2fa957d3c44c958894abef8d77c9610ea27dd81b12833b67"}
Jul 24 16:44:44.527993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.527952    2581 scope.go:117] "RemoveContainer" containerID="6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"
Jul 24 16:44:44.537808 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.537789    2581 scope.go:117] "RemoveContainer" containerID="c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"
Jul 24 16:44:44.545805 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.545788    2581 scope.go:117] "RemoveContainer" containerID="6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"
Jul 24 16:44:44.546033 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:44:44.546016    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846\": container with ID starting with 6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846 not found: ID does not exist" containerID="6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"
Jul 24 16:44:44.546081 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.546041    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846"} err="failed to get container status \"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846\": rpc error: code = NotFound desc = could not find container \"6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846\": container with ID starting with 6d94e7120ccaa5ec1f05d88b877400a9b8d9b1cf26a4772a521d94aa107f0846 not found: ID does not exist"
Jul 24 16:44:44.546081 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.546059    2581 scope.go:117] "RemoveContainer" containerID="c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"
Jul 24 16:44:44.546267 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:44:44.546241    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013\": container with ID starting with c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013 not found: ID does not exist" containerID="c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"
Jul 24 16:44:44.546362 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.546271    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013"} err="failed to get container status \"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013\": rpc error: code = NotFound desc = could not find container \"c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013\": container with ID starting with c26b414dd403c3539ae2155393b83db51f052187ebbed64c97be4810c5a07013 not found: ID does not exist"
Jul 24 16:44:44.549971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.549949    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:44:44.553720 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:44.553700    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1797-openshift-default-5fc64bdf84-87sfw"]
Jul 24 16:44:45.488494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:44:45.488461    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" path="/var/lib/kubelet/pods/b3df2ccc-4849-47d8-acaf-3a273e413029/volumes"
Jul 24 16:45:00.899748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:00.899709    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:45:00.900254 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:00.900023    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy" containerID="cri-o://09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d" gracePeriod=30
Jul 24 16:45:01.751711 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.751678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:01.752360 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752339    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" containerName="payload-pre-processing"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" containerName="payload-pre-processing"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752386    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" containerName="main"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752396    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" containerName="main"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752420    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752430    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752448 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752445    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752454    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752556    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752570    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8beaa8a9-c77d-4c8b-9be1-3c6f3e748d72" containerName="main"
Jul 24 16:45:01.752671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752585    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3df2ccc-4849-47d8-acaf-3a273e413029" containerName="istio-proxy"
Jul 24 16:45:01.752671 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.752594    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb87ed7-6af6-47d3-9f5b-f057547d54ca" containerName="payload-pre-processing"
Jul 24 16:45:01.755698 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.755681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.758375 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.758357    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-aac1d1-openshift-default-dockercfg-smcfp\""
Jul 24 16:45:01.767545 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.767515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:01.916311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkmr\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:01.916722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:01.916626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.017932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.017896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.017932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.017934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkmr\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.017957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018260 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018260 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018374 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018588 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018588 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.018916 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.018896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.020515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.020489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.020841 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.020819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.025651 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.025628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.025964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.025942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkmr\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr\") pod \"e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") " pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.067012 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.066976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:02.211269 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.211242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:02.213289 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:45:02.213262    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc91549_b219_4026_9930_d55179bc5ac1.slice/crio-2d40b33ade64635db007f65631a2c40f33e99875705a4d5c70da9bf8713a762c WatchSource:0}: Error finding container 2d40b33ade64635db007f65631a2c40f33e99875705a4d5c70da9bf8713a762c: Status 404 returned error can't find the container with id 2d40b33ade64635db007f65631a2c40f33e99875705a4d5c70da9bf8713a762c
Jul 24 16:45:02.215453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.215410    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:02.215533 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.215507    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:02.215579 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.215554    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:02.632016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.631929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerStarted","Data":"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"}
Jul 24 16:45:02.632016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.632006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerStarted","Data":"2d40b33ade64635db007f65631a2c40f33e99875705a4d5c70da9bf8713a762c"}
Jul 24 16:45:02.653006 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:02.652953    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podStartSLOduration=1.652937481 podStartE2EDuration="1.652937481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:02.650570453 +0000 UTC m=+2347.596350745" watchObservedRunningTime="2026-07-24 16:45:02.652937481 +0000 UTC m=+2347.598717779"
Jul 24 16:45:03.067700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:03.067672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:03.072732 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:03.072707    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:03.638015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:03.637984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:03.639050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:03.639028    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:06.167264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.167179    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:45:06.262514 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262567    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262598    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262666 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262649    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262699    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kp4g\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262738    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo\") pod \"e7d81338-be7a-450d-9732-fb63701c6745\" (UID: \"e7d81338-be7a-450d-9732-fb63701c6745\") "
Jul 24 16:45:06.262949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262850    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:06.262949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262865    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:06.263219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.262977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:06.263219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.263080    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.263219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.263103    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.263219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.263119    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.263219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.263195    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:06.263507 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.263336    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:06.264921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.264889    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:06.265035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.265005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:06.265269 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.265216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:45:06.265424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.265404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g" (OuterVolumeSpecName: "kube-api-access-8kp4g") pod "e7d81338-be7a-450d-9732-fb63701c6745" (UID: "e7d81338-be7a-450d-9732-fb63701c6745"). InnerVolumeSpecName "kube-api-access-8kp4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:06.363714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363679    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.363714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363712    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.363714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363721    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kp4g\" (UniqueName: \"kubernetes.io/projected/e7d81338-be7a-450d-9732-fb63701c6745-kube-api-access-8kp4g\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.363925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363731    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d81338-be7a-450d-9732-fb63701c6745-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.363925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363740    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d81338-be7a-450d-9732-fb63701c6745-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.363925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.363750    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d81338-be7a-450d-9732-fb63701c6745-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:06.656421 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.656384    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7d81338-be7a-450d-9732-fb63701c6745" containerID="09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d" exitCode=0
Jul 24 16:45:06.656625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.656446    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"
Jul 24 16:45:06.656625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.656464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerDied","Data":"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"}
Jul 24 16:45:06.656625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.656527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf" event={"ID":"e7d81338-be7a-450d-9732-fb63701c6745","Type":"ContainerDied","Data":"7a64d18aa7e5f019e891b60ca0ff4e857d1f28fed8b2f5c4a977198b98f8d965"}
Jul 24 16:45:06.656625 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.656592    2581 scope.go:117] "RemoveContainer" containerID="09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"
Jul 24 16:45:06.667569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.667546    2581 scope.go:117] "RemoveContainer" containerID="d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"
Jul 24 16:45:06.683543 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.683512    2581 scope.go:117] "RemoveContainer" containerID="09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"
Jul 24 16:45:06.683884 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:45:06.683859    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d\": container with ID starting with 09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d not found: ID does not exist" containerID="09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"
Jul 24 16:45:06.683943 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.683908    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d"} err="failed to get container status \"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d\": rpc error: code = NotFound desc = could not find container \"09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d\": container with ID starting with 09794bcaa913c77f983e63918f60588f2dd5c4731c3deeb45049a6d9807b6c2d not found: ID does not exist"
Jul 24 16:45:06.683943 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.683932    2581 scope.go:117] "RemoveContainer" containerID="d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"
Jul 24 16:45:06.684203 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:45:06.684174    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32\": container with ID starting with d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32 not found: ID does not exist" containerID="d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"
Jul 24 16:45:06.684295 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.684202    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32"} err="failed to get container status \"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32\": rpc error: code = NotFound desc = could not find container \"d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32\": container with ID starting with d2dc64755cabed585b165eab8bd9006816c81b48d681a297bfd1fa43a3728b32 not found: ID does not exist"
Jul 24 16:45:06.693557 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.693530    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:45:06.697700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:06.697678    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3881c4-openshift-default-849954fb7d-s5ccf"]
Jul 24 16:45:07.488410 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:07.488379    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d81338-be7a-450d-9732-fb63701c6745" path="/var/lib/kubelet/pods/e7d81338-be7a-450d-9732-fb63701c6745/volumes"
Jul 24 16:45:09.852152 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852123    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:45:09.852593 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852579    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:45:09.852593 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852591    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:45:09.852724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852612    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:45:09.852724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852620    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:45:09.852724 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.852693    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:45:09.857355 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.857333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.859791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.859771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4ef934-openshift-default-dockercfg-jnkvr\""
Jul 24 16:45:09.868422 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.868398    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:45:09.901456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901591 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901591 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901708 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:09.901847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:09.901807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ndn8\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002524 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002716 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002716 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002716 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002716 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002884 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002884 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ndn8\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002884 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.002884 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.002865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.003338 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.003314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.003796 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.003772    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.004472 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.004425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.004675 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.004630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.004974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.004951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.006408 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.006382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.006729 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.006705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.016095 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.016067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.016242 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.016187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ndn8\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8\") pod \"e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") " pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.168246 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.168129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:10.315294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.315217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:45:10.317609 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:45:10.317575    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f0e09c_c5c5_4ce9_9fce_f5e12644a8f5.slice/crio-735709e9fbf7681801d7dc46e6ebad88d4e72011a8546979708459b84f71de65 WatchSource:0}: Error finding container 735709e9fbf7681801d7dc46e6ebad88d4e72011a8546979708459b84f71de65: Status 404 returned error can't find the container with id 735709e9fbf7681801d7dc46e6ebad88d4e72011a8546979708459b84f71de65
Jul 24 16:45:10.319739 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.319707    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:10.319836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.319773    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:10.319836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.319802    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:10.681065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.681028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerStarted","Data":"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"}
Jul 24 16:45:10.681240 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.681086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerStarted","Data":"735709e9fbf7681801d7dc46e6ebad88d4e72011a8546979708459b84f71de65"}
Jul 24 16:45:10.699409 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:10.699366    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podStartSLOduration=1.69935114 podStartE2EDuration="1.69935114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:45:10.697930802 +0000 UTC m=+2355.643711100" watchObservedRunningTime="2026-07-24 16:45:10.69935114 +0000 UTC m=+2355.645131438"
Jul 24 16:45:11.168427 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:11.168390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:11.173607 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:11.173585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:11.685876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:11.685845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:11.686840 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:11.686812    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:19.680406 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:19.680361    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:45:19.680874 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:19.680427    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:45:20.743150 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.743125    2581 generic.go:356] "Generic (PLEG): container finished" podID="6dc91549-b219-4026-9930-d55179bc5ac1" containerID="389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2" exitCode=0
Jul 24 16:45:20.743605 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.743195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerDied","Data":"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"}
Jul 24 16:45:20.743673 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.743609    2581 scope.go:117] "RemoveContainer" containerID="389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"
Jul 24 16:45:20.744745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.744712    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:20.744810 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.744799    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:20.744856 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:20.744842    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:21.752016 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:21.751977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerStarted","Data":"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"}
Jul 24 16:45:22.068105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:22.068075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:22.068320 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:22.068283    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 24 16:45:22.068380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:22.068329    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 24 16:45:23.067949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:23.067911    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 24 16:45:23.068395 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:23.067978    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 24 16:45:24.067746 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:24.067709    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 24 16:45:24.067932 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:24.067762    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 24 16:45:25.068151 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:25.068104    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 24 16:45:25.068655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:25.068179    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 24 16:45:26.076773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:26.076731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:26.077268 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:26.077244    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:26.078079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:26.078061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:30.807137 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.807097    2581 generic.go:356] "Generic (PLEG): container finished" podID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerID="0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515" exitCode=0
Jul 24 16:45:30.807601 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.807146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerDied","Data":"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"}
Jul 24 16:45:30.807644 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.807622    2581 scope.go:117] "RemoveContainer" containerID="0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"
Jul 24 16:45:30.808707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.808682    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:30.808819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.808748    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:30.808819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:30.808790    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:45:31.816434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:31.816392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerStarted","Data":"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"}
Jul 24 16:45:32.169251 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:32.169132    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:32.169509 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:32.169485    2581 patch_prober.go:28] interesting pod/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 24 16:45:32.169568 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:32.169547    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 24 16:45:33.169453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:33.169416    2581 patch_prober.go:28] interesting pod/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 24 16:45:33.169864 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:33.169474    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 24 16:45:34.168555 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:34.168520    2581 patch_prober.go:28] interesting pod/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 24 16:45:34.168745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:34.168570    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 24 16:45:35.169184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:35.169144    2581 patch_prober.go:28] interesting pod/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Jul 24 16:45:35.169599 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:35.169218    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Jul 24 16:45:36.172004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:36.171975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:36.172425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:36.172251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:36.172960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:36.172944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:45:51.474878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:51.474844    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:51.475377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:51.475118    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" containerID="cri-o://a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be" gracePeriod=30
Jul 24 16:45:55.614669 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:55.614639    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:45:55.625903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:55.625882    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:45:56.079139 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.079102    2581 patch_prober.go:28] interesting pod/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:45:56.079390 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.079163    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:45:56.731865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.731839    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:56.757606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757577    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757651    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757669    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757706    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxkmr\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.757807 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757805    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.758130 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757840    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert\") pod \"6dc91549-b219-4026-9930-d55179bc5ac1\" (UID: \"6dc91549-b219-4026-9930-d55179bc5ac1\") "
Jul 24 16:45:56.758130 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.757922    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:56.758270 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758148    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:56.758270 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758164    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:56.758390 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758266    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:45:56.758659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758587    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.758659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758610    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.758659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758624    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.758659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.758637    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc91549-b219-4026-9930-d55179bc5ac1-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.759086 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.759050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:56.760508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.760483    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr" (OuterVolumeSpecName: "kube-api-access-lxkmr") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "kube-api-access-lxkmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:56.760736 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.760690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:45:56.761015 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.760980    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:45:56.761322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.761303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dc91549-b219-4026-9930-d55179bc5ac1" (UID: "6dc91549-b219-4026-9930-d55179bc5ac1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:45:56.859343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.859309    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.859343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.859338    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc91549-b219-4026-9930-d55179bc5ac1-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.859343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.859348    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxkmr\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-kube-api-access-lxkmr\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.859584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.859358    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc91549-b219-4026-9930-d55179bc5ac1-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.859584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.859367    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc91549-b219-4026-9930-d55179bc5ac1-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:45:56.950004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.949969    2581 generic.go:356] "Generic (PLEG): container finished" podID="6dc91549-b219-4026-9930-d55179bc5ac1" containerID="a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be" exitCode=0
Jul 24 16:45:56.950193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.950022    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"
Jul 24 16:45:56.950193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.950022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerDied","Data":"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"}
Jul 24 16:45:56.950193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.950092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt" event={"ID":"6dc91549-b219-4026-9930-d55179bc5ac1","Type":"ContainerDied","Data":"2d40b33ade64635db007f65631a2c40f33e99875705a4d5c70da9bf8713a762c"}
Jul 24 16:45:56.950193 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.950123    2581 scope.go:117] "RemoveContainer" containerID="a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"
Jul 24 16:45:56.959748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.959731    2581 scope.go:117] "RemoveContainer" containerID="389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"
Jul 24 16:45:56.967729 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.967712    2581 scope.go:117] "RemoveContainer" containerID="a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"
Jul 24 16:45:56.967960 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:45:56.967938    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be\": container with ID starting with a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be not found: ID does not exist" containerID="a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"
Jul 24 16:45:56.968021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.967967    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be"} err="failed to get container status \"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be\": rpc error: code = NotFound desc = could not find container \"a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be\": container with ID starting with a22000967b2b1471d7f80c7818b0ba509ab9c72bfd202c721a3675b5b44258be not found: ID does not exist"
Jul 24 16:45:56.968021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.967983    2581 scope.go:117] "RemoveContainer" containerID="389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"
Jul 24 16:45:56.968231 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:45:56.968203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2\": container with ID starting with 389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2 not found: ID does not exist" containerID="389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"
Jul 24 16:45:56.968287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.968235    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2"} err="failed to get container status \"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2\": rpc error: code = NotFound desc = could not find container \"389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2\": container with ID starting with 389af4e76e6244377dced68ac7a6ca1d3d7c9bf4ca97d49af64c5dd9b97195c2 not found: ID does not exist"
Jul 24 16:45:56.972067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.972043    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:56.977734 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:56.977710    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-aac1d1-openshift-default-79d6d89694-6p4bt"]
Jul 24 16:45:57.488321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:45:57.488283    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" path="/var/lib/kubelet/pods/6dc91549-b219-4026-9930-d55179bc5ac1/volumes"
Jul 24 16:46:18.343179 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:18.343147    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:46:18.343769 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:18.343385    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" containerID="cri-o://d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8" gracePeriod=30
Jul 24 16:46:19.237072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237039    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:46:19.237768 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237739    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.237768 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237761    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.237929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237786    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.237929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237792    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.237929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237852    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d81338-be7a-450d-9732-fb63701c6745" containerName="istio-proxy"
Jul 24 16:46:19.237929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237861    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.237929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.237867    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc91549-b219-4026-9930-d55179bc5ac1" containerName="istio-proxy"
Jul 24 16:46:19.241162 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.241146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.243579 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.243561    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a65dee-openshift-default-dockercfg-nwcr8\""
Jul 24 16:46:19.252132 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.252108    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:46:19.372727 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.372727 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.372980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.373019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.373070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.373312 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.373126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbk7\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474486 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474687 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbk7\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.474883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.475157 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.474899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.475257 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.475207    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.475341 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.475262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.475341 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.475321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.475435 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.475362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.476876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.476858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.477127 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.477109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.482458 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.482429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.482929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.482908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbk7\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7\") pod \"e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") " pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.552714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.552682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:19.701325 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.701293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:46:19.703688 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:46:19.703660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb744b6_5c0f_401e_bbd6_98ee7b0b1882.slice/crio-e0ee819668fcbb87a1d1508127ac6e4fc8ee58c4509272e4c8544f0224f841cd WatchSource:0}: Error finding container e0ee819668fcbb87a1d1508127ac6e4fc8ee58c4509272e4c8544f0224f841cd: Status 404 returned error can't find the container with id e0ee819668fcbb87a1d1508127ac6e4fc8ee58c4509272e4c8544f0224f841cd
Jul 24 16:46:19.705857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.705825    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:19.705962 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.705890    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:19.705962 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:19.705915    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:20.071031 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:20.070988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerStarted","Data":"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"}
Jul 24 16:46:20.071031 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:20.071038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerStarted","Data":"e0ee819668fcbb87a1d1508127ac6e4fc8ee58c4509272e4c8544f0224f841cd"}
Jul 24 16:46:20.095006 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:20.094957    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podStartSLOduration=1.094940317 podStartE2EDuration="1.094940317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:20.092538284 +0000 UTC m=+2425.038318582" watchObservedRunningTime="2026-07-24 16:46:20.094940317 +0000 UTC m=+2425.040720678"
Jul 24 16:46:20.553647 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:20.553616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:20.558993 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:20.558971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:21.076569 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:21.076536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:21.077373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:21.077355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:21.174297 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:21.174260    2581 patch_prober.go:28] interesting pod/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:46:21.174463 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:21.174327    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:46:23.601659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.601631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:46:23.718044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.717962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718013    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718055    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718203    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718314 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ndn8\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718347    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data\") pod \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\" (UID: \"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5\") "
Jul 24 16:46:23.718576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:46:23.718734 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718646    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:46:23.718799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718694    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:46:23.718799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718721    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.718990 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.718892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:46:23.719424 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.719397    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:46:23.720619 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.720598    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:46:23.720714 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.720692    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8" (OuterVolumeSpecName: "kube-api-access-7ndn8") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "kube-api-access-7ndn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:46:23.720846 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.720829    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:46:23.720921 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.720869    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" (UID: "d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:46:23.819426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819391    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ndn8\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-kube-api-access-7ndn8\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819419    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819429    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819438    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819445    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819453    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819461    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:23.819655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:23.819468    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:46:24.096396 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.096357    2581 generic.go:356] "Generic (PLEG): container finished" podID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerID="d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8" exitCode=0
Jul 24 16:46:24.096574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.096409    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"
Jul 24 16:46:24.096574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.096441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerDied","Data":"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"}
Jul 24 16:46:24.096574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.096500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr" event={"ID":"d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5","Type":"ContainerDied","Data":"735709e9fbf7681801d7dc46e6ebad88d4e72011a8546979708459b84f71de65"}
Jul 24 16:46:24.096574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.096523    2581 scope.go:117] "RemoveContainer" containerID="d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"
Jul 24 16:46:24.106427 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.106407    2581 scope.go:117] "RemoveContainer" containerID="0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"
Jul 24 16:46:24.117752 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.117729    2581 scope.go:117] "RemoveContainer" containerID="d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"
Jul 24 16:46:24.118026 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:46:24.118006    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8\": container with ID starting with d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8 not found: ID does not exist" containerID="d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"
Jul 24 16:46:24.118081 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.118038    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8"} err="failed to get container status \"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8\": rpc error: code = NotFound desc = could not find container \"d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8\": container with ID starting with d52264cabde459f8f523473949bf05e11b053c2f5ccfad8c4e2b64d19de87aa8 not found: ID does not exist"
Jul 24 16:46:24.118081 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.118074    2581 scope.go:117] "RemoveContainer" containerID="0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"
Jul 24 16:46:24.118180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.118148    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:46:24.118379 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:46:24.118361    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515\": container with ID starting with 0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515 not found: ID does not exist" containerID="0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"
Jul 24 16:46:24.118436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.118395    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515"} err="failed to get container status \"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515\": rpc error: code = NotFound desc = could not find container \"0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515\": container with ID starting with 0ea2265f76b80970a0614c417e13367fccbc155c80c3888d7c5d7b516010a515 not found: ID does not exist"
Jul 24 16:46:24.121067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:24.121047    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4ef934-openshift-default-65f6ff9488-2ncnr"]
Jul 24 16:46:25.488328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:25.488289    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" path="/var/lib/kubelet/pods/d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5/volumes"
Jul 24 16:46:27.111668 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.111634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:46:27.112296 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.112275    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:27.112394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.112300    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:27.112394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.112317    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:27.112394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.112326    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:27.112563 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.112432    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:27.117287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.117266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.119743 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.119723    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a29da6-openshift-default-dockercfg-7gctj\""
Jul 24 16:46:27.125707 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.125677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:46:27.154080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154080 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nlb\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154538 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.154538 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.154368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nlb\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.254951 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.254948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255382 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255382 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255382 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.255800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.255781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.257362 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.257338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.257452 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.257403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.262595 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.262571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.263145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.263124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nlb\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb\") pod \"e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") " pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.428485 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.428405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:27.574184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.574156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:46:27.577150 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:46:27.577123    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd786387_79f2_47e4_ad1f_3730f8406f99.slice/crio-3bb7ac0724db20043c75d808d652ce6221bbf74d1f643939604264b9b31a7542 WatchSource:0}: Error finding container 3bb7ac0724db20043c75d808d652ce6221bbf74d1f643939604264b9b31a7542: Status 404 returned error can't find the container with id 3bb7ac0724db20043c75d808d652ce6221bbf74d1f643939604264b9b31a7542
Jul 24 16:46:27.579343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.579309    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:27.579419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.579375    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:27.579419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:27.579404    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:28.121950 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:28.121909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerStarted","Data":"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"}
Jul 24 16:46:28.122381 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:28.121977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerStarted","Data":"3bb7ac0724db20043c75d808d652ce6221bbf74d1f643939604264b9b31a7542"}
Jul 24 16:46:28.149098 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:28.149046    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podStartSLOduration=1.149028605 podStartE2EDuration="1.149028605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:28.147903725 +0000 UTC m=+2433.093684046" watchObservedRunningTime="2026-07-24 16:46:28.149028605 +0000 UTC m=+2433.094808902"
Jul 24 16:46:28.429145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:28.429052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:28.433845 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:28.433821    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:29.127773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:29.127741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:29.128628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:29.128612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:37.118371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:37.118331    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:46:37.118764 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:37.118409    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:46:38.177345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.177246    2581 generic.go:356] "Generic (PLEG): container finished" podID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerID="8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf" exitCode=0
Jul 24 16:46:38.177345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.177296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerDied","Data":"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"}
Jul 24 16:46:38.177785 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.177697    2581 scope.go:117] "RemoveContainer" containerID="8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"
Jul 24 16:46:38.178896 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.178857    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:38.178964 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.178933    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:38.179001 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:38.178967    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:39.186334 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:39.186304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerStarted","Data":"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"}
Jul 24 16:46:39.553123 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:39.553087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:39.553370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:39.553349    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 16:46:39.553426 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:39.553390    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 16:46:40.553830 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:40.553794    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 16:46:40.554262 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:40.553846    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 16:46:41.553096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:41.553059    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 16:46:41.553397 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:41.553359    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 16:46:42.553331 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:42.553296    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 16:46:42.553748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:42.553353    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 16:46:43.553700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:43.553663    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 24 16:46:43.554056 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:43.553734    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 24 16:46:44.557287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:44.557248    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:44.557767 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:44.557745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:44.558380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:44.558361    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:46:45.169436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:45.169388    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 16:46:45.169627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:45.169448    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 16:46:47.250703 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.250670    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerID="37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1" exitCode=0
Jul 24 16:46:47.251157 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.250742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerDied","Data":"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"}
Jul 24 16:46:47.251201 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.251163    2581 scope.go:117] "RemoveContainer" containerID="37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"
Jul 24 16:46:47.252217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.252185    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:47.252336 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.252282    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:47.252400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:47.252332    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:46:48.259974 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:48.259936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerStarted","Data":"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"}
Jul 24 16:46:48.429575 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:48.429542    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:48.429748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:48.429724    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 24 16:46:48.429800 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:48.429771    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 24 16:46:49.429400 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:49.429363    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 24 16:46:49.429873 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:49.429423    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 24 16:46:50.429427 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.429388    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 24 16:46:50.429838 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.429446    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 24 16:46:50.865880 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.865841    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:46:50.866564 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.866541    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f0e09c-c5c5-4ce9-9fce-f5e12644a8f5" containerName="istio-proxy"
Jul 24 16:46:50.869844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.869823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:50.872275 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.872254    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"default-dockercfg-g2wt4\""
Jul 24 16:46:50.873158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.873138    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"kube-root-ca.crt\""
Jul 24 16:46:50.873158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.873148    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"auth-test-model-a65dee-kserve-self-signed-certs\""
Jul 24 16:46:50.873377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.873211    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"openshift-service-ca.crt\""
Jul 24 16:46:50.879551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:50.879524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:46:51.016998 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.016954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82w7\" (UniqueName: \"kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.017238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.017036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.017238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.017074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.017238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.017110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.017238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.017137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.017238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.017182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82w7\" (UniqueName: \"kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118519 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.118762 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.118634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.119315 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.119292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.119505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.119381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.119588 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.119433    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.121697 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.121677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.121948 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.121931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.126865 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.126842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82w7\" (UniqueName: \"kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7\") pod \"auth-test-model-a65dee-kserve-68dc894cc5-hvwgp\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") " pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.180889 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.180861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:46:51.365619 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.365593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:46:51.367841 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:46:51.367812    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a360ab5_fce3_43ca_9b90_887bcec66e0e.slice/crio-c8656b4ad7015c3fcef2d3a671e31e5465b3bd694a62c1fee7b32f15b4eb96fa WatchSource:0}: Error finding container c8656b4ad7015c3fcef2d3a671e31e5465b3bd694a62c1fee7b32f15b4eb96fa: Status 404 returned error can't find the container with id c8656b4ad7015c3fcef2d3a671e31e5465b3bd694a62c1fee7b32f15b4eb96fa
Jul 24 16:46:51.429174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.429143    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 24 16:46:51.429321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:51.429204    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 24 16:46:52.283442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.283407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" event={"ID":"5a360ab5-fce3-43ca-9b90-887bcec66e0e","Type":"ContainerStarted","Data":"ef22fb623e65165a48517afde25fe646705346aefe9a43e502e6986b6a251909"}
Jul 24 16:46:52.283442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.283447    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" event={"ID":"5a360ab5-fce3-43ca-9b90-887bcec66e0e","Type":"ContainerStarted","Data":"c8656b4ad7015c3fcef2d3a671e31e5465b3bd694a62c1fee7b32f15b4eb96fa"}
Jul 24 16:46:52.301847 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.301788    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" podStartSLOduration=2.30177058 podStartE2EDuration="2.30177058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:46:52.298936511 +0000 UTC m=+2457.244716809" watchObservedRunningTime="2026-07-24 16:46:52.30177058 +0000 UTC m=+2457.247550878"
Jul 24 16:46:52.432014 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.431986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:52.432350 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.432333    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:46:52.433002 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:46:52.432983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:47:01.181471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:47:01.181428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:47:01.181917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:47:01.181487    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:47:01.197513 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:47:01.197486    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:47:01.345618 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:47:01.345592    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:49:32.053195 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:32.053158    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:49:47.072383 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.072340    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" podUID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" containerName="main" containerID="cri-o://ef22fb623e65165a48517afde25fe646705346aefe9a43e502e6986b6a251909" gracePeriod=45
Jul 24 16:49:47.222996 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.222965    2581 generic.go:356] "Generic (PLEG): container finished" podID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" containerID="ef22fb623e65165a48517afde25fe646705346aefe9a43e502e6986b6a251909" exitCode=0
Jul 24 16:49:47.223186 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.223030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" event={"ID":"5a360ab5-fce3-43ca-9b90-887bcec66e0e","Type":"ContainerDied","Data":"ef22fb623e65165a48517afde25fe646705346aefe9a43e502e6986b6a251909"}
Jul 24 16:49:47.334373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.334304    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:49:47.456444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w82w7\" (UniqueName: \"kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456702 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456702 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456540    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456702 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456622    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456702 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home\") pod \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\" (UID: \"5a360ab5-fce3-43ca-9b90-887bcec66e0e\") "
Jul 24 16:49:47.456911 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:47.457057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:47.457057 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.456930    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home" (OuterVolumeSpecName: "home") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:47.457145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.457057    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:47.457145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.457073    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:47.457145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.457083    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:47.458878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.458850    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm" (OuterVolumeSpecName: "dshm") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:49:47.458878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.458859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:49:47.459030 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.458887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7" (OuterVolumeSpecName: "kube-api-access-w82w7") pod "5a360ab5-fce3-43ca-9b90-887bcec66e0e" (UID: "5a360ab5-fce3-43ca-9b90-887bcec66e0e"). InnerVolumeSpecName "kube-api-access-w82w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:49:47.558715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.558671    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w82w7\" (UniqueName: \"kubernetes.io/projected/5a360ab5-fce3-43ca-9b90-887bcec66e0e-kube-api-access-w82w7\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:47.558715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.558699    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a360ab5-fce3-43ca-9b90-887bcec66e0e-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:47.558715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:47.558713    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a360ab5-fce3-43ca-9b90-887bcec66e0e-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:49:48.191109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.191065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:49:48.191726 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.191707    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" containerName="main"
Jul 24 16:49:48.191797 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.191727    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" containerName="main"
Jul 24 16:49:48.191862 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.191838    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" containerName="main"
Jul 24 16:49:48.195434 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.195413    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.198827 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.198808    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a65dee\"/\"sub-test-model-a65dee-kserve-self-signed-certs\""
Jul 24 16:49:48.212966 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.210525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:49:48.230240 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.230194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp" event={"ID":"5a360ab5-fce3-43ca-9b90-887bcec66e0e","Type":"ContainerDied","Data":"c8656b4ad7015c3fcef2d3a671e31e5465b3bd694a62c1fee7b32f15b4eb96fa"}
Jul 24 16:49:48.230386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.230241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"
Jul 24 16:49:48.230386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.230270    2581 scope.go:117] "RemoveContainer" containerID="ef22fb623e65165a48517afde25fe646705346aefe9a43e502e6986b6a251909"
Jul 24 16:49:48.254505 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.254472    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:49:48.263062 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.263039    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/auth-test-model-a65dee-kserve-68dc894cc5-hvwgp"]
Jul 24 16:49:48.264915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.264895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.264987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.264924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.264987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.264958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2vf\" (UniqueName: \"kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.265069 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.265007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.265069 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.265037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.265147 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.265087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366444 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2vf\" (UniqueName: \"kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.366968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366934    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.367029 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.366984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.367029 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.367020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.368753 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.368732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.369024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.369006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.378772 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.378742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2vf\" (UniqueName: \"kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf\") pod \"sub-test-model-a65dee-kserve-7d697c6579-spm5r\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") " pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.505825 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.505739    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:48.650705 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:48.650678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:49:48.652763 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:49:48.652732    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcb3cd47_805a_4718_bb90_820e30105b7b.slice/crio-5911205a232be6a1d7453c95aa17f33e07d042cf4fd5b47c4e3c598ce98e610c WatchSource:0}: Error finding container 5911205a232be6a1d7453c95aa17f33e07d042cf4fd5b47c4e3c598ce98e610c: Status 404 returned error can't find the container with id 5911205a232be6a1d7453c95aa17f33e07d042cf4fd5b47c4e3c598ce98e610c
Jul 24 16:49:49.236685 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:49.236650    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" event={"ID":"bcb3cd47-805a-4718-bb90-820e30105b7b","Type":"ContainerStarted","Data":"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"}
Jul 24 16:49:49.237123 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:49.236694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" event={"ID":"bcb3cd47-805a-4718-bb90-820e30105b7b","Type":"ContainerStarted","Data":"5911205a232be6a1d7453c95aa17f33e07d042cf4fd5b47c4e3c598ce98e610c"}
Jul 24 16:49:49.254210 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:49.254156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" podStartSLOduration=1.254141502 podStartE2EDuration="1.254141502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:49:49.252989881 +0000 UTC m=+2634.198770191" watchObservedRunningTime="2026-07-24 16:49:49.254141502 +0000 UTC m=+2634.199921800"
Jul 24 16:49:49.487919 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:49.487830    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a360ab5-fce3-43ca-9b90-887bcec66e0e" path="/var/lib/kubelet/pods/5a360ab5-fce3-43ca-9b90-887bcec66e0e/volumes"
Jul 24 16:49:58.506543 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:58.506498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:58.506959 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:58.506564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:58.519274 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:58.519251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:49:59.301537 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:49:59.301504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:50:55.648361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:50:55.648291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:50:55.659019 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:50:55.658996    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:50:57.772108 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:50:57.772064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:51:12.796542 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:12.796484    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" podUID="bcb3cd47-805a-4718-bb90-820e30105b7b" containerName="main" containerID="cri-o://595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c" gracePeriod=45
Jul 24 16:51:13.055329 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.055253    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:51:13.211731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211694    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.211960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.211960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.211960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.211960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv2vf\" (UniqueName: \"kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.211960 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.211877    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm\") pod \"bcb3cd47-805a-4718-bb90-820e30105b7b\" (UID: \"bcb3cd47-805a-4718-bb90-820e30105b7b\") "
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache" (OuterVolumeSpecName: "model-cache") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212060    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home" (OuterVolumeSpecName: "home") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212275    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-tmp-dir\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212300    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-model-cache\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.212456 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.212316    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-home\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.214106 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.214055    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm" (OuterVolumeSpecName: "dshm") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:51:13.214207 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.214179    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 16:51:13.214207 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.214173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf" (OuterVolumeSpecName: "kube-api-access-wv2vf") pod "bcb3cd47-805a-4718-bb90-820e30105b7b" (UID: "bcb3cd47-805a-4718-bb90-820e30105b7b"). InnerVolumeSpecName "kube-api-access-wv2vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:51:13.313072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.312982    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb3cd47-805a-4718-bb90-820e30105b7b-tls-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.313072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.313014    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv2vf\" (UniqueName: \"kubernetes.io/projected/bcb3cd47-805a-4718-bb90-820e30105b7b-kube-api-access-wv2vf\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.313072 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.313030    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcb3cd47-805a-4718-bb90-820e30105b7b-dshm\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:51:13.685508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.685423    2581 generic.go:356] "Generic (PLEG): container finished" podID="bcb3cd47-805a-4718-bb90-820e30105b7b" containerID="595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c" exitCode=0
Jul 24 16:51:13.685508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.685466    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"
Jul 24 16:51:13.685508 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.685500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" event={"ID":"bcb3cd47-805a-4718-bb90-820e30105b7b","Type":"ContainerDied","Data":"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"}
Jul 24 16:51:13.685750 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.685541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r" event={"ID":"bcb3cd47-805a-4718-bb90-820e30105b7b","Type":"ContainerDied","Data":"5911205a232be6a1d7453c95aa17f33e07d042cf4fd5b47c4e3c598ce98e610c"}
Jul 24 16:51:13.685750 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.685557    2581 scope.go:117] "RemoveContainer" containerID="595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"
Jul 24 16:51:13.698162 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.697440    2581 scope.go:117] "RemoveContainer" containerID="595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"
Jul 24 16:51:13.698162 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:51:13.697793    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c\": container with ID starting with 595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c not found: ID does not exist" containerID="595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"
Jul 24 16:51:13.698162 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.697826    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c"} err="failed to get container status \"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c\": rpc error: code = NotFound desc = could not find container \"595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c\": container with ID starting with 595e30839f9a90496c79836a2414fd2fe3266a5e377562c9361d8662e1b2fe9c not found: ID does not exist"
Jul 24 16:51:13.702096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.702072    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:51:13.708067 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:13.708045    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a65dee/sub-test-model-a65dee-kserve-7d697c6579-spm5r"]
Jul 24 16:51:15.487516 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:51:15.487480    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb3cd47-805a-4718-bb90-820e30105b7b" path="/var/lib/kubelet/pods/bcb3cd47-805a-4718-bb90-820e30105b7b/volumes"
Jul 24 16:52:13.592528 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.592484    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822502818480"]
Jul 24 16:52:13.593048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.592898    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb3cd47-805a-4718-bb90-820e30105b7b" containerName="main"
Jul 24 16:52:13.593048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.592909    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb3cd47-805a-4718-bb90-820e30105b7b" containerName="main"
Jul 24 16:52:13.593048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.593014    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb3cd47-805a-4718-bb90-820e30105b7b" containerName="main"
Jul 24 16:52:13.596104 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.596088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:13.598263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.598245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bk744\""
Jul 24 16:52:13.601413 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.601392    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502818480"]
Jul 24 16:52:13.712108 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.712077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4btw\" (UniqueName: \"kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw\") pod \"test-curl-7546-139822502818480\" (UID: \"273d93c4-1517-4249-87b7-7dbb6e14c2f6\") " pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:13.813300 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.813265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4btw\" (UniqueName: \"kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw\") pod \"test-curl-7546-139822502818480\" (UID: \"273d93c4-1517-4249-87b7-7dbb6e14c2f6\") " pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:13.822552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.822526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4btw\" (UniqueName: \"kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw\") pod \"test-curl-7546-139822502818480\" (UID: \"273d93c4-1517-4249-87b7-7dbb6e14c2f6\") " pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:13.907035 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:13.906946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:14.066929 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:14.066899    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502818480"]
Jul 24 16:52:14.068619 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:14.068588    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod273d93c4_1517_4249_87b7_7dbb6e14c2f6.slice/crio-02758174d7a187071eb86db10dd21b2568358c6cf359c5f2cffcb766e7194f11 WatchSource:0}: Error finding container 02758174d7a187071eb86db10dd21b2568358c6cf359c5f2cffcb766e7194f11: Status 404 returned error can't find the container with id 02758174d7a187071eb86db10dd21b2568358c6cf359c5f2cffcb766e7194f11
Jul 24 16:52:14.070217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:14.070200    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:52:15.018636 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:15.018605    2581 generic.go:356] "Generic (PLEG): container finished" podID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" containerID="622800eb67e12e9c7037f38706c08217bcbe5e198c2c16d01ee4b20eb23b3d01" exitCode=0
Jul 24 16:52:15.019022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:15.018647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502818480" event={"ID":"273d93c4-1517-4249-87b7-7dbb6e14c2f6","Type":"ContainerDied","Data":"622800eb67e12e9c7037f38706c08217bcbe5e198c2c16d01ee4b20eb23b3d01"}
Jul 24 16:52:15.019022 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:15.018677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502818480" event={"ID":"273d93c4-1517-4249-87b7-7dbb6e14c2f6","Type":"ContainerStarted","Data":"02758174d7a187071eb86db10dd21b2568358c6cf359c5f2cffcb766e7194f11"}
Jul 24 16:52:16.168700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.168677    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:16.202549 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.202496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822502818480_273d93c4-1517-4249-87b7-7dbb6e14c2f6/test-curl-7546-139822502818480/0.log"
Jul 24 16:52:16.226477 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.226444    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822502818480"]
Jul 24 16:52:16.230425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.230402    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822502818480"]
Jul 24 16:52:16.241287 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.241268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4btw\" (UniqueName: \"kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw\") pod \"273d93c4-1517-4249-87b7-7dbb6e14c2f6\" (UID: \"273d93c4-1517-4249-87b7-7dbb6e14c2f6\") "
Jul 24 16:52:16.243465 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.243435    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw" (OuterVolumeSpecName: "kube-api-access-k4btw") pod "273d93c4-1517-4249-87b7-7dbb6e14c2f6" (UID: "273d93c4-1517-4249-87b7-7dbb6e14c2f6"). InnerVolumeSpecName "kube-api-access-k4btw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:16.342531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.342457    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4btw\" (UniqueName: \"kubernetes.io/projected/273d93c4-1517-4249-87b7-7dbb6e14c2f6-kube-api-access-k4btw\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:16.347684 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.347649    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822502818352"]
Jul 24 16:52:16.348152 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.348134    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" containerName="test-curl-7546-139822502818480"
Jul 24 16:52:16.348255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.348154    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" containerName="test-curl-7546-139822502818480"
Jul 24 16:52:16.348344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.348331    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" containerName="test-curl-7546-139822502818480"
Jul 24 16:52:16.351433 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.351414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:16.357208 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.357153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502818352"]
Jul 24 16:52:16.443418 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.443391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdj7w\" (UniqueName: \"kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w\") pod \"test-curl-7546-139822502818352\" (UID: \"241e1181-970f-43b8-834c-39fc5549d1b3\") " pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:16.544380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.544342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdj7w\" (UniqueName: \"kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w\") pod \"test-curl-7546-139822502818352\" (UID: \"241e1181-970f-43b8-834c-39fc5549d1b3\") " pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:16.552299 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.552279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdj7w\" (UniqueName: \"kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w\") pod \"test-curl-7546-139822502818352\" (UID: \"241e1181-970f-43b8-834c-39fc5549d1b3\") " pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:16.662401 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.662310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:16.796446 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:16.796301    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502818352"]
Jul 24 16:52:16.799102 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:16.799075    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod241e1181_970f_43b8_834c_39fc5549d1b3.slice/crio-317457c2fe29a7321edd353fc0c43210e9dedd73a4bac6d74a6dc9dc464609bc WatchSource:0}: Error finding container 317457c2fe29a7321edd353fc0c43210e9dedd73a4bac6d74a6dc9dc464609bc: Status 404 returned error can't find the container with id 317457c2fe29a7321edd353fc0c43210e9dedd73a4bac6d74a6dc9dc464609bc
Jul 24 16:52:17.030712 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:17.030681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502818352" event={"ID":"241e1181-970f-43b8-834c-39fc5549d1b3","Type":"ContainerStarted","Data":"317457c2fe29a7321edd353fc0c43210e9dedd73a4bac6d74a6dc9dc464609bc"}
Jul 24 16:52:17.031987 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:17.031966    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:17.032128 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:17.031990    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02758174d7a187071eb86db10dd21b2568358c6cf359c5f2cffcb766e7194f11"
Jul 24 16:52:17.042598 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:52:17.042573    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7546-139822502818480\" is forbidden: User \"system:node:ip-10-0-130-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-189.ec2.internal' and this object" podUID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" pod="opendatahub/test-curl-7546-139822502818480"
Jul 24 16:52:17.496425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:17.496295    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273d93c4-1517-4249-87b7-7dbb6e14c2f6" path="/var/lib/kubelet/pods/273d93c4-1517-4249-87b7-7dbb6e14c2f6/volumes"
Jul 24 16:52:18.039101 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:18.039065    2581 generic.go:356] "Generic (PLEG): container finished" podID="241e1181-970f-43b8-834c-39fc5549d1b3" containerID="9be77f0e7a08c530dfc525d51f0d5e3c32d5301a169f07ac54082b472b351519" exitCode=0
Jul 24 16:52:18.039311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:18.039150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502818352" event={"ID":"241e1181-970f-43b8-834c-39fc5549d1b3","Type":"ContainerDied","Data":"9be77f0e7a08c530dfc525d51f0d5e3c32d5301a169f07ac54082b472b351519"}
Jul 24 16:52:19.186337 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.186314    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:19.207101 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.207070    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822502818352_241e1181-970f-43b8-834c-39fc5549d1b3/test-curl-7546-139822502818352/0.log"
Jul 24 16:52:19.231471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.231437    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822502818352"]
Jul 24 16:52:19.233622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.233599    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822502818352"]
Jul 24 16:52:19.273053 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.273017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdj7w\" (UniqueName: \"kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w\") pod \"241e1181-970f-43b8-834c-39fc5549d1b3\" (UID: \"241e1181-970f-43b8-834c-39fc5549d1b3\") "
Jul 24 16:52:19.275255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.275201    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w" (OuterVolumeSpecName: "kube-api-access-xdj7w") pod "241e1181-970f-43b8-834c-39fc5549d1b3" (UID: "241e1181-970f-43b8-834c-39fc5549d1b3"). InnerVolumeSpecName "kube-api-access-xdj7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:19.373926 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.373841    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdj7w\" (UniqueName: \"kubernetes.io/projected/241e1181-970f-43b8-834c-39fc5549d1b3-kube-api-access-xdj7w\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:19.394915 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.394885    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:19.395366 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.395350    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241e1181-970f-43b8-834c-39fc5549d1b3" containerName="test-curl-7546-139822502818352"
Jul 24 16:52:19.395445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.395368    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="241e1181-970f-43b8-834c-39fc5549d1b3" containerName="test-curl-7546-139822502818352"
Jul 24 16:52:19.395483 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.395474    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="241e1181-970f-43b8-834c-39fc5549d1b3" containerName="test-curl-7546-139822502818352"
Jul 24 16:52:19.398623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.398608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:19.402640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.402616    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:19.475204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.475175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x99jq\" (UniqueName: \"kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq\") pod \"test-curl-7546-139822495160336\" (UID: \"4ad81def-c825-41f8-b7ce-d8f3762bf83e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:19.487943 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.487907    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241e1181-970f-43b8-834c-39fc5549d1b3" path="/var/lib/kubelet/pods/241e1181-970f-43b8-834c-39fc5549d1b3/volumes"
Jul 24 16:52:19.576184 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.576144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x99jq\" (UniqueName: \"kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq\") pod \"test-curl-7546-139822495160336\" (UID: \"4ad81def-c825-41f8-b7ce-d8f3762bf83e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:19.584893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.584862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x99jq\" (UniqueName: \"kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq\") pod \"test-curl-7546-139822495160336\" (UID: \"4ad81def-c825-41f8-b7ce-d8f3762bf83e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:19.709179 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.709101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:19.847337 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:19.847315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:19.848946 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:19.848918    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ad81def_c825_41f8_b7ce_d8f3762bf83e.slice/crio-e061ad8a35f8e66a0bbf994d39a1c6fab52c0dac580d90b94900c4efec5dd89e WatchSource:0}: Error finding container e061ad8a35f8e66a0bbf994d39a1c6fab52c0dac580d90b94900c4efec5dd89e: Status 404 returned error can't find the container with id e061ad8a35f8e66a0bbf994d39a1c6fab52c0dac580d90b94900c4efec5dd89e
Jul 24 16:52:20.050858 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:20.050828    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502818352"
Jul 24 16:52:20.051059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:20.050866    2581 scope.go:117] "RemoveContainer" containerID="9be77f0e7a08c530dfc525d51f0d5e3c32d5301a169f07ac54082b472b351519"
Jul 24 16:52:20.052247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:20.052128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822495160336" event={"ID":"4ad81def-c825-41f8-b7ce-d8f3762bf83e","Type":"ContainerStarted","Data":"e061ad8a35f8e66a0bbf994d39a1c6fab52c0dac580d90b94900c4efec5dd89e"}
Jul 24 16:52:21.058479 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:21.058447    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" containerID="5e3e7941e38ea3cb1b7c358d4f4982c051cf40ab713e1d46d738079497a66bf9" exitCode=0
Jul 24 16:52:21.058890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:21.058539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822495160336" event={"ID":"4ad81def-c825-41f8-b7ce-d8f3762bf83e","Type":"ContainerDied","Data":"5e3e7941e38ea3cb1b7c358d4f4982c051cf40ab713e1d46d738079497a66bf9"}
Jul 24 16:52:22.198608 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.198581    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.223719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.223677    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822495160336_4ad81def-c825-41f8-b7ce-d8f3762bf83e/test-curl-7546-139822495160336/0.log"
Jul 24 16:52:22.252785 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.252747    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:22.256343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.256320    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:22.307079 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.307048    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x99jq\" (UniqueName: \"kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq\") pod \"4ad81def-c825-41f8-b7ce-d8f3762bf83e\" (UID: \"4ad81def-c825-41f8-b7ce-d8f3762bf83e\") "
Jul 24 16:52:22.309136 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.309111    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq" (OuterVolumeSpecName: "kube-api-access-x99jq") pod "4ad81def-c825-41f8-b7ce-d8f3762bf83e" (UID: "4ad81def-c825-41f8-b7ce-d8f3762bf83e"). InnerVolumeSpecName "kube-api-access-x99jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:22.385095 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.385065    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:22.385515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.385502    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:22.385578 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.385518    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:22.385623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.385614    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:22.388598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.388584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.395862 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.395838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:22.408760 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.408736    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x99jq\" (UniqueName: \"kubernetes.io/projected/4ad81def-c825-41f8-b7ce-d8f3762bf83e-kube-api-access-x99jq\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:22.509450 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.509416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlmr\" (UniqueName: \"kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr\") pod \"test-curl-7546-139822495160336\" (UID: \"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.610782 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.610700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlmr\" (UniqueName: \"kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr\") pod \"test-curl-7546-139822495160336\" (UID: \"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.619152 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.619122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlmr\" (UniqueName: \"kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr\") pod \"test-curl-7546-139822495160336\" (UID: \"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e\") " pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.701747 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.701715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:22.839912 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:22.839884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:22.841355 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:22.841322    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca2606b0_1375_4ccd_a5be_edc0b64aaf9e.slice/crio-799de6c173b4cfd45d5d969d93e7fbff1c7ef44d556f55e1e58f1687fe238a80 WatchSource:0}: Error finding container 799de6c173b4cfd45d5d969d93e7fbff1c7ef44d556f55e1e58f1687fe238a80: Status 404 returned error can't find the container with id 799de6c173b4cfd45d5d969d93e7fbff1c7ef44d556f55e1e58f1687fe238a80
Jul 24 16:52:23.070012 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:23.069983    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:23.070175 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:23.070025    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e061ad8a35f8e66a0bbf994d39a1c6fab52c0dac580d90b94900c4efec5dd89e"
Jul 24 16:52:23.071248 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:23.071204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822495160336" event={"ID":"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e","Type":"ContainerStarted","Data":"799de6c173b4cfd45d5d969d93e7fbff1c7ef44d556f55e1e58f1687fe238a80"}
Jul 24 16:52:23.082451 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:23.082424    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7546-139822495160336" oldPodUID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" podUID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e"
Jul 24 16:52:23.488376 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:23.488298    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad81def-c825-41f8-b7ce-d8f3762bf83e" path="/var/lib/kubelet/pods/4ad81def-c825-41f8-b7ce-d8f3762bf83e/volumes"
Jul 24 16:52:24.077956 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:24.077919    2581 generic.go:356] "Generic (PLEG): container finished" podID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" containerID="d6493ac3010dc48a244e6b9b04e93f02126d4c35c2816030534ca873075401bc" exitCode=0
Jul 24 16:52:24.078139 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:24.077980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822495160336" event={"ID":"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e","Type":"ContainerDied","Data":"d6493ac3010dc48a244e6b9b04e93f02126d4c35c2816030534ca873075401bc"}
Jul 24 16:52:25.222489 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.222465    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:25.246900 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.246869    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822495160336_ca2606b0-1375-4ccd-a5be-edc0b64aaf9e/test-curl-7546-139822495160336/0.log"
Jul 24 16:52:25.276659 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.276637    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:25.281667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.281644    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822495160336"]
Jul 24 16:52:25.338934 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.338850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqlmr\" (UniqueName: \"kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr\") pod \"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e\" (UID: \"ca2606b0-1375-4ccd-a5be-edc0b64aaf9e\") "
Jul 24 16:52:25.340955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.340929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr" (OuterVolumeSpecName: "kube-api-access-wqlmr") pod "ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" (UID: "ca2606b0-1375-4ccd-a5be-edc0b64aaf9e"). InnerVolumeSpecName "kube-api-access-wqlmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:25.410995 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.410957    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:25.411489 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.411470    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:25.411596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.411489    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:25.411596 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.411584    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" containerName="test-curl-7546-139822495160336"
Jul 24 16:52:25.414533 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.414512    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:25.420354 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.420335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:25.440185 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.440165    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqlmr\" (UniqueName: \"kubernetes.io/projected/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e-kube-api-access-wqlmr\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:25.489349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.489319    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2606b0-1375-4ccd-a5be-edc0b64aaf9e" path="/var/lib/kubelet/pods/ca2606b0-1375-4ccd-a5be-edc0b64aaf9e/volumes"
Jul 24 16:52:25.540808 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.540785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddzpc\" (UniqueName: \"kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc\") pod \"test-curl-7546-139822502598096\" (UID: \"cab3bf58-3a2f-43ae-af2d-cc116f2120fc\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:25.641776 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.641690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddzpc\" (UniqueName: \"kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc\") pod \"test-curl-7546-139822502598096\" (UID: \"cab3bf58-3a2f-43ae-af2d-cc116f2120fc\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:25.651670 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.651640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddzpc\" (UniqueName: \"kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc\") pod \"test-curl-7546-139822502598096\" (UID: \"cab3bf58-3a2f-43ae-af2d-cc116f2120fc\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:25.725294 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.725259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:25.857065 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:25.857043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:25.859697 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:25.859670    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcab3bf58_3a2f_43ae_af2d_cc116f2120fc.slice/crio-9f53117a2864468fac80983ab3a0ba90e40e36360a630af8732be56148378b7c WatchSource:0}: Error finding container 9f53117a2864468fac80983ab3a0ba90e40e36360a630af8732be56148378b7c: Status 404 returned error can't find the container with id 9f53117a2864468fac80983ab3a0ba90e40e36360a630af8732be56148378b7c
Jul 24 16:52:26.090653 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:26.090612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502598096" event={"ID":"cab3bf58-3a2f-43ae-af2d-cc116f2120fc","Type":"ContainerStarted","Data":"9f53117a2864468fac80983ab3a0ba90e40e36360a630af8732be56148378b7c"}
Jul 24 16:52:26.091931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:26.091904    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822495160336"
Jul 24 16:52:26.091931 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:26.091919    2581 scope.go:117] "RemoveContainer" containerID="d6493ac3010dc48a244e6b9b04e93f02126d4c35c2816030534ca873075401bc"
Jul 24 16:52:27.099369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:27.099329    2581 generic.go:356] "Generic (PLEG): container finished" podID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" containerID="db8a343f632835cdb1dfa230d5a9f03ff788da7d065f8f9d18f437c6159d9391" exitCode=0
Jul 24 16:52:27.099749 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:27.099376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502598096" event={"ID":"cab3bf58-3a2f-43ae-af2d-cc116f2120fc","Type":"ContainerDied","Data":"db8a343f632835cdb1dfa230d5a9f03ff788da7d065f8f9d18f437c6159d9391"}
Jul 24 16:52:28.250527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.250497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.271059 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.271021    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822502598096_cab3bf58-3a2f-43ae-af2d-cc116f2120fc/test-curl-7546-139822502598096/0.log"
Jul 24 16:52:28.296347 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.296309    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:28.299374 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.299352    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:28.370077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.369972    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddzpc\" (UniqueName: \"kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc\") pod \"cab3bf58-3a2f-43ae-af2d-cc116f2120fc\" (UID: \"cab3bf58-3a2f-43ae-af2d-cc116f2120fc\") "
Jul 24 16:52:28.372253 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.372215    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc" (OuterVolumeSpecName: "kube-api-access-ddzpc") pod "cab3bf58-3a2f-43ae-af2d-cc116f2120fc" (UID: "cab3bf58-3a2f-43ae-af2d-cc116f2120fc"). InnerVolumeSpecName "kube-api-access-ddzpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:28.424790 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.424759    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:28.425258 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.425219    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:28.425258 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.425255    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:28.425391 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.425369    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:28.428417 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.428398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.434812 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.434788    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:28.471103 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.471073    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddzpc\" (UniqueName: \"kubernetes.io/projected/cab3bf58-3a2f-43ae-af2d-cc116f2120fc-kube-api-access-ddzpc\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:28.572321 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.572283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn8hx\" (UniqueName: \"kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx\") pod \"test-curl-7546-139822502598096\" (UID: \"596ae71c-d520-4809-968c-b1350b3e9096\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.673761 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.673685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn8hx\" (UniqueName: \"kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx\") pod \"test-curl-7546-139822502598096\" (UID: \"596ae71c-d520-4809-968c-b1350b3e9096\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.681674 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.681645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn8hx\" (UniqueName: \"kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx\") pod \"test-curl-7546-139822502598096\" (UID: \"596ae71c-d520-4809-968c-b1350b3e9096\") " pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.739610 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.739571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:28.874414 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:28.874384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:28.876461 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:28.876435    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod596ae71c_d520_4809_968c_b1350b3e9096.slice/crio-89e296ca76521fd09b2cfe10c32f421f21aa5d0e161add2c181a0ca46d79e5f5 WatchSource:0}: Error finding container 89e296ca76521fd09b2cfe10c32f421f21aa5d0e161add2c181a0ca46d79e5f5: Status 404 returned error can't find the container with id 89e296ca76521fd09b2cfe10c32f421f21aa5d0e161add2c181a0ca46d79e5f5
Jul 24 16:52:29.110494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:29.110461    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:29.110686 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:29.110469    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f53117a2864468fac80983ab3a0ba90e40e36360a630af8732be56148378b7c"
Jul 24 16:52:29.111688 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:29.111658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502598096" event={"ID":"596ae71c-d520-4809-968c-b1350b3e9096","Type":"ContainerStarted","Data":"89e296ca76521fd09b2cfe10c32f421f21aa5d0e161add2c181a0ca46d79e5f5"}
Jul 24 16:52:29.122263 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:29.122212    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7546-139822502598096" oldPodUID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" podUID="596ae71c-d520-4809-968c-b1350b3e9096"
Jul 24 16:52:29.488171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:29.488076    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab3bf58-3a2f-43ae-af2d-cc116f2120fc" path="/var/lib/kubelet/pods/cab3bf58-3a2f-43ae-af2d-cc116f2120fc/volumes"
Jul 24 16:52:30.118843 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:30.118808    2581 generic.go:356] "Generic (PLEG): container finished" podID="596ae71c-d520-4809-968c-b1350b3e9096" containerID="91b8f9b3c586274c44d2269100573cd55877b9aa024904072e58af280aa8d7dc" exitCode=0
Jul 24 16:52:30.119031 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:30.118896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139822502598096" event={"ID":"596ae71c-d520-4809-968c-b1350b3e9096","Type":"ContainerDied","Data":"91b8f9b3c586274c44d2269100573cd55877b9aa024904072e58af280aa8d7dc"}
Jul 24 16:52:31.266238 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.266207    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:31.287102 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.287080    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139822502598096_596ae71c-d520-4809-968c-b1350b3e9096/test-curl-7546-139822502598096/0.log"
Jul 24 16:52:31.295373 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.295352    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn8hx\" (UniqueName: \"kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx\") pod \"596ae71c-d520-4809-968c-b1350b3e9096\" (UID: \"596ae71c-d520-4809-968c-b1350b3e9096\") "
Jul 24 16:52:31.297450 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.297424    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx" (OuterVolumeSpecName: "kube-api-access-pn8hx") pod "596ae71c-d520-4809-968c-b1350b3e9096" (UID: "596ae71c-d520-4809-968c-b1350b3e9096"). InnerVolumeSpecName "kube-api-access-pn8hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:52:31.313667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.313643    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:31.322437 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.316770    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139822502598096"]
Jul 24 16:52:31.396090 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.396015    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn8hx\" (UniqueName: \"kubernetes.io/projected/596ae71c-d520-4809-968c-b1350b3e9096-kube-api-access-pn8hx\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:52:31.487578 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:31.487546    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="596ae71c-d520-4809-968c-b1350b3e9096" path="/var/lib/kubelet/pods/596ae71c-d520-4809-968c-b1350b3e9096/volumes"
Jul 24 16:52:32.079531 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.079495    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:52:32.080125 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.080095    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596ae71c-d520-4809-968c-b1350b3e9096" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:32.080125 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.080118    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="596ae71c-d520-4809-968c-b1350b3e9096" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:32.080361 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.080206    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="596ae71c-d520-4809-968c-b1350b3e9096" containerName="test-curl-7546-139822502598096"
Jul 24 16:52:32.083485 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.083466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.085688 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.085664    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b04709-openshift-default-dockercfg-kpbrw\""
Jul 24 16:52:32.093117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.093094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:52:32.102174 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102325 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102325 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqhn\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102325 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102363    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.102515 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.102476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.131165 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.131137    2581 scope.go:117] "RemoveContainer" containerID="91b8f9b3c586274c44d2269100573cd55877b9aa024904072e58af280aa8d7dc"
Jul 24 16:52:32.131333 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.131181    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139822502598096"
Jul 24 16:52:32.203446 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.203646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.203646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.203646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.203646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqhn\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204126 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.203833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.204655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.204949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.204918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.205971 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.205948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.206252 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.205963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.206811 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.206765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.206905 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.206828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.207761 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.207742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.213259 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.213212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.213598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.213577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqhn\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn\") pod \"e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") " pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.395102 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.395020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:32.543255 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.543195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:52:32.545138 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:32.545106    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dc0fbc_291a_497d_89ce_1d7a7c9eeb3f.slice/crio-5cb2d11e6b705ec694d4c06ba8ef89edcd47bef2f0be56a0ae4121087fbd9539 WatchSource:0}: Error finding container 5cb2d11e6b705ec694d4c06ba8ef89edcd47bef2f0be56a0ae4121087fbd9539: Status 404 returned error can't find the container with id 5cb2d11e6b705ec694d4c06ba8ef89edcd47bef2f0be56a0ae4121087fbd9539
Jul 24 16:52:32.547616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.547582    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:32.547684 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.547652    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:32.547719 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:32.547684    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:33.138331 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:33.138296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerStarted","Data":"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"}
Jul 24 16:52:33.138544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:33.138352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerStarted","Data":"5cb2d11e6b705ec694d4c06ba8ef89edcd47bef2f0be56a0ae4121087fbd9539"}
Jul 24 16:52:33.158047 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:33.158005    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podStartSLOduration=1.157990857 podStartE2EDuration="1.157990857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:33.156680144 +0000 UTC m=+2798.102460442" watchObservedRunningTime="2026-07-24 16:52:33.157990857 +0000 UTC m=+2798.103771219"
Jul 24 16:52:33.395879 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:33.395798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:33.401380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:33.401356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:34.147053 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:34.147018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:34.147984 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:34.147966    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:35.951976 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:35.951938    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:52:35.955722 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:35.955697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:35.959367 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:35.959343    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b04709\""
Jul 24 16:52:35.959367 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:35.959359    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b04709-dockercfg-j5wf7\""
Jul 24 16:52:35.966645 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:35.966623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:52:36.038183 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.038134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.038413 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.038196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k74n\" (UniqueName: \"kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.139078 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.139034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.139348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.139098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k74n\" (UniqueName: \"kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.139950 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.139928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.147623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.147599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k74n\" (UniqueName: \"kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n\") pod \"payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.268394 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.268350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:36.405976 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:36.405949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:52:36.407971 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:36.407939    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6964e35_daea_4f4f_8984_781a504db4f2.slice/crio-0d8fe65b48a3a3be40f8dcb841cac2b2e8aeaf34b23ef26c848c07c89ea5c919 WatchSource:0}: Error finding container 0d8fe65b48a3a3be40f8dcb841cac2b2e8aeaf34b23ef26c848c07c89ea5c919: Status 404 returned error can't find the container with id 0d8fe65b48a3a3be40f8dcb841cac2b2e8aeaf34b23ef26c848c07c89ea5c919
Jul 24 16:52:37.165709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:37.165675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" event={"ID":"c6964e35-daea-4f4f-8984-781a504db4f2","Type":"ContainerStarted","Data":"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"}
Jul 24 16:52:37.166112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:37.165729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" event={"ID":"c6964e35-daea-4f4f-8984-781a504db4f2","Type":"ContainerStarted","Data":"0d8fe65b48a3a3be40f8dcb841cac2b2e8aeaf34b23ef26c848c07c89ea5c919"}
Jul 24 16:52:37.166112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:37.165758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:37.181936 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:37.181889    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" podStartSLOduration=2.181871218 podStartE2EDuration="2.181871218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:37.179763159 +0000 UTC m=+2802.125543458" watchObservedRunningTime="2026-07-24 16:52:37.181871218 +0000 UTC m=+2802.127651520"
Jul 24 16:52:48.173310 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:48.173272    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:52:50.748459 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.748414    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:52:50.755199 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.755174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.757530 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.757510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-633b54-openshift-default-dockercfg-h4r7c\""
Jul 24 16:52:50.766464 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.766437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:52:50.888592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.888799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.888799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcr5p\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.888799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.888799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.889085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.889085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.889085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.889085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.888983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990427 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990631 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcr5p\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.990860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.990762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.991717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.991098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.991717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.991319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.991717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.991411    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.991717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.991573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.992021 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.991783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.993171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.993147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:50.993817 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:50.993800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:51.002718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.002637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:51.004968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.004939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcr5p\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p\") pod \"e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") " pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:51.068731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.068698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:51.236369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.236336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:52:51.238298 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:52:51.238273    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95263e5e_bcfd_4b48_8313_402faf21adaf.slice/crio-95181aa2de06fde79aaefb6a635aaed50cfdf8d977ae243d6089f163619b1489 WatchSource:0}: Error finding container 95181aa2de06fde79aaefb6a635aaed50cfdf8d977ae243d6089f163619b1489: Status 404 returned error can't find the container with id 95181aa2de06fde79aaefb6a635aaed50cfdf8d977ae243d6089f163619b1489
Jul 24 16:52:51.240571 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.240530    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:51.240665 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.240623    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:51.240717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.240700    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:51.255064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:51.255001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerStarted","Data":"95181aa2de06fde79aaefb6a635aaed50cfdf8d977ae243d6089f163619b1489"}
Jul 24 16:52:52.261652 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:52.261625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerStarted","Data":"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"}
Jul 24 16:52:52.284285 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:52.284237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podStartSLOduration=2.284207559 podStartE2EDuration="2.284207559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:52:52.281728436 +0000 UTC m=+2817.227508729" watchObservedRunningTime="2026-07-24 16:52:52.284207559 +0000 UTC m=+2817.229987858"
Jul 24 16:52:53.069060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.069029    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:53.074815 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.074787    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:53.274859 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.274825    2581 generic.go:356] "Generic (PLEG): container finished" podID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerID="9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426" exitCode=0
Jul 24 16:52:53.275346 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.274905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerDied","Data":"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"}
Jul 24 16:52:53.275346 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.275183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:53.275540 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.275523    2581 scope.go:117] "RemoveContainer" containerID="9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"
Jul 24 16:52:53.276375 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.276339    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:52:53.276619 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.276592    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:53.276667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.276655    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:53.276703 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:53.276691    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:52:54.282781 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:54.282751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerStarted","Data":"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"}
Jul 24 16:52:54.396207 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:54.396161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:54.396536 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:54.396505    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 16:52:54.396646 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:54.396567    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 16:52:55.395771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:55.395731    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 16:52:55.396290 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:55.395813    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 16:52:56.395822 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:56.395782    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 16:52:56.396327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:56.395850    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 16:52:57.395425 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:57.395386    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 24 16:52:57.395745 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:57.395712    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 24 16:52:58.412208 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:58.412133    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:58.412657 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:58.412598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:52:58.413374 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:52:58.413353    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:53:13.404497 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.404419    2581 generic.go:356] "Generic (PLEG): container finished" podID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerID="d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2" exitCode=0
Jul 24 16:53:13.404906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.404495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerDied","Data":"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"}
Jul 24 16:53:13.404952 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.404937    2581 scope.go:117] "RemoveContainer" containerID="d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"
Jul 24 16:53:13.406023 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.405993    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:53:13.406117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.406058    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:53:13.406117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:13.406090    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:53:14.415449 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:14.415405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerStarted","Data":"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"}
Jul 24 16:53:15.069110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:15.069079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:53:15.069342 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:15.069318    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 24 16:53:15.069399 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:15.069377    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 24 16:53:16.069398 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:16.069358    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 24 16:53:16.069801 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:16.069462    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 24 16:53:17.069968 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:17.069925    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 24 16:53:17.070494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:17.070006    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 24 16:53:18.069518 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:18.069480    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 24 16:53:18.069731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:18.069548    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 24 16:53:19.073850 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:19.073817    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:53:19.074327 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:19.074111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:53:19.074918 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:53:19.074902    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:54:02.652202 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:02.652125    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc_c6964e35-daea-4f4f-8984-781a504db4f2/payload-processing/0.log"
Jul 24 16:54:03.434766 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.434733    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:03.438927 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.438903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.441289 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.441268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8c969d-openshift-default-dockercfg-sk5mn\""
Jul 24 16:54:03.449883 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.449858    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.551700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.551762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brc48\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.551803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.551918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.552092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552247 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.552159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.552256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.552306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.552689 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.552334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.653494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.653494 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brc48\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654044 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.653954    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.654145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.654181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.654345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.654552 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.654408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.656017 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.655995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.656237 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.656208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.660606 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.660582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.660882 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.660862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brc48\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48\") pod \"e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") " pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.750544 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.750457    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:03.894027 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.894004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:03.895849 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:54:03.895820    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc953cd3c_5677_4362_9aa2_eb2a595b6b86.slice/crio-30107950b5a6f15b0054c899bab6676e734fdda92987367c073c00a17a2f11dd WatchSource:0}: Error finding container 30107950b5a6f15b0054c899bab6676e734fdda92987367c073c00a17a2f11dd: Status 404 returned error can't find the container with id 30107950b5a6f15b0054c899bab6676e734fdda92987367c073c00a17a2f11dd
Jul 24 16:54:03.898096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.898061    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:03.898166 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.898132    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:03.898204 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:03.898177    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:04.700949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:04.700907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerStarted","Data":"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"}
Jul 24 16:54:04.701345 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:04.700966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerStarted","Data":"30107950b5a6f15b0054c899bab6676e734fdda92987367c073c00a17a2f11dd"}
Jul 24 16:54:04.723383 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:04.723339    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podStartSLOduration=1.723324858 podStartE2EDuration="1.723324858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:54:04.722303497 +0000 UTC m=+2889.668083796" watchObservedRunningTime="2026-07-24 16:54:04.723324858 +0000 UTC m=+2889.669105156"
Jul 24 16:54:04.750747 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:04.750712    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:04.756464 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:04.756442    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:05.707033 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:05.707006    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:05.708060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:05.708042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:20.708893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.708801    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 24 16:54:20.708893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.708858    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 24 16:54:20.797187 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.797154    2581 generic.go:356] "Generic (PLEG): container finished" podID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerID="99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3" exitCode=0
Jul 24 16:54:20.797411 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.797258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerDied","Data":"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"}
Jul 24 16:54:20.797773 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.797754    2581 scope.go:117] "RemoveContainer" containerID="99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"
Jul 24 16:54:20.799014 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.798985    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:20.799073 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.799060    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:20.799111 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:20.799095    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 24 16:54:21.810004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:21.809955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerStarted","Data":"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"}
Jul 24 16:54:22.750903 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:22.750862    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:22.751127 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:22.751106    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 24 16:54:22.751177 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:22.751162    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 24 16:54:23.751343 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:23.751308    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 24 16:54:23.751731 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:23.751368    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 24 16:54:24.751168 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:24.751138    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 24 16:54:24.751359 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:24.751233    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 24 16:54:25.751527 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:25.751490    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 24 16:54:25.752010 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:25.751558    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 24 16:54:26.755267 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:26.755218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:26.755734 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:26.755681    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:26.756298 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:26.756277    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:44.115085 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:44.115049    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:44.115639 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:44.115359    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy" containerID="cri-o://a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd" gracePeriod=30
Jul 24 16:54:49.377181 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.377155    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:49.420906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.420817    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.420906 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.420876    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.420906    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.420967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.420998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brc48\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421142 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421129    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421140    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:49.421420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421206    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data\") pod \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\" (UID: \"c953cd3c-5677-4362-9aa2-eb2a595b6b86\") "
Jul 24 16:54:49.421420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421371    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:49.421420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:49.421662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421623    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.421662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421641    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.421662 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421654    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.421823 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.421682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:54:49.422572 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.422545    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data" (OuterVolumeSpecName: "istio-data") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:49.423923 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.423872    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token" (OuterVolumeSpecName: "istio-token") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:49.423923 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.423885    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48" (OuterVolumeSpecName: "kube-api-access-brc48") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "kube-api-access-brc48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:54:49.424113 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.423931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:54:49.424113 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.423945    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c953cd3c-5677-4362-9aa2-eb2a595b6b86" (UID: "c953cd3c-5677-4362-9aa2-eb2a595b6b86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:54:49.523171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523138    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.523171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523168    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.523171 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523177    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.523453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523185    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.523453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523193    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brc48\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-kube-api-access-brc48\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.523453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.523202    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c953cd3c-5677-4362-9aa2-eb2a595b6b86-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:54:49.986891 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.986850    2581 generic.go:356] "Generic (PLEG): container finished" podID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerID="a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd" exitCode=0
Jul 24 16:54:49.987064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.986912    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"
Jul 24 16:54:49.987064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.986928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerDied","Data":"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"}
Jul 24 16:54:49.987064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.987029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8" event={"ID":"c953cd3c-5677-4362-9aa2-eb2a595b6b86","Type":"ContainerDied","Data":"30107950b5a6f15b0054c899bab6676e734fdda92987367c073c00a17a2f11dd"}
Jul 24 16:54:49.987064 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.987060    2581 scope.go:117] "RemoveContainer" containerID="a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"
Jul 24 16:54:49.997097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:49.997077    2581 scope.go:117] "RemoveContainer" containerID="99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"
Jul 24 16:54:50.003595 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.003570    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:50.005818 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.005798    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8c969d-openshift-default-98b894586-r2cz8"]
Jul 24 16:54:50.006533 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.006519    2581 scope.go:117] "RemoveContainer" containerID="a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"
Jul 24 16:54:50.006795 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:54:50.006775    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd\": container with ID starting with a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd not found: ID does not exist" containerID="a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"
Jul 24 16:54:50.006871 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.006807    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd"} err="failed to get container status \"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd\": rpc error: code = NotFound desc = could not find container \"a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd\": container with ID starting with a2d3e97685e41f0049394263f7f08245114daa73d40b838cdf2b733ab1302bdd not found: ID does not exist"
Jul 24 16:54:50.006871 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.006833    2581 scope.go:117] "RemoveContainer" containerID="99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"
Jul 24 16:54:50.007080 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:54:50.007062    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3\": container with ID starting with 99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3 not found: ID does not exist" containerID="99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"
Jul 24 16:54:50.007122 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:50.007088    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3"} err="failed to get container status \"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3\": rpc error: code = NotFound desc = could not find container \"99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3\": container with ID starting with 99407e03e265694380b9ba37475c21ff7d2e2efe291f6a2f67bc70b0eb9eeff3 not found: ID does not exist"
Jul 24 16:54:51.487791 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:54:51.487757    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" path="/var/lib/kubelet/pods/c953cd3c-5677-4362-9aa2-eb2a595b6b86/volumes"
Jul 24 16:55:05.708617 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:05.708574    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:55:05.709539 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:05.709499    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" podUID="c6964e35-daea-4f4f-8984-781a504db4f2" containerName="payload-processing" containerID="cri-o://2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1" gracePeriod=30
Jul 24 16:55:05.985464 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:05.985440    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:55:06.074411 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.074381    2581 generic.go:356] "Generic (PLEG): container finished" podID="c6964e35-daea-4f4f-8984-781a504db4f2" containerID="2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1" exitCode=0
Jul 24 16:55:06.074592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.074422    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"
Jul 24 16:55:06.074592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.074463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" event={"ID":"c6964e35-daea-4f4f-8984-781a504db4f2","Type":"ContainerDied","Data":"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"}
Jul 24 16:55:06.074592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.074518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc" event={"ID":"c6964e35-daea-4f4f-8984-781a504db4f2","Type":"ContainerDied","Data":"0d8fe65b48a3a3be40f8dcb841cac2b2e8aeaf34b23ef26c848c07c89ea5c919"}
Jul 24 16:55:06.074592 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.074540    2581 scope.go:117] "RemoveContainer" containerID="2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"
Jul 24 16:55:06.083479 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.083435    2581 scope.go:117] "RemoveContainer" containerID="2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"
Jul 24 16:55:06.083715 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:55:06.083687    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1\": container with ID starting with 2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1 not found: ID does not exist" containerID="2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"
Jul 24 16:55:06.083797 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.083727    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1"} err="failed to get container status \"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1\": rpc error: code = NotFound desc = could not find container \"2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1\": container with ID starting with 2e765fc0539915e50db676f948a9448e84929afda514ea919e5a950d61c5b9b1 not found: ID does not exist"
Jul 24 16:55:06.087955 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.087936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k74n\" (UniqueName: \"kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n\") pod \"c6964e35-daea-4f4f-8984-781a504db4f2\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") "
Jul 24 16:55:06.088118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.088104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume\") pod \"c6964e35-daea-4f4f-8984-781a504db4f2\" (UID: \"c6964e35-daea-4f4f-8984-781a504db4f2\") "
Jul 24 16:55:06.088530 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.088501    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c6964e35-daea-4f4f-8984-781a504db4f2" (UID: "c6964e35-daea-4f4f-8984-781a504db4f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:55:06.090105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.090082    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n" (OuterVolumeSpecName: "kube-api-access-9k74n") pod "c6964e35-daea-4f4f-8984-781a504db4f2" (UID: "c6964e35-daea-4f4f-8984-781a504db4f2"). InnerVolumeSpecName "kube-api-access-9k74n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:55:06.189351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.189322    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c6964e35-daea-4f4f-8984-781a504db4f2-plugins-config-volume\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.189351 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.189348    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k74n\" (UniqueName: \"kubernetes.io/projected/c6964e35-daea-4f4f-8984-781a504db4f2-kube-api-access-9k74n\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:55:06.399445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.399406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:55:06.401520 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:06.401500    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b04709-749964d774-dw6zc"]
Jul 24 16:55:07.488548 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:07.488505    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6964e35-daea-4f4f-8984-781a504db4f2" path="/var/lib/kubelet/pods/c6964e35-daea-4f4f-8984-781a504db4f2/volumes"
Jul 24 16:55:55.681954 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:55.681926    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:55:55.695217 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:55.695195    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:55:58.758328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:58.758292    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:55:58.758819 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:55:58.758552    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy" containerID="cri-o://3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9" gracePeriod=30
Jul 24 16:56:04.020789 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.020728    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:56:04.071331 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071282    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071331 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071535 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071555    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071628 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rqhn\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071654    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071694    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.071831 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071739    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert\") pod \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\" (UID: \"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f\") "
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071617    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.072011    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.071824    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.072242    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.072268    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.072284    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.072445 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.072304    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:04.073176 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.073144    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:04.073776 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.073749    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:56:04.073776 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.073748    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn" (OuterVolumeSpecName: "kube-api-access-4rqhn") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "kube-api-access-4rqhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:04.073937 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.073887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:04.074290 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.074268    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" (UID: "29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:04.173757 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173718    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.173757 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173754    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.173757 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173763    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.173956 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173771    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.173956 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173780    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.173956 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.173788    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rqhn\" (UniqueName: \"kubernetes.io/projected/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f-kube-api-access-4rqhn\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:04.404280 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.404186    2581 generic.go:356] "Generic (PLEG): container finished" podID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerID="3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9" exitCode=0
Jul 24 16:56:04.404280 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.404248    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"
Jul 24 16:56:04.404280 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.404260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerDied","Data":"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"}
Jul 24 16:56:04.404510 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.404314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg" event={"ID":"29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f","Type":"ContainerDied","Data":"5cb2d11e6b705ec694d4c06ba8ef89edcd47bef2f0be56a0ae4121087fbd9539"}
Jul 24 16:56:04.404510 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.404337    2581 scope.go:117] "RemoveContainer" containerID="3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"
Jul 24 16:56:04.417393 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.417353    2581 scope.go:117] "RemoveContainer" containerID="9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"
Jul 24 16:56:04.425991 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.425954    2581 scope.go:117] "RemoveContainer" containerID="3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"
Jul 24 16:56:04.426214 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:04.426196    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9\": container with ID starting with 3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9 not found: ID does not exist" containerID="3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"
Jul 24 16:56:04.426322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.426243    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9"} err="failed to get container status \"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9\": rpc error: code = NotFound desc = could not find container \"3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9\": container with ID starting with 3d0673d513d01d1718403fd7bfc024f365de42419a69d6106a245dee6f68f5a9 not found: ID does not exist"
Jul 24 16:56:04.426322 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.426261    2581 scope.go:117] "RemoveContainer" containerID="9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"
Jul 24 16:56:04.426499 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:04.426480    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426\": container with ID starting with 9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426 not found: ID does not exist" containerID="9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"
Jul 24 16:56:04.426567 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.426505    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426"} err="failed to get container status \"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426\": rpc error: code = NotFound desc = could not find container \"9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426\": container with ID starting with 9bbd07a57dba2efd1f76f60bf50ca6707185ae03ec2da3101d2f6bafa3924426 not found: ID does not exist"
Jul 24 16:56:04.428365 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.428343    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:56:04.433771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:04.433751    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b04709-openshift-default-654dc8758-8svlg"]
Jul 24 16:56:05.487640 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:05.487605    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" path="/var/lib/kubelet/pods/29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f/volumes"
Jul 24 16:56:20.684109 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:20.684074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:56:20.684644 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:20.684345    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy" containerID="cri-o://305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac" gracePeriod=30
Jul 24 16:56:25.948328 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:25.948266    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:56:26.087094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087055    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087094 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087094    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcr5p\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087116    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087185    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087212    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087416 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087397    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087444    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087452    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:26.087723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087485    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket\") pod \"95263e5e-bcfd-4b48-8313-402faf21adaf\" (UID: \"95263e5e-bcfd-4b48-8313-402faf21adaf\") "
Jul 24 16:56:26.087723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:26.087723 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087701    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:26.088000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:26.088000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087905    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.088000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087931    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95263e5e-bcfd-4b48-8313-402faf21adaf-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.088000 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.087945    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.088510 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.088489    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data" (OuterVolumeSpecName: "istio-data") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:26.089677 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.089648    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:56:26.089770 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.089714    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p" (OuterVolumeSpecName: "kube-api-access-gcr5p") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "kube-api-access-gcr5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:26.089944 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.089924    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token" (OuterVolumeSpecName: "istio-token") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:26.090027 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.090003    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95263e5e-bcfd-4b48-8313-402faf21adaf" (UID: "95263e5e-bcfd-4b48-8313-402faf21adaf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:26.188833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188798    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.188833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188825    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.188833 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188836    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcr5p\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-kube-api-access-gcr5p\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.189074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188846    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.189074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188854    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.189074 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.188862    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95263e5e-bcfd-4b48-8313-402faf21adaf-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:26.525436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.525408    2581 generic.go:356] "Generic (PLEG): container finished" podID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerID="305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac" exitCode=0
Jul 24 16:56:26.525612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.525457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"
Jul 24 16:56:26.525612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.525501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerDied","Data":"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"}
Jul 24 16:56:26.525612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.525562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm" event={"ID":"95263e5e-bcfd-4b48-8313-402faf21adaf","Type":"ContainerDied","Data":"95181aa2de06fde79aaefb6a635aaed50cfdf8d977ae243d6089f163619b1489"}
Jul 24 16:56:26.525612 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.525587    2581 scope.go:117] "RemoveContainer" containerID="305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"
Jul 24 16:56:26.535587 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.535571    2581 scope.go:117] "RemoveContainer" containerID="d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"
Jul 24 16:56:26.543576 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.543561    2581 scope.go:117] "RemoveContainer" containerID="305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"
Jul 24 16:56:26.543813 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:26.543794    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac\": container with ID starting with 305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac not found: ID does not exist" containerID="305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"
Jul 24 16:56:26.543869 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.543825    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac"} err="failed to get container status \"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac\": rpc error: code = NotFound desc = could not find container \"305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac\": container with ID starting with 305f68de339f4f8d34cf76a6e7e4ec96996138d57361d0edca74629b7fe984ac not found: ID does not exist"
Jul 24 16:56:26.543869 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.543849    2581 scope.go:117] "RemoveContainer" containerID="d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"
Jul 24 16:56:26.544057 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:26.544042    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2\": container with ID starting with d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2 not found: ID does not exist" containerID="d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"
Jul 24 16:56:26.544096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.544061    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2"} err="failed to get container status \"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2\": rpc error: code = NotFound desc = could not find container \"d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2\": container with ID starting with d89859692b09d932817246c68e5af2e05daf822235133b85e02881ad481755b2 not found: ID does not exist"
Jul 24 16:56:26.547581 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.547561    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:56:26.550885 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:26.550866    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-633b54-openshift-default-85f79664f4-npkpm"]
Jul 24 16:56:27.493701 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:27.493666    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" path="/var/lib/kubelet/pods/95263e5e-bcfd-4b48-8313-402faf21adaf/volumes"
Jul 24 16:56:42.882701 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:42.882667    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:56:42.883284 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:42.882876    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" containerID="cri-o://15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e" gracePeriod=30
Jul 24 16:56:44.560598 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:44.560556    2581 patch_prober.go:28] interesting pod/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:56:44.560978 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:44.560634    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:56:48.151599 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.151532    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:56:48.215858 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.215831    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.215874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.215914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.215942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216048 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkbk7\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216081    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket\") pod \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\" (UID: \"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882\") "
Jul 24 16:56:48.216420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216116    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:48.216420 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216351    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:56:48.216616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216474    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.216616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216568    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:48.216616 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216599    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.216767 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:48.216989 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.216967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:48.218397 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.218368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:56:48.218397 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.218379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:56:48.218698 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.218680    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:48.218763 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.218741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7" (OuterVolumeSpecName: "kube-api-access-zkbk7") pod "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" (UID: "ddb744b6-5c0f-401e-bbd6-98ee7b0b1882"). InnerVolumeSpecName "kube-api-access-zkbk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:56:48.317105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317071    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317099    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317105 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317109    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkbk7\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-kube-api-access-zkbk7\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317117    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317127    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317158    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.317370 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.317166    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:56:48.644700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.644669    2581 generic.go:356] "Generic (PLEG): container finished" podID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerID="15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e" exitCode=0
Jul 24 16:56:48.644892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.644708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerDied","Data":"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"}
Jul 24 16:56:48.644892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.644716    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"
Jul 24 16:56:48.644892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.644753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd" event={"ID":"ddb744b6-5c0f-401e-bbd6-98ee7b0b1882","Type":"ContainerDied","Data":"e0ee819668fcbb87a1d1508127ac6e4fc8ee58c4509272e4c8544f0224f841cd"}
Jul 24 16:56:48.644892 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.644779    2581 scope.go:117] "RemoveContainer" containerID="15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"
Jul 24 16:56:48.655078 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.655062    2581 scope.go:117] "RemoveContainer" containerID="8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"
Jul 24 16:56:48.663004 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.662985    2581 scope.go:117] "RemoveContainer" containerID="15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"
Jul 24 16:56:48.663296 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:48.663276    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e\": container with ID starting with 15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e not found: ID does not exist" containerID="15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"
Jul 24 16:56:48.663379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.663305    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e"} err="failed to get container status \"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e\": rpc error: code = NotFound desc = could not find container \"15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e\": container with ID starting with 15262a72ba03e30d362a9c158b4f46fb4a2bbb39a9b9d906c212d9a4a2b0be5e not found: ID does not exist"
Jul 24 16:56:48.663379 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.663323    2581 scope.go:117] "RemoveContainer" containerID="8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"
Jul 24 16:56:48.663558 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:56:48.663536    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf\": container with ID starting with 8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf not found: ID does not exist" containerID="8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"
Jul 24 16:56:48.663656 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.663601    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf"} err="failed to get container status \"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf\": rpc error: code = NotFound desc = could not find container \"8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf\": container with ID starting with 8650fb57bd98d951ba9711808aadd4e99a6d4a5000471cf53a598b9c565c8daf not found: ID does not exist"
Jul 24 16:56:48.666145 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.666123    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:56:48.668510 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:48.668489    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a65dee-openshift-default-568dc97864-lqjcd"]
Jul 24 16:56:49.488319 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:56:49.488284    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" path="/var/lib/kubelet/pods/ddb744b6-5c0f-401e-bbd6-98ee7b0b1882/volumes"
Jul 24 16:57:04.800177 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:04.800140    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:57:04.800795 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:04.800472    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" containerID="cri-o://f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693" gracePeriod=30
Jul 24 16:57:07.435024 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:07.434989    2581 patch_prober.go:28] interesting pod/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 16:57:07.435453 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:07.435050    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 16:57:10.062654 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.062631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:57:10.226117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226146    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226173    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52nlb\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226273    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:57:10.226700 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket\") pod \"dd786387-79f2-47e4-ad1f-3730f8406f99\" (UID: \"dd786387-79f2-47e4-ad1f-3730f8406f99\") "
Jul 24 16:57:10.226814 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226735    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 16:57:10.226814 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226754    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:57:10.226814 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226756    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-certs\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.226975 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:57:10.227031 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.226999    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:57:10.228622 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.228588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb" (OuterVolumeSpecName: "kube-api-access-52nlb") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "kube-api-access-52nlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:57:10.228742 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.228625    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 16:57:10.228864 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.228840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 16:57:10.228925 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.228908    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd786387-79f2-47e4-ad1f-3730f8406f99" (UID: "dd786387-79f2-47e4-ad1f-3730f8406f99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 16:57:10.327466 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327432    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-token\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327466 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327460    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd786387-79f2-47e4-ad1f-3730f8406f99-istiod-ca-cert\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327466 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327472    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-workload-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327485    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-credential-socket\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327497    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-podinfo\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327510    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-data\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327520    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd786387-79f2-47e4-ad1f-3730f8406f99-istio-envoy\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.327706 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.327531    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52nlb\" (UniqueName: \"kubernetes.io/projected/dd786387-79f2-47e4-ad1f-3730f8406f99-kube-api-access-52nlb\") on node \"ip-10-0-130-189.ec2.internal\" DevicePath \"\""
Jul 24 16:57:10.761436 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.761400    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerID="f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693" exitCode=0
Jul 24 16:57:10.761634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.761457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"
Jul 24 16:57:10.761634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.761479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerDied","Data":"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"}
Jul 24 16:57:10.761634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.761534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt" event={"ID":"dd786387-79f2-47e4-ad1f-3730f8406f99","Type":"ContainerDied","Data":"3bb7ac0724db20043c75d808d652ce6221bbf74d1f643939604264b9b31a7542"}
Jul 24 16:57:10.761634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.761557    2581 scope.go:117] "RemoveContainer" containerID="f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"
Jul 24 16:57:10.770979 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.770964    2581 scope.go:117] "RemoveContainer" containerID="37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"
Jul 24 16:57:10.779417 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.779397    2581 scope.go:117] "RemoveContainer" containerID="f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"
Jul 24 16:57:10.779695 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:57:10.779673    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693\": container with ID starting with f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693 not found: ID does not exist" containerID="f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"
Jul 24 16:57:10.779780 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.779701    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693"} err="failed to get container status \"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693\": rpc error: code = NotFound desc = could not find container \"f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693\": container with ID starting with f2d42dfc213f6e13aba590e942f440e3655f260c979976844387e6241a4e7693 not found: ID does not exist"
Jul 24 16:57:10.779780 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.779719    2581 scope.go:117] "RemoveContainer" containerID="37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"
Jul 24 16:57:10.779943 ip-10-0-130-189 kubenswrapper[2581]: E0724 16:57:10.779927    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1\": container with ID starting with 37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1 not found: ID does not exist" containerID="37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"
Jul 24 16:57:10.779983 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.779950    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1"} err="failed to get container status \"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1\": rpc error: code = NotFound desc = could not find container \"37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1\": container with ID starting with 37f9afe11796528737e241d1b9c47348e025ec5a4c384d788e5ddbc0daa5d4a1 not found: ID does not exist"
Jul 24 16:57:10.783158 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.783138    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:57:10.787112 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.787091    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a29da6-openshift-default-545cc7f48-ps7lt"]
Jul 24 16:57:10.819949 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.819920    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-86frx_31212062-6d64-4685-ac04-639fde0c55c9/manager/0.log"
Jul 24 16:57:10.943152 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:10.943120    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f5pqp_4e06dd05-0382-4f6e-a9ef-bdae47fd7812/manager/0.log"
Jul 24 16:57:11.173814 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:11.173732    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lxjvm_3551fa5a-2b86-418e-9175-d972b3382a93/server/0.log"
Jul 24 16:57:11.296589 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:11.296551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-v9rwg_8b55df44-5868-4c2d-845a-c5c43770fdfd/manager/0.log"
Jul 24 16:57:11.492715 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:11.492637    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" path="/var/lib/kubelet/pods/dd786387-79f2-47e4-ad1f-3730f8406f99/volumes"
Jul 24 16:57:11.532313 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:11.532289    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-9sk74_2b81cdea-80c4-4b5c-a6d0-166eba27139f/copy-manifests/0.log"
Jul 24 16:57:11.540784 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:11.540762    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-9sk74_2b81cdea-80c4-4b5c-a6d0-166eba27139f/manager/0.log"
Jul 24 16:57:13.756269 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:13.756218    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8mm8k_286aae4e-2cad-46d9-a2f6-e722de9b0819/manager/0.log"
Jul 24 16:57:13.871584 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:13.871549    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t6thl_bd0cf85c-5619-4551-88c4-02458e073e84/manager/0.log"
Jul 24 16:57:14.106709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:14.106670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cr4xt_c01ade6c-4543-42fe-82e5-4a7bb3aec996/registry-server/0.log"
Jul 24 16:57:14.230369 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:14.230336    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vjdrh_a019ef64-a03d-44f1-8b4b-cadcf9d65c60/manager/0.log"
Jul 24 16:57:14.468686 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:14.468609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b2gh2_65b603eb-339e-4402-ad2d-acebca92cc6a/manager/0.log"
Jul 24 16:57:14.818432 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:14.818403    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8_27fd22a2-1c57-4275-97d1-7ecb7a4d1835/istio-proxy/0.log"
Jul 24 16:57:15.047501 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:15.047472    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd59bb69-qg8hj_ae79aced-a77f-4df3-9870-afaaa9a063dc/kube-auth-proxy/0.log"
Jul 24 16:57:15.285077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:15.285049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/1.log"
Jul 24 16:57:15.407771 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:15.407741    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p76rl_142de5a6-67aa-41fd-b731-36fa2c3abaeb/payload-pre-processing/0.log"
Jul 24 16:57:15.639279 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:15.639187    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d74b7cb7-j6qlv_89f28435-6d7e-46af-b76c-1ca8c4c9f1da/router/0.log"
Jul 24 16:57:16.106338 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:16.106307    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6hzdc_cb250e84-99a3-45d1-ac8c-7f65f3a7eba2/main/0.log"
Jul 24 16:57:16.226061 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:16.226030    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5m8v9_fdd08598-ca27-4d81-acd3-5644be9b871e/main/0.log"
Jul 24 16:57:16.565896 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:16.565865    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-54kvs_ce12cd3f-800a-4928-84f5-ebada2acfdd9/main/0.log"
Jul 24 16:57:22.187713 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.187680    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vptbp/must-gather-8f9dt"]
Jul 24 16:57:22.188077 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188065    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188078    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188087    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188093    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188104    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188110    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188121    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188127    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188131 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188133    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188138    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188146    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188152    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188163    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188172    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188179    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188184    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188189    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188203    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6964e35-daea-4f4f-8984-781a504db4f2" containerName="payload-processing"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188207    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6964e35-daea-4f4f-8984-781a504db4f2" containerName="payload-processing"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188296    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188304    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188310    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188317    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb744b6-5c0f-401e-bbd6-98ee7b0b1882" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188321    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188329    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd786387-79f2-47e4-ad1f-3730f8406f99" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188334    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6964e35-daea-4f4f-8984-781a504db4f2" containerName="payload-processing"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188339    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188346    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c953cd3c-5677-4362-9aa2-eb2a595b6b86" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188399    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.188412 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188405    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.189097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188469    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95263e5e-bcfd-4b48-8313-402faf21adaf" containerName="istio-proxy"
Jul 24 16:57:22.189097 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.188479    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="29dc0fbc-291a-497d-89ce-1d7a7c9eeb3f" containerName="istio-proxy"
Jul 24 16:57:22.193013 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.192992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.196709 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.196688    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vptbp\"/\"openshift-service-ca.crt\""
Jul 24 16:57:22.196917 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.196725    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vptbp\"/\"kube-root-ca.crt\""
Jul 24 16:57:22.197523 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.197501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vptbp\"/\"default-dockercfg-r859z\""
Jul 24 16:57:22.200551 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.200364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/must-gather-8f9dt"]
Jul 24 16:57:22.222110 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.222086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-must-gather-output\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.222206 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.222143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g4wl\" (UniqueName: \"kubernetes.io/projected/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-kube-api-access-4g4wl\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.323380 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.323354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-must-gather-output\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.323511 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.323423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g4wl\" (UniqueName: \"kubernetes.io/projected/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-kube-api-access-4g4wl\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.323637 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.323617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-must-gather-output\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.334122 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.334104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g4wl\" (UniqueName: \"kubernetes.io/projected/c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed-kube-api-access-4g4wl\") pod \"must-gather-8f9dt\" (UID: \"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed\") " pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.503118 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.503037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/must-gather-8f9dt"
Jul 24 16:57:22.642718 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.642692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/must-gather-8f9dt"]
Jul 24 16:57:22.645093 ip-10-0-130-189 kubenswrapper[2581]: W0724 16:57:22.645062    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc74ea0cd_bcf9_4fdb_ae60_b8968a61a5ed.slice/crio-62e5ec15b9a426fdfd726dd7493cc675ec1e19ecf38629efb0e75a4175dce407 WatchSource:0}: Error finding container 62e5ec15b9a426fdfd726dd7493cc675ec1e19ecf38629efb0e75a4175dce407: Status 404 returned error can't find the container with id 62e5ec15b9a426fdfd726dd7493cc675ec1e19ecf38629efb0e75a4175dce407
Jul 24 16:57:22.647377 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.647362    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 16:57:22.825473 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:22.825442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/must-gather-8f9dt" event={"ID":"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed","Type":"ContainerStarted","Data":"62e5ec15b9a426fdfd726dd7493cc675ec1e19ecf38629efb0e75a4175dce407"}
Jul 24 16:57:23.834574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:23.834480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/must-gather-8f9dt" event={"ID":"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed","Type":"ContainerStarted","Data":"28571303ffbc3e10e3ba931ff8693d35030c5f5f867a5868b53e87beb85df4a9"}
Jul 24 16:57:23.834574 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:23.834534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/must-gather-8f9dt" event={"ID":"c74ea0cd-bcf9-4fdb-ae60-b8968a61a5ed","Type":"ContainerStarted","Data":"22216c42b92df5f3d77619101033f398f95c946b31b322b845bb83a15a7cba02"}
Jul 24 16:57:23.850386 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:23.850317    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vptbp/must-gather-8f9dt" podStartSLOduration=0.930252898 podStartE2EDuration="1.85029797s" totalImagesPullingTime="920.045072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 16:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:57:23.848984195 +0000 UTC m=+3088.794764512" watchObservedRunningTime="2026-07-24 16:57:23.85029797 +0000 UTC m=+3088.796078267"
Jul 24 16:57:25.155860 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:25.155823    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2b9xc_c3c3a185-7e8d-4104-b229-7a08b508b311/global-pull-secret-syncer/0.log"
Jul 24 16:57:25.333409 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:25.333374    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r4tlm_a5fa79ce-1af8-4da1-b24e-72a044f8ccbd/konnectivity-agent/0.log"
Jul 24 16:57:25.393503 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:25.393457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-189.ec2.internal_184e074dc10ec1472e8fcaa4bff99132/haproxy/0.log"
Jul 24 16:57:30.224279 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:30.224244    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8mm8k_286aae4e-2cad-46d9-a2f6-e722de9b0819/manager/0.log"
Jul 24 16:57:30.249692 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:30.249661    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t6thl_bd0cf85c-5619-4551-88c4-02458e073e84/manager/0.log"
Jul 24 16:57:30.341857 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:30.341818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cr4xt_c01ade6c-4543-42fe-82e5-4a7bb3aec996/registry-server/0.log"
Jul 24 16:57:30.576175 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:30.576140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vjdrh_a019ef64-a03d-44f1-8b4b-cadcf9d65c60/manager/0.log"
Jul 24 16:57:30.759586 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:30.759453    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b2gh2_65b603eb-339e-4402-ad2d-acebca92cc6a/manager/0.log"
Jul 24 16:57:32.709711 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:32.709633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-drnjw_e1111b24-1671-43d0-8880-1e6b808bdb80/cluster-monitoring-operator/0.log"
Jul 24 16:57:33.040655 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.040617    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v288l_1f265f40-5f1e-42f4-bacb-297c46f560ac/node-exporter/0.log"
Jul 24 16:57:33.061096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.061068    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v288l_1f265f40-5f1e-42f4-bacb-297c46f560ac/kube-rbac-proxy/0.log"
Jul 24 16:57:33.086096 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.086064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v288l_1f265f40-5f1e-42f4-bacb-297c46f560ac/init-textfile/0.log"
Jul 24 16:57:33.435799 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.435719    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f88694c9d-8l9qt_1b0b6122-d5d2-48a1-b48a-9b24004a494b/telemeter-client/0.log"
Jul 24 16:57:33.459043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.458983    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f88694c9d-8l9qt_1b0b6122-d5d2-48a1-b48a-9b24004a494b/reload/0.log"
Jul 24 16:57:33.481349 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:33.481322    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f88694c9d-8l9qt_1b0b6122-d5d2-48a1-b48a-9b24004a494b/kube-rbac-proxy/0.log"
Jul 24 16:57:34.803994 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:34.803961    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-rgnb8_2450dc38-ba13-4aec-b1d0-334b0d0db42b/networking-console-plugin/0.log"
Jul 24 16:57:35.398050 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.398015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"]
Jul 24 16:57:35.402893 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.402867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.410824 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.410707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"]
Jul 24 16:57:35.434920 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.434898    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/1.log"
Jul 24 16:57:35.440585 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.440484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-szsnm_58dd30f1-8401-4836-a8f9-3da46b05452f/console-operator/2.log"
Jul 24 16:57:35.477661 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.477625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-podres\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.477861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.477735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-lib-modules\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.477861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.477771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5l7n\" (UniqueName: \"kubernetes.io/projected/200324d0-8c31-4a6f-855d-4604afddf5db-kube-api-access-c5l7n\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.477861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.477808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-proc\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.478046 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.477861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-sys\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.578836 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.578789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-lib-modules\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579032 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.578866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5l7n\" (UniqueName: \"kubernetes.io/projected/200324d0-8c31-4a6f-855d-4604afddf5db-kube-api-access-c5l7n\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579032 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.578907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-proc\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579032 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.578963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-sys\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579216 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.579040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-podres\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.579318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-lib-modules\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579717 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.579693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-proc\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.579810 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.579765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-sys\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.580219 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.580195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/200324d0-8c31-4a6f-855d-4604afddf5db-podres\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.588119 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.588094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5l7n\" (UniqueName: \"kubernetes.io/projected/200324d0-8c31-4a6f-855d-4604afddf5db-kube-api-access-c5l7n\") pod \"perf-node-gather-daemonset-2jxk9\" (UID: \"200324d0-8c31-4a6f-855d-4604afddf5db\") " pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.719117 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.719030    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:35.908844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.908814    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"]
Jul 24 16:57:35.936774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:35.936695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9" event={"ID":"200324d0-8c31-4a6f-855d-4604afddf5db","Type":"ContainerStarted","Data":"e3a2a06e6432b3aa249940e2e4c20ba0dfa6aa5d53a09ada6ebd49bdd303e1c6"}
Jul 24 16:57:36.603623 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:36.603594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-z65wn_25510c44-793c-46fc-802c-45cb8361af75/volume-data-source-validator/0.log"
Jul 24 16:57:36.944344 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:36.944253    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9" event={"ID":"200324d0-8c31-4a6f-855d-4604afddf5db","Type":"ContainerStarted","Data":"40df6884bbc70bea396f73e09da6db7c9c444291289dcabcf3d8233b9d709b95"}
Jul 24 16:57:36.944788 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:36.944347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:36.962890 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:36.962833    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9" podStartSLOduration=1.962811164 podStartE2EDuration="1.962811164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 16:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 16:57:36.959980058 +0000 UTC m=+3101.905760356" watchObservedRunningTime="2026-07-24 16:57:36.962811164 +0000 UTC m=+3101.908591463"
Jul 24 16:57:37.672504 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:37.672469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lkrpt_53a44290-1bcc-4162-b399-4c4712855bf9/dns/0.log"
Jul 24 16:57:37.693513 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:37.693485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lkrpt_53a44290-1bcc-4162-b399-4c4712855bf9/kube-rbac-proxy/0.log"
Jul 24 16:57:37.794442 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:37.794406    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rl87m_f5145161-3ca1-460a-8fda-08dd3a8511d0/dns-node-resolver/0.log"
Jul 24 16:57:38.408910 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:38.408877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qk29m_d8d2f57c-3eb4-4f54-9853-24f65d577a32/node-ca/0.log"
Jul 24 16:57:39.321869 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.321841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8_27fd22a2-1c57-4275-97d1-7ecb7a4d1835/istio-proxy/0.log"
Jul 24 16:57:39.490311 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.490279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd59bb69-qg8hj_ae79aced-a77f-4df3-9870-afaaa9a063dc/kube-auth-proxy/0.log"
Jul 24 16:57:39.545103 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.545069    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/0.log"
Jul 24 16:57:39.603419 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.603337    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/1.log"
Jul 24 16:57:39.646634 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.646599    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p76rl_142de5a6-67aa-41fd-b731-36fa2c3abaeb/payload-pre-processing/0.log"
Jul 24 16:57:39.699113 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:39.699076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d74b7cb7-j6qlv_89f28435-6d7e-46af-b76c-1ca8c4c9f1da/router/0.log"
Jul 24 16:57:40.492649 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:40.492617    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8f6rc_3eff99bf-f98f-461d-988e-2e78d5e03899/serve-healthcheck-canary/0.log"
Jul 24 16:57:41.002180 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:41.002137    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9k8pw_bbadbd8b-ced4-4d90-a17a-5686275f4839/insights-operator/0.log"
Jul 24 16:57:41.003774 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:41.003743    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9k8pw_bbadbd8b-ced4-4d90-a17a-5686275f4839/insights-operator/1.log"
Jul 24 16:57:41.024431 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:41.024405    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl2dn_811057f4-42f1-4b2e-ad21-645420760bbf/kube-rbac-proxy/0.log"
Jul 24 16:57:41.043997 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:41.043967    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl2dn_811057f4-42f1-4b2e-ad21-645420760bbf/exporter/0.log"
Jul 24 16:57:41.065895 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:41.065870    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl2dn_811057f4-42f1-4b2e-ad21-645420760bbf/extractor/0.log"
Jul 24 16:57:42.961521 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:42.961497    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vptbp/perf-node-gather-daemonset-2jxk9"
Jul 24 16:57:43.289246 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:43.289191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-86frx_31212062-6d64-4685-ac04-639fde0c55c9/manager/0.log"
Jul 24 16:57:43.670371 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:43.670275    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f5pqp_4e06dd05-0382-4f6e-a9ef-bdae47fd7812/manager/0.log"
Jul 24 16:57:43.839060 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:43.839032    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lxjvm_3551fa5a-2b86-418e-9175-d972b3382a93/server/0.log"
Jul 24 16:57:43.977882 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:43.977395    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-v9rwg_8b55df44-5868-4c2d-845a-c5c43770fdfd/manager/0.log"
Jul 24 16:57:44.055207 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:44.055108    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-9sk74_2b81cdea-80c4-4b5c-a6d0-166eba27139f/manager/0.log"
Jul 24 16:57:44.075844 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:44.075822    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6c795b6-9sk74_2b81cdea-80c4-4b5c-a6d0-166eba27139f/copy-manifests/0.log"
Jul 24 16:57:45.705278 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:45.705245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8_27fd22a2-1c57-4275-97d1-7ecb7a4d1835/istio-proxy/0.log"
Jul 24 16:57:45.845360 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:45.845317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd59bb69-qg8hj_ae79aced-a77f-4df3-9870-afaaa9a063dc/kube-auth-proxy/0.log"
Jul 24 16:57:45.878861 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:45.878827    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/0.log"
Jul 24 16:57:45.932704 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:45.932668    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/1.log"
Jul 24 16:57:45.967870 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:45.967840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p76rl_142de5a6-67aa-41fd-b731-36fa2c3abaeb/payload-pre-processing/0.log"
Jul 24 16:57:46.002572 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:46.002540    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d74b7cb7-j6qlv_89f28435-6d7e-46af-b76c-1ca8c4c9f1da/router/0.log"
Jul 24 16:57:47.437615 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.437528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-s8rp8_27fd22a2-1c57-4275-97d1-7ecb7a4d1835/istio-proxy/0.log"
Jul 24 16:57:47.591043 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.591004    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd59bb69-qg8hj_ae79aced-a77f-4df3-9870-afaaa9a063dc/kube-auth-proxy/0.log"
Jul 24 16:57:47.630667 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.630636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/0.log"
Jul 24 16:57:47.690748 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.690659    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-s5z69_ae7f20ed-66be-4a98-8409-cd90d7b6716e/istio-proxy/1.log"
Jul 24 16:57:47.720630 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.720604    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p76rl_142de5a6-67aa-41fd-b731-36fa2c3abaeb/payload-pre-processing/0.log"
Jul 24 16:57:47.760297 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:47.760271    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d74b7cb7-j6qlv_89f28435-6d7e-46af-b76c-1ca8c4c9f1da/router/0.log"
Jul 24 16:57:50.700471 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:50.700436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cmmz2_d7b0b757-9856-4c76-acf5-362b475510ea/migrator/0.log"
Jul 24 16:57:50.720526 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:50.720495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cmmz2_d7b0b757-9856-4c76-acf5-362b475510ea/graceful-termination/0.log"
Jul 24 16:57:51.089852 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:51.089813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-l845t_59f51710-f801-48d4-8e26-4186ab4ddb71/kube-storage-version-migrator-operator/1.log"
Jul 24 16:57:51.092031 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:51.092003    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-l845t_59f51710-f801-48d4-8e26-4186ab4ddb71/kube-storage-version-migrator-operator/0.log"
Jul 24 16:57:52.053627 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.053598    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/kube-multus-additional-cni-plugins/0.log"
Jul 24 16:57:52.073878 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.073854    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/egress-router-binary-copy/0.log"
Jul 24 16:57:52.098976 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.098959    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/cni-plugins/0.log"
Jul 24 16:57:52.118739 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.118718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/bond-cni-plugin/0.log"
Jul 24 16:57:52.138348 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.138326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/routeoverride-cni/0.log"
Jul 24 16:57:52.157953 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.157934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/whereabouts-cni-bincopy/0.log"
Jul 24 16:57:52.178609 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.178584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g9j5h_0f12bcaa-2383-458d-9b20-e1b1c90cba96/whereabouts-cni/0.log"
Jul 24 16:57:52.535264 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.535235    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jg65c_8edc9564-d43d-4fb5-adb7-c9229292e4a9/kube-multus/0.log"
Jul 24 16:57:52.593296 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.593191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4h4nw_f6dd050c-bb36-4b36-aa9c-f972635cec1e/network-metrics-daemon/0.log"
Jul 24 16:57:52.607876 ip-10-0-130-189 kubenswrapper[2581]: I0724 16:57:52.607853    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4h4nw_f6dd050c-bb36-4b36-aa9c-f972635cec1e/kube-rbac-proxy/0.log"