Sep 12 00:42:55.678922 ip-10-0-142-242 systemd[1]: Starting Kubernetes Kubelet...
Sep 12 00:42:56.116657 ip-10-0-142-242 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:42:56.116657 ip-10-0-142-242 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 12 00:42:56.116657 ip-10-0-142-242 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:42:56.116657 ip-10-0-142-242 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 12 00:42:56.116657 ip-10-0-142-242 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 00:42:56.126851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.120807    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 12 00:42:56.130362 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130335    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.130362 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130362    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.130362 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130366    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.130362 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130370    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.130362 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130373    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130377    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130380    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130382    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130385    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130387    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130390    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130392    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130395    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130398    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130400    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130403    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130406    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130409    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130412    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130414    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130417    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130419    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130422    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130425    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.130525 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130427    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130430    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130432    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130435    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130438    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130440    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130443    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130446    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130449    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130451    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130453    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130458    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130461    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130464    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130468    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130482    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130487    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130491    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130493    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.131051 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130496    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130499    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130502    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130504    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130507    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130509    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130512    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130514    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130517    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130520    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130522    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130525    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130528    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130531    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130533    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130536    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130539    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130542    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130546    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130548    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.131767 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130551    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130554    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130557    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130560    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130562    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130565    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130567    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130570    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130572    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130575    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130577    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130580    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130583    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130587    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130589    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130592    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130594    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130596    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130599    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130601    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.132361 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130604    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130607    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130610    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130612    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130614    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130617    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130619    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130639    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130642    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130645    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130647    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130650    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130652    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130655    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130660    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.132865 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.130663    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.133318 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133301    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.133318 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133317    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133321    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133324    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133327    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133330    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133333    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133336    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133339    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133343    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133346    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133349    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133352    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133354    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133357    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133360    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133363    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133365    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133368    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133371    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.133369 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133373    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133376    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133379    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133382    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133385    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133387    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133390    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133393    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133396    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133398    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133401    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133403    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133406    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133408    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133411    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133415    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133420    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133423    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133426    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133429    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.133860 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133432    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133435    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133438    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133441    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133443    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133445    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133448    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133450    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133453    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133455    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133459    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133461    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133465    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133468    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133472    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133476    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133480    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133483    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133486    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.134349 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133489    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133493    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133495    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133498    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133501    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133503    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133506    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133508    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133511    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133514    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133516    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133519    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133522    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133525    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133527    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133530    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133533    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133535    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133538    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133540    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.134837 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133543    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133545    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133548    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133550    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133553    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133556    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133558    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133562    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133564    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133569    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133572    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133574    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133577    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133579    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133582    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133584    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133587    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133589    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133591    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133594    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.135343 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133992    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.133998    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134001    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134004    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134007    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134009    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134012    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134014    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134017    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134020    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134022    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134025    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134029    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134032    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134035    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134037    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134040    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134043    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134046    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.135845 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134049    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134052    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134056    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134060    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134064    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134068    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134071    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134073    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134076    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134079    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134082    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134084    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134087    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134089    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134092    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134095    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134097    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134100    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134102    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.136305 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134105    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134107    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134109    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134112    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134115    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134118    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134122    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134125    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134128    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134130    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134133    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134137    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134139    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134142    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134145    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134149    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134151    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134155    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134157    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134160    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.136816 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134163    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134165    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134168    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134170    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134172    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134178    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134180    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134182    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134185    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134187    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134190    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134192    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134195    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134197    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134200    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134202    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134204    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134207    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134209    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.137309 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134212    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134214    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134216    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134219    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134222    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134225    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134228    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134231    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134234    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134236    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134239    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134241    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134244    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134246    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134249    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134251    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134254    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134256    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134258    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134261    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.137821 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.134263    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134344    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134377    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134383    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134388    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134392    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134395    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134400    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134404    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134407    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134410    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134413    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134417    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134420    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134423    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134426    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134429    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134433    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134436    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134443    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134446    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134449    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134452    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134455    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 12 00:42:56.138344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134463    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134466    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134469    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134481    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134484    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134487    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134490    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134493    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134496    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134500    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134503    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134506    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134509    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134512    2576 flags.go:64] FLAG: --enable-server="true"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134515    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134518    2576 flags.go:64] FLAG: --event-burst="100"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134522    2576 flags.go:64] FLAG: --event-qps="50"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134524    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134527    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134530    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134533    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134536    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134539    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134542    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134545    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 12 00:42:56.138943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134548    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134554    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134559    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134561    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134564    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134567    2576 flags.go:64] FLAG: --feature-gates=""
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134571    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134574    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134576    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134579    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134582    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134585    2576 flags.go:64] FLAG: --help="false"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134588    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134591    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134594    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134597    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134600    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134603    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134606    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134609    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134611    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134614    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134617    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134636    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 12 00:42:56.139554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134641    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134644    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134647    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134650    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134654    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134657    2576 flags.go:64] FLAG: --lock-file=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134660    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134663    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134666    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134671    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134677    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134680    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134683    2576 flags.go:64] FLAG: --logging-format="text"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134686    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134689    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134692    2576 flags.go:64] FLAG: --manifest-url=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134695    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134699    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134702    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134707    2576 flags.go:64] FLAG: --max-pods="110"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134710    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134712    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134715    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134718    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134721    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 12 00:42:56.140175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134724    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134727    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134735    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134738    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134740    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134743    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134746    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134751    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134754    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134757    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134760    2576 flags.go:64] FLAG: --port="10250"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134763    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134767    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0307f4b5dab8f692e"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134771    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134774    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134776    2576 flags.go:64] FLAG: --register-node="true"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134779    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134784    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134787    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134790    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134793    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134797    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134800    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134803    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134805    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 12 00:42:56.140904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134808    2576 flags.go:64] FLAG: --runonce="false"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134811    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134814    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134817    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134820    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134822    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134825    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134828    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134831    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134834    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134837    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134840    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134843    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134846    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134849    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134852    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134858    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134861    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134863    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134870    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134872    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134875    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134878    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134881    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134885    2576 flags.go:64] FLAG: --v="2"
Sep 12 00:42:56.141506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134889    2576 flags.go:64] FLAG: --version="false"
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134894    2576 flags.go:64] FLAG: --vmodule=""
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134897    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.134900    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135022    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135025    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135028    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135031    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135034    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135037    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135039    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135042    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135045    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135048    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135050    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135053    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135055    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135058    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135060    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135063    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.142201 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135065    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135068    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135070    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135072    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135075    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135077    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135081    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135083    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135086    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135088    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135091    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135095    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135098    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135100    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135103    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135105    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135108    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135110    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135114    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135116    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.142750 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135118    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135122    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135126    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135129    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135132    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135135    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135137    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135140    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135143    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135146    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135148    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135152    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135154    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135157    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135159    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135161    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135164    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135166    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135170    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.143251 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135172    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135175    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135178    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135180    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135184    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135187    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135189    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135192    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135200    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135203    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135206    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135208    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135211    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135213    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135216    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135218    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135220    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135224    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135228    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135230    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.143753 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135233    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135235    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135237    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135240    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135242    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135245    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135248    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135250    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135252    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135255    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135257    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135262    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135265    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135267    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135270    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135273    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135277    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135279    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135283    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.144226 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135286    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135289    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135293    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135295    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.135298    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.136102    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.143676    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.143692    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.144590    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.144597    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144675    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144682    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144686    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144689    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144692    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.144784 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144695    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144698    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144701    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144703    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144706    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144708    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144711    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144713    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144716    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144719    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144722    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144725    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144727    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144730    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144733    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144735    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144738    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144740    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144743    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144745    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.145157 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144748    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144752    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144755    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144758    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144763    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144766    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144768    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144771    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144774    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144776    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144779    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144781    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144784    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144786    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144789    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144792    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144795    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144797    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144800    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144803    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.145686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144805    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144808    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144811    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144813    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144816    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144818    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144821    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144823    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144825    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144828    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144830    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144833    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144835    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144839    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144843    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144846    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144850    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144853    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144856    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.146177 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144859    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144861    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144864    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144866    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144869    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144871    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144874    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144876    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144879    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144881    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144884    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144886    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144889    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144893    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144896    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144899    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144902    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144905    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144908    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.146665 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144911    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144914    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144916    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144919    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144921    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144924    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144926    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144929    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144931    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144934    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144937    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144939    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144942    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144946    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144948    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.147114 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.144950    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.144955    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145092    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145096    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145100    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145103    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145106    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145108    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145111    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145114    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145117    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145120    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145123    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145126    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145129    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 00:42:56.147481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145132    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145135    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145137    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145140    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145144    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145147    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145151    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145154    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145156    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145159    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145162    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145165    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145168    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145171    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145174    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145178    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145180    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145183    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145185    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 00:42:56.147862 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145188    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145190    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145193    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145195    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145198    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145200    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145203    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145205    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145208    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145210    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145213    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145215    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145218    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145220    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145223    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145225    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145228    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145230    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145233    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145235    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 00:42:56.148353 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145238    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145240    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145243    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145245    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145248    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145250    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145253    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145256    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145259    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145261    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145264    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145267    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145269    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145271    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145274    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145276    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145279    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145281    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145284    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 00:42:56.148859 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145286    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145289    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145291    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145295    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145299    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145302    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145304    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145307    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145309    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145312    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145314    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145317    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145319    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145322    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145324    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145327    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145330    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145332    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145335    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145337    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 00:42:56.149420 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145346    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145349    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145351    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145356    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145359    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145362    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145364    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:56.145367    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.145372    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.145483    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.147935    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.149022    2576 server.go:1019] "Starting client certificate rotation"
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.149132    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 00:42:56.149981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.149175    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 00:42:56.152118 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.152102    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 00:42:56.157664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.157645    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 00:42:56.166063 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.166043    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 12 00:42:56.169392 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.169376    2576 log.go:25] "Validated CRI v1 image API"
Sep 12 00:42:56.170190 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.170176    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 12 00:42:56.174423 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.174403    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 980141aa-0ec7-416a-80cb-40e65cd911e7:/dev/nvme0n1p3 eea92912-6e5d-402a-8844-e70029cde153:/dev/nvme0n1p4]
Sep 12 00:42:56.174490 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.174421    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 12 00:42:56.180435 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.180326    2576 manager.go:216] Machine: {Timestamp:2026-09-12 00:42:56.178108147 +0000 UTC m=+0.371437161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096931 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec245dc8243b1a20318cc4930a090280 SystemUUID:ec245dc8-243b-1a20-318c-c4930a090280 BootID:4f14b38e-72cc-469e-8f37-7a7da1735121 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:e9:17:d0:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:e9:17:d0:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:f4:7f:c0:bb:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 12 00:42:56.180435 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.180426    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 12 00:42:56.180552 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.180507    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 12 00:42:56.180892 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.180878    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 00:42:56.181662 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.181641    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 12 00:42:56.181790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.181665    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 12 00:42:56.183220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.183210    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 12 00:42:56.183251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.183222    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 12 00:42:56.183251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.183230    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 00:42:56.183995 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.183986    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 00:42:56.185132 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.185122    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 12 00:42:56.189420 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189409    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 00:42:56.189522 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189514    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 12 00:42:56.189551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189543    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 12 00:42:56.189577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189556    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 12 00:42:56.189577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189571    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 12 00:42:56.189653 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189580    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 12 00:42:56.189653 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189589    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 12 00:42:56.189958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189945    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 00:42:56.189996 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.189966    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 00:42:56.198962 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.198941    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 12 00:42:56.201888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.201871    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 12 00:42:56.201966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.201910    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 12 00:42:56.204597 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.204564    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204646    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.204655    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204671    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204681    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204689    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204701    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 12 00:42:56.204708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204711    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204730    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204738    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204749    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204757    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204776    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 12 00:42:56.204942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.204786    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 12 00:42:56.205668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.205655    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 12 00:42:56.205727 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.205670    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 12 00:42:56.209586 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.209441    2576 server.go:1268] "Started kubelet"
Sep 12 00:42:56.209686 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.209489    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 12 00:42:56.209746 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.209524    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 12 00:42:56.209843 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.209789    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 12 00:42:56.210339 ip-10-0-142-242 systemd[1]: Started Kubernetes Kubelet.
Sep 12 00:42:56.215654 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.215614    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 12 00:42:56.216085 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.216063    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 12 00:42:56.216843 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.216816    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbpjr"
Sep 12 00:42:56.216932 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.216861    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 12 00:42:56.218465 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.218447    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 12 00:42:56.219620 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.218507    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-242.ec2.internal.18d46c11ec680064  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-242.ec2.internal,UID:ip-10-0-142-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-242.ec2.internal,},FirstTimestamp:2026-09-12 00:42:56.209412196 +0000 UTC m=+0.402741191,LastTimestamp:2026-09-12 00:42:56.209412196 +0000 UTC m=+0.402741191,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-242.ec2.internal,}"
Sep 12 00:42:56.222186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.222145    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 12 00:42:56.222830 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.222812    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 12 00:42:56.223259 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.223241    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.223537 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.223523    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 12 00:42:56.223537 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.223538    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 12 00:42:56.223693 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.223522    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 12 00:42:56.223693 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.223603    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 12 00:42:56.223693 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.223614    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 12 00:42:56.224121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224099    2576 factory.go:153] Registering CRI-O factory
Sep 12 00:42:56.224121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224119    2576 factory.go:223] Registration of the crio container factory successfully
Sep 12 00:42:56.224225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224176    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 12 00:42:56.224225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224186    2576 factory.go:55] Registering systemd factory
Sep 12 00:42:56.224225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224193    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 12 00:42:56.224225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224211    2576 factory.go:103] Registering Raw factory
Sep 12 00:42:56.224225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224225    2576 manager.go:1196] Started watching for new ooms in manager
Sep 12 00:42:56.224720 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.224705    2576 manager.go:349] Starting recovery of all containers
Sep 12 00:42:56.224855 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.224826    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 12 00:42:56.224855 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.224844    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 12 00:42:56.231536 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.231514    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qbpjr"
Sep 12 00:42:56.231658 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.231619    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 12 00:42:56.235316 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.235297    2576 manager.go:354] Recovery completed
Sep 12 00:42:56.239374 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.239360    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.241124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241112    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.241170 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241139    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.241170 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241149    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.241713 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241701    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 12 00:42:56.241713 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241713    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 12 00:42:56.241813 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241729    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 00:42:56.241813 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.241705    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.242397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.242385    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.242443 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.242410    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.242443 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.242419    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.243755 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.243741    2576 policy_none.go:49] "None policy: Start"
Sep 12 00:42:56.243815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.243760    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 12 00:42:56.243815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.243773    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 12 00:42:56.245844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.245832    2576 policy_none.go:47] "Start"
Sep 12 00:42:56.285181 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285164    2576 manager.go:337] "Starting Device Plugin manager"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.285203    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285213    2576 server.go:87] "Starting device plugin registration server"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285580    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285590    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285708    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285793    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.285800    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.286371    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.286430    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.293934    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.293975    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.293994    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.294026    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 12 00:42:56.302370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.296471    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:42:56.386069 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.385957    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.387017 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.386997    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.387087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.387034    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.387087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.387050    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.387087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.387073    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.394695 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.394669    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"]
Sep 12 00:42:56.394779 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.394735    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.395538 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.395523    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.395602 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.395547    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.395602 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.395555    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.397064 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.397051    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.397120 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.397074    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-242.ec2.internal\": node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.397750 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.397739    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.397880 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.397868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.397925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.397902    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.398448 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398434    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.398520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398456    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.398520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398465    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.398520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398488    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.398520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398512    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.398520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.398522    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.400712 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.400697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.400778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.400722    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 00:42:56.401361 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.401343    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 00:42:56.401437 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.401377    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 00:42:56.401437 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.401392    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID"
Sep 12 00:42:56.410870 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.410854    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.435278 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.435254    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.439677 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.439662    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.511545 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.511518    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.523839 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.523810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.523938 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.523846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.523938 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.523897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/427abdc7e2784c3c5f6bbe0ee342a5b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"427abdc7e2784c3c5f6bbe0ee342a5b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.611842 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.611811    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.624022 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.624079 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/427abdc7e2784c3c5f6bbe0ee342a5b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"427abdc7e2784c3c5f6bbe0ee342a5b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.624079 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.624150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.624150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/427abdc7e2784c3c5f6bbe0ee342a5b6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"427abdc7e2784c3c5f6bbe0ee342a5b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.624150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.624112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79d681e26c169b5ac07eacf2cb3d45e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"79d681e26c169b5ac07eacf2cb3d45e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.712399 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.712335    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.738740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.738720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.743882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:56.743858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:56.813376 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.813346    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:56.913938 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:56.913910    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:57.014451 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:57.014369    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:57.114893 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:57.114863    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:57.148282 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.148254    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 12 00:42:57.148728 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.148398    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 12 00:42:57.215758 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:57.215728    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:57.235726 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.235699    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-11 00:37:57 +0000 UTC" deadline="2028-04-06 05:05:03.734675307 +0000 UTC"
Sep 12 00:42:57.235726 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.235726    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13732h22m6.498952161s"
Sep 12 00:42:57.316665 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:57.316582    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found"
Sep 12 00:42:57.368691 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:57.368662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427abdc7e2784c3c5f6bbe0ee342a5b6.slice/crio-5b21a5989c4604bfc986b50198cf76d83ae9575db33860e619f90a76f187f26b WatchSource:0}: Error finding container 5b21a5989c4604bfc986b50198cf76d83ae9575db33860e619f90a76f187f26b: Status 404 returned error can't find the container with id 5b21a5989c4604bfc986b50198cf76d83ae9575db33860e619f90a76f187f26b
Sep 12 00:42:57.368917 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:42:57.368897    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d681e26c169b5ac07eacf2cb3d45e4.slice/crio-8e576d8a2c6379d863c43cede044f7efecf95f5eba24879949afa28181fd7cf8 WatchSource:0}: Error finding container 8e576d8a2c6379d863c43cede044f7efecf95f5eba24879949afa28181fd7cf8: Status 404 returned error can't find the container with id 8e576d8a2c6379d863c43cede044f7efecf95f5eba24879949afa28181fd7cf8
Sep 12 00:42:57.373947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.373933    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:42:57.416134 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.416108    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:42:57.423499 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.423477    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:57.434526 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.434507    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 00:42:57.436492 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.436480    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal"
Sep 12 00:42:57.442540 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.442525    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 00:42:57.664381 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:57.664301    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:42:59.003729 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.003700    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:42:59.471476 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.471444    2576 apiserver.go:52] "Watching apiserver"
Sep 12 00:42:59.480243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.480214    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 12 00:42:59.481584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.481551    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bbjbr","kube-system/konnectivity-agent-swcwd","openshift-dns/node-resolver-m2fbp","openshift-image-registry/node-ca-fftc4","openshift-multus/multus-additional-cni-plugins-tvl6h","openshift-multus/multus-d5w4k","openshift-network-diagnostics/network-check-target-ddtb5","kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2","openshift-cluster-node-tuning-operator/tuned-pr2mz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal","openshift-multus/network-metrics-daemon-bmqnt","openshift-network-operator/iptables-alerter-8mm6w","openshift-ovn-kubernetes/ovnkube-node-2pml8"]
Sep 12 00:42:59.484865 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.484845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:42:59.485013 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.484987    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:42:59.486942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.486922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.489391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.489368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.489666 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.489501    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 12 00:42:59.489666 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.489604    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r88hb\""
Sep 12 00:42:59.490016 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.489998    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.490503 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.490487    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.492853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.492072    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.492853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.492346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gdphh\""
Sep 12 00:42:59.492853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.492535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.492853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.492542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.494535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.494516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.495669 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.495654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nhqpq\""
Sep 12 00:42:59.495737 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.495669    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.495913 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.495893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.495973 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.495914    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 12 00:42:59.497570 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.497166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.497817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.497778    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.497817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.497762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.497947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.497897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4lghz\""
Sep 12 00:42:59.497998 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.497785    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 12 00:42:59.499334 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.499316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.500888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.500869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 12 00:42:59.501481 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.501439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.501568 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.501510    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:42:59.501771 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.501746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rwqgw\""
Sep 12 00:42:59.501845 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.501798    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 12 00:42:59.501952 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.501938    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 12 00:42:59.502087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.502075    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4z7gv\""
Sep 12 00:42:59.502124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.502111    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.502167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.501755    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.502392 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.502368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 12 00:42:59.503264 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.503245    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 12 00:42:59.504784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.504767    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.506792 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.506776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.507714 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.507688    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jm9nw\""
Sep 12 00:42:59.508106 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.508087    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 12 00:42:59.508270 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.508248    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 12 00:42:59.509115 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.509087    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.509313 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.509294    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.509540 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.509485    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8rn8r\""
Sep 12 00:42:59.510356 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.510336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.512325 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.512449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-run\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.512449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-tuned\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.512449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512379    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 12 00:42:59.512449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2mg\" (UniqueName: \"kubernetes.io/projected/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-kube-api-access-xr2mg\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.512449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa08ee12-08f0-49ac-8249-21640eb82903-iptables-alerter-script\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-registration-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-systemd\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-var-lib-kubelet\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa08ee12-08f0-49ac-8249-21640eb82903-host-slash\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512655    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.512675    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-socket-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512714    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 12 00:42:59.512784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckxv\" (UniqueName: \"kubernetes.io/projected/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kube-api-access-gckxv\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99m8\" (UniqueName: \"kubernetes.io/projected/c58d5c08-0d10-4987-b725-33a543ec05b3-kube-api-access-k99m8\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstnw\" (UniqueName: \"kubernetes.io/projected/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-kube-api-access-jstnw\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-kubelet-config\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512858    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8888e2b-d074-4641-bca9-a021cd277d1d-tmp-dir\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cnibin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-socket-dir-parent\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512946    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xpnns\""
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-k8s-cni-cncf-io\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-netns\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.512946    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cni-binary-copy\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-multus-certs\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-kubernetes\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-sys-fs\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-kubelet\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-tmp\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4de9de51-ffe2-453c-bc99-b83a4ff81254-agent-certs\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513786    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-etc-kubernetes\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-host\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmc2q\" (UniqueName: \"kubernetes.io/projected/d8888e2b-d074-4641-bca9-a021cd277d1d-kube-api-access-zmc2q\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-multus\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.513970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c58d5c08-0d10-4987-b725-33a543ec05b3-serviceca\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysconfig\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.513991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-hostroot\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-lib-modules\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-dbus\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-bin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-conf-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-device-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwt5k\" (UniqueName: \"kubernetes.io/projected/fa08ee12-08f0-49ac-8249-21640eb82903-kube-api-access-kwt5k\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c58d5c08-0d10-4987-b725-33a543ec05b3-host\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cnibin\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-daemon-config\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8qm\" (UniqueName: \"kubernetes.io/projected/3aec457a-c608-439f-8e00-ceadf9f7f5bc-kube-api-access-6n8qm\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-conf\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.514867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-sys\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.515697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4de9de51-ffe2-453c-bc99-b83a4ff81254-konnectivity-ca\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.515697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-modprobe-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.515697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.515697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8888e2b-d074-4641-bca9-a021cd277d1d-hosts-file\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.515697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.514654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-system-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.519906 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.519874    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 00:42:59.536114 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.536091    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpltr"
Sep 12 00:42:59.546234 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.546211    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpltr"
Sep 12 00:42:59.581505 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.581448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"427abdc7e2784c3c5f6bbe0ee342a5b6","Type":"ContainerStarted","Data":"5b21a5989c4604bfc986b50198cf76d83ae9575db33860e619f90a76f187f26b"}
Sep 12 00:42:59.583069 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.583045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"79d681e26c169b5ac07eacf2cb3d45e4","Type":"ContainerStarted","Data":"8e576d8a2c6379d863c43cede044f7efecf95f5eba24879949afa28181fd7cf8"}
Sep 12 00:42:59.604883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.604852    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 12 00:42:59.614975 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.614939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.614975 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.614979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8888e2b-d074-4641-bca9-a021cd277d1d-hosts-file\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-system-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-run\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-tuned\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.615107    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2mg\" (UniqueName: \"kubernetes.io/projected/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-kube-api-access-xr2mg\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-run\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8888e2b-d074-4641-bca9-a021cd277d1d-hosts-file\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-system-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-kubelet\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.615221    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:00.115175398 +0000 UTC m=+3.027854332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:42:59.615323 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa08ee12-08f0-49ac-8249-21640eb82903-iptables-alerter-script\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-registration-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-systemd\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-var-lib-kubelet\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-registration-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-bin\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-var-lib-kubelet\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-systemd\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-script-lib\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa08ee12-08f0-49ac-8249-21640eb82903-host-slash\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa08ee12-08f0-49ac-8249-21640eb82903-host-slash\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.615943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-socket-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckxv\" (UniqueName: \"kubernetes.io/projected/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kube-api-access-gckxv\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615821    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b603b366-58bf-4d09-9d64-17329b0f424a-ovn-node-metrics-cert\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99m8\" (UniqueName: \"kubernetes.io/projected/c58d5c08-0d10-4987-b725-33a543ec05b3-kube-api-access-k99m8\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstnw\" (UniqueName: \"kubernetes.io/projected/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-kube-api-access-jstnw\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-kubelet-config\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8888e2b-d074-4641-bca9-a021cd277d1d-tmp-dir\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cnibin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-socket-dir-parent\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-k8s-cni-cncf-io\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-netns\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-socket-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cni-binary-copy\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-multus-certs\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-kubernetes\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-sys-fs\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.616699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-kubelet\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-tmp\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tvmg\" (UniqueName: \"kubernetes.io/projected/b603b366-58bf-4d09-9d64-17329b0f424a-kube-api-access-7tvmg\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4de9de51-ffe2-453c-bc99-b83a4ff81254-agent-certs\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-etc-kubernetes\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-host\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-netd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmc2q\" (UniqueName: \"kubernetes.io/projected/d8888e2b-d074-4641-bca9-a021cd277d1d-kube-api-access-zmc2q\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-multus\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-log-socket\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c58d5c08-0d10-4987-b725-33a543ec05b3-serviceca\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.617715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.615907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa08ee12-08f0-49ac-8249-21640eb82903-iptables-alerter-script\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysconfig\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-etc-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-ovn\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-config\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-netns\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cnibin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-systemd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-var-lib-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-env-overrides\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-kubelet-config\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-k8s-cni-cncf-io\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-hostroot\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-sys-fs\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-multus-certs\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-kubernetes\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.618543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysconfig\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8888e2b-d074-4641-bca9-a021cd277d1d-tmp-dir\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-lib-modules\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-dbus\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-bin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-conf-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-device-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-slash\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-node-log\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwt5k\" (UniqueName: \"kubernetes.io/projected/fa08ee12-08f0-49ac-8249-21640eb82903-kube-api-access-kwt5k\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c58d5c08-0d10-4987-b725-33a543ec05b3-host\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cnibin\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-daemon-config\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8qm\" (UniqueName: \"kubernetes.io/projected/3aec457a-c608-439f-8e00-ceadf9f7f5bc-kube-api-access-6n8qm\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-conf\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.619239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-sys\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4de9de51-ffe2-453c-bc99-b83a4ff81254-konnectivity-ca\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-modprobe-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7tz6\" (UniqueName: \"kubernetes.io/projected/19f25892-551d-441f-bbda-21bc93d0feb9-kube-api-access-z7tz6\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-cni-binary-copy\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.616956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-run-netns\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.617985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-systemd-units\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-socket-dir-parent\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-sys\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-modprobe-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c58d5c08-0d10-4987-b725-33a543ec05b3-host\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-lib-modules\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-dbus\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-bin\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.620261 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-hostroot\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-conf-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4de9de51-ffe2-453c-bc99-b83a4ff81254-konnectivity-ca\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618703    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-daemon-config\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-host\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-device-dir\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-etc-kubernetes\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-kubelet\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cnibin\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-host-var-lib-cni-multus\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aec457a-c608-439f-8e00-ceadf9f7f5bc-multus-cni-dir\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-etc-selinux\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-d\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.618933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-sysctl-conf\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.619355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c58d5c08-0d10-4987-b725-33a543ec05b3-serviceca\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.619716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.621338 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.621333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4de9de51-ffe2-453c-bc99-b83a4ff81254-agent-certs\") pod \"konnectivity-agent-swcwd\" (UID: \"4de9de51-ffe2-453c-bc99-b83a4ff81254\") " pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.622141 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.621840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-etc-tuned\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.622141 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.622115    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:42:59.622141 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.622141    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:42:59.622334 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.622155    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:42:59.622380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.622337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-tmp\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.622438 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.622221    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:00.12220429 +0000 UTC m=+3.034883223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:42:59.624668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.624640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2mg\" (UniqueName: \"kubernetes.io/projected/c4bd5fb8-05f8-41e0-9db8-26c8c276a274-kube-api-access-xr2mg\") pod \"tuned-pr2mz\" (UID: \"c4bd5fb8-05f8-41e0-9db8-26c8c276a274\") " pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.630897 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.630872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstnw\" (UniqueName: \"kubernetes.io/projected/a0b5df19-5943-4d5f-b142-7d10ffe6e33b-kube-api-access-jstnw\") pod \"multus-additional-cni-plugins-tvl6h\" (UID: \"a0b5df19-5943-4d5f-b142-7d10ffe6e33b\") " pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.630999 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.630954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckxv\" (UniqueName: \"kubernetes.io/projected/8adf9789-7c40-4662-b1b0-b07e1f6bbdca-kube-api-access-gckxv\") pod \"aws-ebs-csi-driver-node-pd5m2\" (UID: \"8adf9789-7c40-4662-b1b0-b07e1f6bbdca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.631176 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.631159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99m8\" (UniqueName: \"kubernetes.io/projected/c58d5c08-0d10-4987-b725-33a543ec05b3-kube-api-access-k99m8\") pod \"node-ca-fftc4\" (UID: \"c58d5c08-0d10-4987-b725-33a543ec05b3\") " pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.632251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.632230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwt5k\" (UniqueName: \"kubernetes.io/projected/fa08ee12-08f0-49ac-8249-21640eb82903-kube-api-access-kwt5k\") pod \"iptables-alerter-8mm6w\" (UID: \"fa08ee12-08f0-49ac-8249-21640eb82903\") " pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.634799 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.634774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmc2q\" (UniqueName: \"kubernetes.io/projected/d8888e2b-d074-4641-bca9-a021cd277d1d-kube-api-access-zmc2q\") pod \"node-resolver-m2fbp\" (UID: \"d8888e2b-d074-4641-bca9-a021cd277d1d\") " pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.635054 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.635036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8qm\" (UniqueName: \"kubernetes.io/projected/3aec457a-c608-439f-8e00-ceadf9f7f5bc-kube-api-access-6n8qm\") pod \"multus-d5w4k\" (UID: \"3aec457a-c608-439f-8e00-ceadf9f7f5bc\") " pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.719133 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tvmg\" (UniqueName: \"kubernetes.io/projected/b603b366-58bf-4d09-9d64-17329b0f424a-kube-api-access-7tvmg\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-netd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-log-socket\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-log-socket\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-etc-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-ovn\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-etc-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-netd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-ovn\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-config\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-netns\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-systemd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-run-systemd\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-run-netns\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-var-lib-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-env-overrides\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-slash\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-node-log\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-var-lib-openvswitch\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7tz6\" (UniqueName: \"kubernetes.io/projected/19f25892-551d-441f-bbda-21bc93d0feb9-kube-api-access-z7tz6\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-slash\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-node-log\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.719730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-systemd-units\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-systemd-units\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.719695    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-kubelet\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-kubelet\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:42:59.719763    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:00.219745873 +0000 UTC m=+3.132424788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-bin\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-script-lib\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b603b366-58bf-4d09-9d64-17329b0f424a-host-cni-bin\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b603b366-58bf-4d09-9d64-17329b0f424a-ovn-node-metrics-cert\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.719940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-env-overrides\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.720093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-config\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.720463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.720309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b603b366-58bf-4d09-9d64-17329b0f424a-ovnkube-script-lib\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.722073 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.722035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b603b366-58bf-4d09-9d64-17329b0f424a-ovn-node-metrics-cert\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.731018 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.730993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7tz6\" (UniqueName: \"kubernetes.io/projected/19f25892-551d-441f-bbda-21bc93d0feb9-kube-api-access-z7tz6\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:42:59.731143 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.731020    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tvmg\" (UniqueName: \"kubernetes.io/projected/b603b366-58bf-4d09-9d64-17329b0f424a-kube-api-access-7tvmg\") pod \"ovnkube-node-2pml8\" (UID: \"b603b366-58bf-4d09-9d64-17329b0f424a\") " pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.802148 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.801868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mm6w"
Sep 12 00:42:59.811428 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.811399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2fbp"
Sep 12 00:42:59.825560 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.825531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fftc4"
Sep 12 00:42:59.829382 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.829361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvl6h"
Sep 12 00:42:59.836332 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.836307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d5w4k"
Sep 12 00:42:59.842471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.842449    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2"
Sep 12 00:42:59.849306 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.849267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:42:59.855051 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.855031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pr2mz"
Sep 12 00:42:59.860984 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.860959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:42:59.929150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:42:59.928957    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 00:43:00.122448 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:00.122362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:00.122448 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:00.122406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122540    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122557    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122569    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122577    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122618    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:01.122605466 +0000 UTC m=+4.035284393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:00.122646 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.122645    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:01.122630895 +0000 UTC m=+4.035309810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:00.223156 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:00.223117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:00.223352 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.223292    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:00.223415 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:00.223367    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:01.223346884 +0000 UTC m=+4.136025803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:00.550205 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:00.550124    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 00:37:59 +0000 UTC" deadline="2028-02-25 08:56:12.320000049 +0000 UTC"
Sep 12 00:43:00.550205 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:00.550160    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12752h13m11.769844484s"
Sep 12 00:43:00.799760 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.784130    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b5df19_5943_4d5f_b142_7d10ffe6e33b.slice/crio-a311dcb05e7d9058232c7fe53b6d9e0e969edef2bfe24a36204382518716c6d6 WatchSource:0}: Error finding container a311dcb05e7d9058232c7fe53b6d9e0e969edef2bfe24a36204382518716c6d6: Status 404 returned error can't find the container with id a311dcb05e7d9058232c7fe53b6d9e0e969edef2bfe24a36204382518716c6d6
Sep 12 00:43:00.806396 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.806370    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de9de51_ffe2_453c_bc99_b83a4ff81254.slice/crio-677422c8b83d649a7e77eb591f0b36b3b540391297aed01bba95d80d9a937ee5 WatchSource:0}: Error finding container 677422c8b83d649a7e77eb591f0b36b3b540391297aed01bba95d80d9a937ee5: Status 404 returned error can't find the container with id 677422c8b83d649a7e77eb591f0b36b3b540391297aed01bba95d80d9a937ee5
Sep 12 00:43:00.809243 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.809220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa08ee12_08f0_49ac_8249_21640eb82903.slice/crio-51d8da5b37b74df7ea19c8f8d090960d24efe46dec04a9e89ef64323a924506f WatchSource:0}: Error finding container 51d8da5b37b74df7ea19c8f8d090960d24efe46dec04a9e89ef64323a924506f: Status 404 returned error can't find the container with id 51d8da5b37b74df7ea19c8f8d090960d24efe46dec04a9e89ef64323a924506f
Sep 12 00:43:00.812436 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.812408    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8888e2b_d074_4641_bca9_a021cd277d1d.slice/crio-d5b50e19dbbc04388832ed8f08df094340971bc43ccbba09c44f358c6b73bf18 WatchSource:0}: Error finding container d5b50e19dbbc04388832ed8f08df094340971bc43ccbba09c44f358c6b73bf18: Status 404 returned error can't find the container with id d5b50e19dbbc04388832ed8f08df094340971bc43ccbba09c44f358c6b73bf18
Sep 12 00:43:00.813586 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.813554    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb603b366_58bf_4d09_9d64_17329b0f424a.slice/crio-84ebc6eec56bae5eb2ba36c21adcbaf3ab434a3e1c82f3e03b57f4f2340130ca WatchSource:0}: Error finding container 84ebc6eec56bae5eb2ba36c21adcbaf3ab434a3e1c82f3e03b57f4f2340130ca: Status 404 returned error can't find the container with id 84ebc6eec56bae5eb2ba36c21adcbaf3ab434a3e1c82f3e03b57f4f2340130ca
Sep 12 00:43:00.814912 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.814788    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4bd5fb8_05f8_41e0_9db8_26c8c276a274.slice/crio-021bfcfbb23cdd5fbac2d1297c3af46b9174b9609b561acd9c25f7cd2f9942ee WatchSource:0}: Error finding container 021bfcfbb23cdd5fbac2d1297c3af46b9174b9609b561acd9c25f7cd2f9942ee: Status 404 returned error can't find the container with id 021bfcfbb23cdd5fbac2d1297c3af46b9174b9609b561acd9c25f7cd2f9942ee
Sep 12 00:43:00.816346 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.816323    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adf9789_7c40_4662_b1b0_b07e1f6bbdca.slice/crio-5a83f5384511d5537c779f66a33b80d94b2a43d92033fdff51555fb306637e3d WatchSource:0}: Error finding container 5a83f5384511d5537c779f66a33b80d94b2a43d92033fdff51555fb306637e3d: Status 404 returned error can't find the container with id 5a83f5384511d5537c779f66a33b80d94b2a43d92033fdff51555fb306637e3d
Sep 12 00:43:00.817970 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.817950    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aec457a_c608_439f_8e00_ceadf9f7f5bc.slice/crio-247ba2383ddaf0f9614dbdfd07520db720cead80ed97326acc8bfe567928febe WatchSource:0}: Error finding container 247ba2383ddaf0f9614dbdfd07520db720cead80ed97326acc8bfe567928febe: Status 404 returned error can't find the container with id 247ba2383ddaf0f9614dbdfd07520db720cead80ed97326acc8bfe567928febe
Sep 12 00:43:00.818260 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:00.818194    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58d5c08_0d10_4987_b725_33a543ec05b3.slice/crio-01cbf0b51bd015ee489e1a54a179cd3a357db8a3d1514b4077d3dd41f456bae2 WatchSource:0}: Error finding container 01cbf0b51bd015ee489e1a54a179cd3a357db8a3d1514b4077d3dd41f456bae2: Status 404 returned error can't find the container with id 01cbf0b51bd015ee489e1a54a179cd3a357db8a3d1514b4077d3dd41f456bae2
Sep 12 00:43:01.130505 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.130481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:01.130590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.130517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:01.130641 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130615    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:01.130641 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130621    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:01.130641 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130639    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:01.130720 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130648    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:01.130720 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130672    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:03.130656788 +0000 UTC m=+6.043335706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:01.130720 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.130688    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:03.130680242 +0000 UTC m=+6.043359157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:01.232130 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.231552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:01.232130 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.231724    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:01.232130 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.231800    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:03.231780693 +0000 UTC m=+6.144459633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:01.550605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.550470    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 00:37:59 +0000 UTC" deadline="2028-04-18 17:34:37.274282363 +0000 UTC"
Sep 12 00:43:01.550605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.550539    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14032h51m35.723746937s"
Sep 12 00:43:01.583597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.583566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:01.583761 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.583693    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:01.584160 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.584131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:01.586181 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.584238    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:01.586181 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.584329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:01.586181 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:01.584398    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:01.595200 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.595134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"427abdc7e2784c3c5f6bbe0ee342a5b6","Type":"ContainerStarted","Data":"78d9fb389d6e8d8b397f83373f55bdca7c88b24ad124bc48916e87e125deeb0f"}
Sep 12 00:43:01.602397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.600702    2576 generic.go:356] "Generic (PLEG): container finished" podID="79d681e26c169b5ac07eacf2cb3d45e4" containerID="252d02bd89624a188af569b949ecd0371ab4a3d121665dd68e463f5de74e3617" exitCode=0
Sep 12 00:43:01.602397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.600780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"79d681e26c169b5ac07eacf2cb3d45e4","Type":"ContainerDied","Data":"252d02bd89624a188af569b949ecd0371ab4a3d121665dd68e463f5de74e3617"}
Sep 12 00:43:01.613109 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.613079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fftc4" event={"ID":"c58d5c08-0d10-4987-b725-33a543ec05b3","Type":"ContainerStarted","Data":"01cbf0b51bd015ee489e1a54a179cd3a357db8a3d1514b4077d3dd41f456bae2"}
Sep 12 00:43:01.616662 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.616586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d5w4k" event={"ID":"3aec457a-c608-439f-8e00-ceadf9f7f5bc","Type":"ContainerStarted","Data":"247ba2383ddaf0f9614dbdfd07520db720cead80ed97326acc8bfe567928febe"}
Sep 12 00:43:01.618517 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.617861    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" podStartSLOduration=3.617844281 podStartE2EDuration="3.617844281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:01.617542824 +0000 UTC m=+4.530221762" watchObservedRunningTime="2026-09-12 00:43:01.617844281 +0000 UTC m=+4.530523408"
Sep 12 00:43:01.636436 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.636350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2" event={"ID":"8adf9789-7c40-4662-b1b0-b07e1f6bbdca","Type":"ContainerStarted","Data":"5a83f5384511d5537c779f66a33b80d94b2a43d92033fdff51555fb306637e3d"}
Sep 12 00:43:01.648688 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.648655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pr2mz" event={"ID":"c4bd5fb8-05f8-41e0-9db8-26c8c276a274","Type":"ContainerStarted","Data":"021bfcfbb23cdd5fbac2d1297c3af46b9174b9609b561acd9c25f7cd2f9942ee"}
Sep 12 00:43:01.665005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.664972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2fbp" event={"ID":"d8888e2b-d074-4641-bca9-a021cd277d1d","Type":"ContainerStarted","Data":"d5b50e19dbbc04388832ed8f08df094340971bc43ccbba09c44f358c6b73bf18"}
Sep 12 00:43:01.679824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.679737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mm6w" event={"ID":"fa08ee12-08f0-49ac-8249-21640eb82903","Type":"ContainerStarted","Data":"51d8da5b37b74df7ea19c8f8d090960d24efe46dec04a9e89ef64323a924506f"}
Sep 12 00:43:01.690967 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.690932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"84ebc6eec56bae5eb2ba36c21adcbaf3ab434a3e1c82f3e03b57f4f2340130ca"}
Sep 12 00:43:01.707574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.707489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swcwd" event={"ID":"4de9de51-ffe2-453c-bc99-b83a4ff81254","Type":"ContainerStarted","Data":"677422c8b83d649a7e77eb591f0b36b3b540391297aed01bba95d80d9a937ee5"}
Sep 12 00:43:01.711589 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:01.711560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerStarted","Data":"a311dcb05e7d9058232c7fe53b6d9e0e969edef2bfe24a36204382518716c6d6"}
Sep 12 00:43:02.737035 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:02.736946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"79d681e26c169b5ac07eacf2cb3d45e4","Type":"ContainerStarted","Data":"5f7f0cc4713fa95f15801fa27a9518029b6c098ea71464ad04fe0d85063c06a2"}
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.149891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.149953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150103    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150122    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150135    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150196    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:07.150177834 +0000 UTC m=+10.062856765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150268    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:03.150724 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.150324    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:07.150312674 +0000 UTC m=+10.062991603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:03.251958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.251303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:03.251958 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.251534    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:03.251958 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.251604    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:07.251583718 +0000 UTC m=+10.164262650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.577792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.577922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.578293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.578384    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:03.578434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:03.578605 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:03.578514    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:05.579578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:05.579633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:05.579984    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:05.580506    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:05.580559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:05.583433 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:05.580648    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:07.183490 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.183451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.183514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183652    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183674    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183687    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:15.183737098 +0000 UTC m=+18.096416018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183781    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:07.183944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.183836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:15.183819209 +0000 UTC m=+18.096498147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:07.284513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.284470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:07.284684 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.284669    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:07.284768 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.284733    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:15.284714315 +0000 UTC m=+18.197393261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:07.579899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.579637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:07.580071 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.579948    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:07.581721 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.580322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:07.581721 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.580413    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:07.581721 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:07.580478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:07.581721 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:07.580555    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:09.575196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:09.575151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:09.575196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:09.575174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:09.575630 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:09.575304    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:09.575630 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:09.575387    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:09.575630 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:09.575452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:09.575630 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:09.575527    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:11.574948 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:11.574913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:11.575424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:11.574911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:11.575424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:11.575052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:11.575424 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:11.575041    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:11.575424 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:11.575191    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:11.575424 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:11.575288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:13.575770 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:13.575727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:13.575770 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:13.575755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:13.576328 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:13.575871    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:13.576328 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:13.575913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:13.576328 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:13.576017    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:13.576328 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:13.576094    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:15.244568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.244536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.244594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244674    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244692    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244709    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244719    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244722    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:31.244709254 +0000 UTC m=+34.157388168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:15.244984 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.244756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:43:31.24474568 +0000 UTC m=+34.157424608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:15.345359 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.345336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:15.345504 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.345425    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:15.345504 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.345468    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:43:31.345455996 +0000 UTC m=+34.258134911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:15.575745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.575668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:15.575901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.575669    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:15.575901 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.575781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:15.575901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:15.575674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:15.575901 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.575879    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:15.576088 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:15.575948    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:17.576322 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:17.576287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:17.576832 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:17.576389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:17.576832 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:17.576403    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:17.576832 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:17.576480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:17.576832 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:17.576499    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:17.576832 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:17.576572    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:19.575197 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.574952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:19.575907 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.574971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:19.575907 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:19.575311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:19.575907 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:19.575388    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:19.575907 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.575022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:19.575907 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:19.575484    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:19.771165 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.771078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fftc4" event={"ID":"c58d5c08-0d10-4987-b725-33a543ec05b3","Type":"ContainerStarted","Data":"3af3dd9872a8f11603f847d8da3909bb93e52802b8cce707f4f753a481539934"}
Sep 12 00:43:19.772933 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.772903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d5w4k" event={"ID":"3aec457a-c608-439f-8e00-ceadf9f7f5bc","Type":"ContainerStarted","Data":"ea3a92dc8f421c790a4e0c41018e90bfc03fdae0229d56313daeca96f0cd6c4f"}
Sep 12 00:43:19.774574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.774545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2" event={"ID":"8adf9789-7c40-4662-b1b0-b07e1f6bbdca","Type":"ContainerStarted","Data":"fecd65b9c2acd39d15751e61a3567685a0efbfb327648bc4887bf426f7ff3c4f"}
Sep 12 00:43:19.778943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.776497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pr2mz" event={"ID":"c4bd5fb8-05f8-41e0-9db8-26c8c276a274","Type":"ContainerStarted","Data":"b0a2164bded5fc34e4ef4f2788415779487e8b24156fe0ad9d00c6838842c822"}
Sep 12 00:43:19.781060 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.781020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2fbp" event={"ID":"d8888e2b-d074-4641-bca9-a021cd277d1d","Type":"ContainerStarted","Data":"f4be5371c4760223fecadb7097fe79032b5a87f44533d6459f85ff5795176f5a"}
Sep 12 00:43:19.784895 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.784866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"24fb6b526c875c1854c5083ea641a2e7812dbfe33dc98614bd6f7a0ce6dd5e7b"}
Sep 12 00:43:19.784986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.784954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"e5542d07f3c4632b2588c600d7c79d07011c27316bf032c81d5372d503e22b47"}
Sep 12 00:43:19.785021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.785008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"40712efa71c04dcff32e9280a994fb310fce95f11b0b50adfa3d3e170fa329da"}
Sep 12 00:43:19.785079 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.785059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"437380c9f528582483295c1ed817d7f36d766ca34bba2bc086452eff90ff26f5"}
Sep 12 00:43:19.785121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.785107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"c59c91312508bbb9926d0412fedc8ef167bde0f24029d3fbcffcfdb3a6d46756"}
Sep 12 00:43:19.785169 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.785155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"c89de3952b9bb28011308146d94ec4a0fe28ea93f1e0e09b42a64fd7fa6260c6"}
Sep 12 00:43:19.786450 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.786412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" podStartSLOduration=21.786399171 podStartE2EDuration="21.786399171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:02.753592936 +0000 UTC m=+5.666271901" watchObservedRunningTime="2026-09-12 00:43:19.786399171 +0000 UTC m=+22.699078109"
Sep 12 00:43:19.786576 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.786447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-swcwd" event={"ID":"4de9de51-ffe2-453c-bc99-b83a4ff81254","Type":"ContainerStarted","Data":"d447bca9829dd705eef73e1179ebf39f19727c303f4e6f3e7b85b964c426c45e"}
Sep 12 00:43:19.786863 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.786828    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fftc4" podStartSLOduration=4.705263837 podStartE2EDuration="22.786819675s" totalImagesPullingTime="18.081555838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:19.786324127 +0000 UTC m=+22.699003068" watchObservedRunningTime="2026-09-12 00:43:19.786819675 +0000 UTC m=+22.699498612"
Sep 12 00:43:19.788070 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.788048    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="7ed368f9059e9d5f21585c667c2497437f4d63f32614728b47026130024a9a02" exitCode=0
Sep 12 00:43:19.788156 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.788083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"7ed368f9059e9d5f21585c667c2497437f4d63f32614728b47026130024a9a02"}
Sep 12 00:43:19.801299 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.801233    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m2fbp" podStartSLOduration=4.713701009 podStartE2EDuration="22.801218927s" totalImagesPullingTime="18.087517918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:19.801116129 +0000 UTC m=+22.713795067" watchObservedRunningTime="2026-09-12 00:43:19.801218927 +0000 UTC m=+22.713897864"
Sep 12 00:43:19.818084 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.818045    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d5w4k" podStartSLOduration=4.6654750289999996 podStartE2EDuration="22.818029756s" totalImagesPullingTime="18.152554727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:19.817659396 +0000 UTC m=+22.730338333" watchObservedRunningTime="2026-09-12 00:43:19.818029756 +0000 UTC m=+22.730708693"
Sep 12 00:43:19.834920 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.834879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pr2mz" podStartSLOduration=4.727871959 podStartE2EDuration="22.834867089s" totalImagesPullingTime="18.10699513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:19.834615224 +0000 UTC m=+22.747294178" watchObservedRunningTime="2026-09-12 00:43:19.834867089 +0000 UTC m=+22.747546025"
Sep 12 00:43:19.854303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:19.854248    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-swcwd" podStartSLOduration=12.179099745 podStartE2EDuration="22.854235196s" totalImagesPullingTime="10.675135451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:19.853999122 +0000 UTC m=+22.766678059" watchObservedRunningTime="2026-09-12 00:43:19.854235196 +0000 UTC m=+22.766914167"
Sep 12 00:43:20.374716 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.374690    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 12 00:43:20.578450 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.578354    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-12T00:43:20.374712607Z","UUID":"68407263-062c-4d52-9c92-7cda2e178ecc","Handler":null,"Name":"","Endpoint":""}
Sep 12 00:43:20.579718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.579697    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 12 00:43:20.579827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.579728    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 12 00:43:20.795200 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.795105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mm6w" event={"ID":"fa08ee12-08f0-49ac-8249-21640eb82903","Type":"ContainerStarted","Data":"544ce4f92ce473267d10c1e0bb13520c0ff9732456b9a63a0dae84aa57f4e874"}
Sep 12 00:43:20.798123 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.798094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2" event={"ID":"8adf9789-7c40-4662-b1b0-b07e1f6bbdca","Type":"ContainerStarted","Data":"44f96d2bbbdf671c4165dcdd2e4a2725712bd26ef08ec62cc5d56dd7dbb25e74"}
Sep 12 00:43:20.810485 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:20.810425    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8mm6w" podStartSLOduration=5.715486274 podStartE2EDuration="23.810405276s" totalImagesPullingTime="18.094919002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:20.810115719 +0000 UTC m=+23.722794656" watchObservedRunningTime="2026-09-12 00:43:20.810405276 +0000 UTC m=+23.723084213"
Sep 12 00:43:21.575551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.575295    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:21.575721 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.575300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:21.575721 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:21.575653    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:21.575827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.575377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:21.575879 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:21.575769    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:21.575934 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:21.575906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:21.803343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.803307    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2" event={"ID":"8adf9789-7c40-4662-b1b0-b07e1f6bbdca","Type":"ContainerStarted","Data":"9008e7bb4af2c4e0ac0666837bc9ae004e995bf08b5ae1aee6bfd09ccd798903"}
Sep 12 00:43:21.808582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.808549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"0878c9b8bfd2ffca01b4f8f5602e8f36ebf169749a9d26594d229d382206b0ae"}
Sep 12 00:43:21.823807 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:21.823756    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pd5m2" podStartSLOduration=4.634577172 podStartE2EDuration="24.823734891s" totalImagesPullingTime="20.189157719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:21.823022103 +0000 UTC m=+24.735701051" watchObservedRunningTime="2026-09-12 00:43:21.823734891 +0000 UTC m=+24.736413829"
Sep 12 00:43:23.575102 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:23.575069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:23.575593 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:23.575195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:23.575593 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:23.575200    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:23.575593 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:23.575345    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:23.575593 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:23.575389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:23.575593 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:23.575525    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:23.955197 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:23.955099    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:43:23.955939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:23.955918    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:43:24.819034 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.818834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" event={"ID":"b603b366-58bf-4d09-9d64-17329b0f424a","Type":"ContainerStarted","Data":"0c0ae9194985f0ac0fd38319317d335fba0af0efe8445a9098b56406d66832da"}
Sep 12 00:43:24.819518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.819125    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:43:24.819518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.819180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:43:24.820981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.820955    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="d2660d9c7fbd7040d6cc48d02bba5c87ee2cf811728fec10d6cc7833ff79d9fb" exitCode=0
Sep 12 00:43:24.821113 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.821046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"d2660d9c7fbd7040d6cc48d02bba5c87ee2cf811728fec10d6cc7833ff79d9fb"}
Sep 12 00:43:24.821230 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.821209    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:43:24.821913 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.821675    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-swcwd"
Sep 12 00:43:24.834983 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.834963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:43:24.844659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:24.844593    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8" podStartSLOduration=9.680025034 podStartE2EDuration="27.844581426s" totalImagesPullingTime="18.164556392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:24.844040604 +0000 UTC m=+27.756719561" watchObservedRunningTime="2026-09-12 00:43:24.844581426 +0000 UTC m=+27.757260453"
Sep 12 00:43:25.575198 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.575160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:25.575419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.575160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:25.575419 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:25.575332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:25.575419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.575392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:25.575532 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:25.575492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:25.575587 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:25.575568    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:25.826122 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.826061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerStarted","Data":"60a90d27b0d5dd1e2e925abfc0b3efd6920b61d03c95367130905a051dfde844"}
Sep 12 00:43:25.826740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.826589    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:43:25.841528 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:25.841505    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:43:26.476978 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.476942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbjbr"]
Sep 12 00:43:26.477139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.477108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:26.477238 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:26.477219    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:26.477931 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.477909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bmqnt"]
Sep 12 00:43:26.478052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.478002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:26.478105 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:26.478088    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:26.478678 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.478656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ddtb5"]
Sep 12 00:43:26.478768 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.478753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:26.478872 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:26.478847    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:26.829858 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.829824    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="60a90d27b0d5dd1e2e925abfc0b3efd6920b61d03c95367130905a051dfde844" exitCode=0
Sep 12 00:43:26.830381 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:26.829899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"60a90d27b0d5dd1e2e925abfc0b3efd6920b61d03c95367130905a051dfde844"}
Sep 12 00:43:27.577979 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:27.577789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:27.578114 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:27.577836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:27.578114 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:27.578077    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:27.578174 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:27.578115    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:27.834324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:27.834187    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="fedd991bb008c1664404e553384cef961df3da439f0e444a2ffe7bf54f0ac816" exitCode=0
Sep 12 00:43:27.834324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:27.834266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"fedd991bb008c1664404e553384cef961df3da439f0e444a2ffe7bf54f0ac816"}
Sep 12 00:43:28.575825 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:28.575792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:28.575964 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:28.575928    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:29.575385 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:29.575350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:29.575739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:29.575361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:29.575739 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:29.575462    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:29.575739 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:29.575557    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:30.575541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:30.575509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:30.576002 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:30.575655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:31.257383 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:31.257347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:31.257399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257514    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257596    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret podName:49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:03.257576705 +0000 UTC m=+66.170255637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret") pod "global-pull-secret-syncer-bbjbr" (UID: "49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5") : object "kube-system"/"original-pull-secret" not registered
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257519    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257639    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 00:43:31.257669 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257655    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q77kc for pod openshift-network-diagnostics/network-check-target-ddtb5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:31.257944 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.257711    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc podName:8763161e-07ba-49b3-958e-39285d27508d nodeName:}" failed. No retries permitted until 2026-09-12 00:44:03.257695413 +0000 UTC m=+66.170374349 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q77kc" (UniqueName: "kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc") pod "network-check-target-ddtb5" (UID: "8763161e-07ba-49b3-958e-39285d27508d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 00:43:31.358097 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:31.358065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:31.358294 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.358258    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:31.358368 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.358357    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:03.358335515 +0000 UTC m=+66.271014438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 00:43:31.575966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:31.575894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:31.576394 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:31.575892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:31.576394 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.576035    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bmqnt" podUID="19f25892-551d-441f-bbda-21bc93d0feb9"
Sep 12 00:43:31.576394 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:31.576099    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ddtb5" podUID="8763161e-07ba-49b3-958e-39285d27508d"
Sep 12 00:43:32.575252 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:32.575214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:32.575443 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:32.575359    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bbjbr" podUID="49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5"
Sep 12 00:43:32.915979 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:32.915955    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeReady"
Sep 12 00:43:32.916355 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:32.916069    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 12 00:43:32.970141 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:32.970110    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c6t79"]
Sep 12 00:43:33.004170 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.004148    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s887l"]
Sep 12 00:43:33.004313 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.004258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.006600 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.006577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 12 00:43:33.006724 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.006694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2gxdg\""
Sep 12 00:43:33.006795 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.006696    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 12 00:43:33.018306 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.018264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c6t79"]
Sep 12 00:43:33.018410 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.018318    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s887l"]
Sep 12 00:43:33.018410 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.018353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.020949 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.020931    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 12 00:43:33.021009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.020954    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 12 00:43:33.021009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.020980    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qtwt4\""
Sep 12 00:43:33.021251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.021238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 12 00:43:33.071222 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.071188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af5db43-0ae2-40bb-beaf-96395ad3362a-config-volume\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.071222 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.071221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.071486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.071245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af5db43-0ae2-40bb-beaf-96395ad3362a-tmp-dir\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.071486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.071334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gczzw\" (UniqueName: \"kubernetes.io/projected/1af5db43-0ae2-40bb-beaf-96395ad3362a-kube-api-access-gczzw\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172578 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af5db43-0ae2-40bb-beaf-96395ad3362a-tmp-dir\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172578 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-cert\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.172578 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gczzw\" (UniqueName: \"kubernetes.io/projected/1af5db43-0ae2-40bb-beaf-96395ad3362a-kube-api-access-gczzw\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7g2\" (UniqueName: \"kubernetes.io/projected/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-kube-api-access-qq7g2\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.172772 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af5db43-0ae2-40bb-beaf-96395ad3362a-config-volume\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172804 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172928 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.172911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1af5db43-0ae2-40bb-beaf-96395ad3362a-tmp-dir\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.172962 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:33.172934    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:33.173005 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:33.172996    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:43:33.672978341 +0000 UTC m=+36.585657260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:33.173203 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.173186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1af5db43-0ae2-40bb-beaf-96395ad3362a-config-volume\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.182861 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.182834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gczzw\" (UniqueName: \"kubernetes.io/projected/1af5db43-0ae2-40bb-beaf-96395ad3362a-kube-api-access-gczzw\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.273991 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.273953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-cert\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.274161 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.274020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7g2\" (UniqueName: \"kubernetes.io/projected/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-kube-api-access-qq7g2\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.276552 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.276530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-cert\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.282394 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.282371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7g2\" (UniqueName: \"kubernetes.io/projected/483496b4-b0fe-4213-80fc-6c5e2a4d9b19-kube-api-access-qq7g2\") pod \"ingress-canary-s887l\" (UID: \"483496b4-b0fe-4213-80fc-6c5e2a4d9b19\") " pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.326471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.326433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s887l"
Sep 12 00:43:33.575217 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.575127    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:43:33.575392 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.575319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:43:33.577718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.577694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kqk\""
Sep 12 00:43:33.577879 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.577694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 12 00:43:33.577879 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.577702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 12 00:43:33.577879 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.577813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 00:43:33.578434 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.578418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfcnt\""
Sep 12 00:43:33.633493 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.633465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s887l"]
Sep 12 00:43:33.636930 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:43:33.636905    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483496b4_b0fe_4213_80fc_6c5e2a4d9b19.slice/crio-0767afa49637c12eb8c73d02e2046de7b418bb2d490a62ef72cab9df69190d98 WatchSource:0}: Error finding container 0767afa49637c12eb8c73d02e2046de7b418bb2d490a62ef72cab9df69190d98: Status 404 returned error can't find the container with id 0767afa49637c12eb8c73d02e2046de7b418bb2d490a62ef72cab9df69190d98
Sep 12 00:43:33.675954 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.675932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:33.676113 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:33.676095    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:33.676180 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:33.676158    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:43:34.676140364 +0000 UTC m=+37.588819283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:33.852891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.852814    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="2abb635831e4744126eec8eb9b924623d74bf8917b6818e61b68f0deb27499c3" exitCode=0
Sep 12 00:43:33.852891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.852883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"2abb635831e4744126eec8eb9b924623d74bf8917b6818e61b68f0deb27499c3"}
Sep 12 00:43:33.854008 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:33.853986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s887l" event={"ID":"483496b4-b0fe-4213-80fc-6c5e2a4d9b19","Type":"ContainerStarted","Data":"0767afa49637c12eb8c73d02e2046de7b418bb2d490a62ef72cab9df69190d98"}
Sep 12 00:43:34.574860 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:34.574822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:43:34.577372 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:34.577351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 00:43:34.686224 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:34.686192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:34.686483 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:34.686462    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:34.686556 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:34.686544    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:43:36.686522514 +0000 UTC m=+39.599201445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:34.859872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:34.859798    2576 generic.go:356] "Generic (PLEG): container finished" podID="a0b5df19-5943-4d5f-b142-7d10ffe6e33b" containerID="1b1731d4f00ab5cb2c1879f82003f32814ea7acb45835ef8bc4f5cccde529c07" exitCode=0
Sep 12 00:43:34.859872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:34.859845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerDied","Data":"1b1731d4f00ab5cb2c1879f82003f32814ea7acb45835ef8bc4f5cccde529c07"}
Sep 12 00:43:35.864955 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:35.864924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" event={"ID":"a0b5df19-5943-4d5f-b142-7d10ffe6e33b","Type":"ContainerStarted","Data":"870132fa469af24b73bd1d6cdc82204689fa908f13269e459fa0288577f17bfe"}
Sep 12 00:43:35.888004 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:35.887958    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tvl6h" podStartSLOduration=9.678829044 podStartE2EDuration="38.88794119s" totalImagesPullingTime="29.209112146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:35.887908635 +0000 UTC m=+38.800587592" watchObservedRunningTime="2026-09-12 00:43:35.88794119 +0000 UTC m=+38.800620107"
Sep 12 00:43:36.701872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:36.701681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:36.702021 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:36.701837    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:36.702021 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:36.701997    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:43:40.701981295 +0000 UTC m=+43.614660223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:36.869216 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:36.869183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s887l" event={"ID":"483496b4-b0fe-4213-80fc-6c5e2a4d9b19","Type":"ContainerStarted","Data":"28bc37d28756407cbad93a111223d14b323b313baa0aec53ad2051dac7da674a"}
Sep 12 00:43:36.884256 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:36.884214    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s887l" podStartSLOduration=2.596514272 podStartE2EDuration="4.884200907s" totalImagesPullingTime="2.287686635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:43:36.883856693 +0000 UTC m=+39.796535647" watchObservedRunningTime="2026-09-12 00:43:36.884200907 +0000 UTC m=+39.796879838"
Sep 12 00:43:40.728992 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:40.728944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:40.729436 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:40.729070    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:40.729436 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:40.729119    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:43:48.729106152 +0000 UTC m=+51.641785066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:48.782176 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:48.782139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:43:48.782655 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:48.782257    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:43:48.782655 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:43:48.782341    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:44:04.78232516 +0000 UTC m=+67.695004077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:43:57.845433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:43:57.845406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2pml8"
Sep 12 00:44:03.285203 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.285150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:44:03.285203 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.285210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:44:03.288152 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.288126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 00:44:03.288293 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.288160    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 12 00:44:03.298485 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.298466    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 12 00:44:03.299703 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.299683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5-original-pull-secret\") pod \"global-pull-secret-syncer-bbjbr\" (UID: \"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5\") " pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:44:03.309373 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.309354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q77kc\" (UniqueName: \"kubernetes.io/projected/8763161e-07ba-49b3-958e-39285d27508d-kube-api-access-q77kc\") pod \"network-check-target-ddtb5\" (UID: \"8763161e-07ba-49b3-958e-39285d27508d\") " pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:44:03.384343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.384313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bbjbr"
Sep 12 00:44:03.385523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.385504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:44:03.388053 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.388038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 00:44:03.396263 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:03.396243    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 00:44:03.396347 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:03.396337    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs podName:19f25892-551d-441f-bbda-21bc93d0feb9 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:07.3963209 +0000 UTC m=+130.308999815 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs") pod "network-metrics-daemon-bmqnt" (UID: "19f25892-551d-441f-bbda-21bc93d0feb9") : secret "metrics-daemon-secret" not found
Sep 12 00:44:03.592752 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.592679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfcnt\""
Sep 12 00:44:03.600670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.600648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:44:03.687384 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.687355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bbjbr"]
Sep 12 00:44:03.690758 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:44:03.690720    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49bf96b8_2254_4b8f_ba5a_7e1dde0f3bb5.slice/crio-314c915f6e53535d1cc65370287cfee7743ed4d66b0492cb852bcd6c803f064c WatchSource:0}: Error finding container 314c915f6e53535d1cc65370287cfee7743ed4d66b0492cb852bcd6c803f064c: Status 404 returned error can't find the container with id 314c915f6e53535d1cc65370287cfee7743ed4d66b0492cb852bcd6c803f064c
Sep 12 00:44:03.889646 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.889582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ddtb5"]
Sep 12 00:44:03.903224 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:44:03.903202    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8763161e_07ba_49b3_958e_39285d27508d.slice/crio-217d772d9533a31b956263ca689d2fcac691d58a4808309ff29a98168b654187 WatchSource:0}: Error finding container 217d772d9533a31b956263ca689d2fcac691d58a4808309ff29a98168b654187: Status 404 returned error can't find the container with id 217d772d9533a31b956263ca689d2fcac691d58a4808309ff29a98168b654187
Sep 12 00:44:03.932880 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.932850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ddtb5" event={"ID":"8763161e-07ba-49b3-958e-39285d27508d","Type":"ContainerStarted","Data":"217d772d9533a31b956263ca689d2fcac691d58a4808309ff29a98168b654187"}
Sep 12 00:44:03.935690 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:03.935647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbjbr" event={"ID":"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5","Type":"ContainerStarted","Data":"314c915f6e53535d1cc65370287cfee7743ed4d66b0492cb852bcd6c803f064c"}
Sep 12 00:44:04.794917 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:04.794878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:44:04.795488 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:04.795052    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:44:04.795488 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:04.795139    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:44:36.795117385 +0000 UTC m=+99.707796300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:44:08.951479 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:08.951444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ddtb5" event={"ID":"8763161e-07ba-49b3-958e-39285d27508d","Type":"ContainerStarted","Data":"e7d8321e492a0dcb51e559a6a0832bea630b1c777dd62a779cf2efb6f041a181"}
Sep 12 00:44:08.951938 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:08.951515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:44:08.952865 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:08.952845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bbjbr" event={"ID":"49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5","Type":"ContainerStarted","Data":"96a46da7bf3bdf97e2d01543486eb4de317874aa815a7acc74c81e3a6566ce02"}
Sep 12 00:44:08.967868 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:08.967831    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ddtb5" podStartSLOduration=67.803036158 podStartE2EDuration="1m11.967818056s" totalImagesPullingTime="4.164781898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:44:08.967160938 +0000 UTC m=+71.879839887" watchObservedRunningTime="2026-09-12 00:44:08.967818056 +0000 UTC m=+71.880496993"
Sep 12 00:44:08.984071 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:08.984030    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bbjbr" podStartSLOduration=67.603304688 podStartE2EDuration="1m11.984021086s" totalImagesPullingTime="4.380716398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:44:08.983622502 +0000 UTC m=+71.896301453" watchObservedRunningTime="2026-09-12 00:44:08.984021086 +0000 UTC m=+71.896700023"
Sep 12 00:44:36.798567 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:36.798512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:44:36.799007 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:36.798642    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 00:44:36.799007 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:36.798704    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls podName:1af5db43-0ae2-40bb-beaf-96395ad3362a nodeName:}" failed. No retries permitted until 2026-09-12 00:45:40.798689244 +0000 UTC m=+163.711368173 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls") pod "dns-default-c6t79" (UID: "1af5db43-0ae2-40bb-beaf-96395ad3362a") : secret "dns-default-metrics-tls" not found
Sep 12 00:44:37.789360 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.789326    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"]
Sep 12 00:44:37.793466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.793450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"
Sep 12 00:44:37.795719 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.795695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lfk84\""
Sep 12 00:44:37.800378 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.800346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"]
Sep 12 00:44:37.805762 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.805742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4xm\" (UniqueName: \"kubernetes.io/projected/720f5bdd-84d2-4478-a040-53d9d978218b-kube-api-access-sz4xm\") pod \"network-check-source-6f8b768455-ddmw5\" (UID: \"720f5bdd-84d2-4478-a040-53d9d978218b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"
Sep 12 00:44:37.896921 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.896889    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"]
Sep 12 00:44:37.899649 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.899632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:37.901658 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.901621    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-764c597d88-hvw2x"]
Sep 12 00:44:37.902055 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.902037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 12 00:44:37.902642 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.902619    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 12 00:44:37.902772 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.902654    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 12 00:44:37.902772 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.902746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bl2j6\""
Sep 12 00:44:37.903955 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.903935    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 12 00:44:37.904320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.904307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:37.906185 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.906159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4xm\" (UniqueName: \"kubernetes.io/projected/720f5bdd-84d2-4478-a040-53d9d978218b-kube-api-access-sz4xm\") pod \"network-check-source-6f8b768455-ddmw5\" (UID: \"720f5bdd-84d2-4478-a040-53d9d978218b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"
Sep 12 00:44:37.906963 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.906943    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 12 00:44:37.907066 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.906984    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 12 00:44:37.907422 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.907409    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 12 00:44:37.907475 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.907464    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 12 00:44:37.907924 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.907910    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 12 00:44:37.909882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.909862    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 12 00:44:37.910936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.910923    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-49tsw\""
Sep 12 00:44:37.932036 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.932009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"]
Sep 12 00:44:37.935105 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.935080    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-764c597d88-hvw2x"]
Sep 12 00:44:37.937837 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:37.937806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4xm\" (UniqueName: \"kubernetes.io/projected/720f5bdd-84d2-4478-a040-53d9d978218b-kube-api-access-sz4xm\") pod \"network-check-source-6f8b768455-ddmw5\" (UID: \"720f5bdd-84d2-4478-a040-53d9d978218b\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"
Sep 12 00:44:38.006638 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-default-certificate\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.006638 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6wjh\" (UniqueName: \"kubernetes.io/projected/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-kube-api-access-l6wjh\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-stats-auth\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16c3a802-de7d-43c6-a877-d659790ad92e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.006849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.006779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqs5\" (UniqueName: \"kubernetes.io/projected/16c3a802-de7d-43c6-a877-d659790ad92e-kube-api-access-xbqs5\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.099470 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.099385    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:44:38.102409 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.102392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.102479 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.102444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"
Sep 12 00:44:38.104474 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.104444    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-56cb5d8758-9tncq\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.104804 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.104781    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret"
Sep 12 00:44:38.107555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.107644 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-stats-auth\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.107644 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16c3a802-de7d-43c6-a877-d659790ad92e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.107750 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqs5\" (UniqueName: \"kubernetes.io/projected/16c3a802-de7d-43c6-a877-d659790ad92e-kube-api-access-xbqs5\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.107750 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-default-certificate\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.107750 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.107897 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6wjh\" (UniqueName: \"kubernetes.io/projected/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-kube-api-access-l6wjh\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.107897 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.107794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.107897 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.107883    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:38.607859388 +0000 UTC m=+101.520538319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:38.108067 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.107898    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:38.108067 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.107963    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:38.607945548 +0000 UTC m=+101.520624479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:38.108168 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.108089    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:38.108766 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.108743    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:38.608721814 +0000 UTC m=+101.521400744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:38.109212 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.108886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/16c3a802-de7d-43c6-a877-d659790ad92e-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.111142 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.111117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-stats-auth\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.111843 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.111821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-default-certificate\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.112595 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.112553    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret"
Sep 12 00:44:38.112595 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.112563    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Sep 12 00:44:38.112595 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.112567    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-rszm7\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rszm7\"" type="*v1.Secret"
Sep 12 00:44:38.112785 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.112563    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap"
Sep 12 00:44:38.128319 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.128250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqs5\" (UniqueName: \"kubernetes.io/projected/16c3a802-de7d-43c6-a877-d659790ad92e-kube-api-access-xbqs5\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.129245 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.129217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:44:38.129838 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.129812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6wjh\" (UniqueName: \"kubernetes.io/projected/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-kube-api-access-l6wjh\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.208873 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.208844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209030 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.208903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209030 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.208976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209030 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.209022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.209044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4djtc\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.209068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.209085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.209126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.209102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310055 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4djtc\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310585 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.310752 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.310733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.318533 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.318510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.319080 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.319064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4djtc\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:38.379839 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.379767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5"]
Sep 12 00:44:38.383121 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:44:38.383099    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720f5bdd_84d2_4478_a040_53d9d978218b.slice/crio-e3324efcb16691f069ea1d37817e56f44ecd95355b1b0e9e2412e3592ad870ab WatchSource:0}: Error finding container e3324efcb16691f069ea1d37817e56f44ecd95355b1b0e9e2412e3592ad870ab: Status 404 returned error can't find the container with id e3324efcb16691f069ea1d37817e56f44ecd95355b1b0e9e2412e3592ad870ab
Sep 12 00:44:38.613377 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.613333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.613553 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.613435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:38.613553 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:38.613466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:38.613553 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.613483    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.613467243 +0000 UTC m=+102.526146158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:38.613659 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.613567    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:38.613659 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.613567    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:38.613659 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.613626    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.613609719 +0000 UTC m=+102.526288634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:38.613659 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:38.613640    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.613633979 +0000 UTC m=+102.526312894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:39.030352 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.030321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5" event={"ID":"720f5bdd-84d2-4478-a040-53d9d978218b","Type":"ContainerStarted","Data":"a9c00b55cdddea7060704252c99d5c8a45a21e4fc21d6eb2ab9dbf280c386174"}
Sep 12 00:44:39.030352 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.030366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5" event={"ID":"720f5bdd-84d2-4478-a040-53d9d978218b","Type":"ContainerStarted","Data":"e3324efcb16691f069ea1d37817e56f44ecd95355b1b0e9e2412e3592ad870ab"}
Sep 12 00:44:39.060692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.060631    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-ddmw5" podStartSLOduration=2.060608912 podStartE2EDuration="2.060608912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:44:39.055047975 +0000 UTC m=+101.967726934" watchObservedRunningTime="2026-09-12 00:44:39.060608912 +0000 UTC m=+101.973287850"
Sep 12 00:44:39.310974 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.310876    2576 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.310974 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.310917    2576 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition
Sep 12 00:44:39.310974 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.310876    2576 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.310983    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.810961251 +0000 UTC m=+102.723640166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.310890    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.311001    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.810993098 +0000 UTC m=+102.723672020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : failed to sync configmap cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.311005    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cb5d8758-9tncq: failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.311015    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.811008046 +0000 UTC m=+102.723686960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.311243 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.311035    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:39.811022462 +0000 UTC m=+102.723701377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : failed to sync secret cache: timed out waiting for the condition
Sep 12 00:44:39.349458 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.349429    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 12 00:44:39.360854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.360832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rszm7\""
Sep 12 00:44:39.436863 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.436834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 12 00:44:39.613894 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.613823    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 12 00:44:39.620901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.620884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:39.621011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.620917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:39.621011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.620939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:39.621104 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.621034    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:39.621104 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.621062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:41.6210472 +0000 UTC m=+104.533726133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:39.621104 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.621081    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:41.621069608 +0000 UTC m=+104.533748522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:39.621104 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.621035    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:39.621104 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.621106    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:41.621099275 +0000 UTC m=+104.533778190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:39.707687 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.707653    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 12 00:44:39.821494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.821461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.821494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.821495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.821718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.821514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.821718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.821546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.821718 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.821631    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:44:39.821718 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.821651    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cb5d8758-9tncq: secret "image-registry-tls" not found
Sep 12 00:44:39.821718 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:39.821710    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:40.821691215 +0000 UTC m=+103.734370135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : secret "image-registry-tls" not found
Sep 12 00:44:39.822285 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.822250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.824146 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.824122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.824236 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.824161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:39.957565 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:39.957542    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ddtb5"
Sep 12 00:44:40.828860 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:40.828821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:40.829233 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:40.828939    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:44:40.829233 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:40.828950    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cb5d8758-9tncq: secret "image-registry-tls" not found
Sep 12 00:44:40.829233 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:40.829008    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:42.828992791 +0000 UTC m=+105.741671706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : secret "image-registry-tls" not found
Sep 12 00:44:41.634815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:41.634779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:41.634815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:41.634822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:41.635114 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:41.634929    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:41.635114 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:41.635003    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:45.634985667 +0000 UTC m=+108.547664582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:41.635114 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:41.635035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:41.635114 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:41.635070    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:45.63505709 +0000 UTC m=+108.547736005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:41.635114 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:41.635110    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:41.635342 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:41.635137    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:45.635128853 +0000 UTC m=+108.547807768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:42.844115 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:42.844080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:42.844537 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:42.844234    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:44:42.844537 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:42.844253    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cb5d8758-9tncq: secret "image-registry-tls" not found
Sep 12 00:44:42.844537 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:42.844359    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:46.844341587 +0000 UTC m=+109.757020502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : secret "image-registry-tls" not found
Sep 12 00:44:43.344883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.344853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sbfdv"]
Sep 12 00:44:43.378132 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.378096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sbfdv"]
Sep 12 00:44:43.378300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.378232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.380816 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.380798    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 12 00:44:43.381289 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.381056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5lqq\""
Sep 12 00:44:43.381397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.381377    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 12 00:44:43.381725 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.381704    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 12 00:44:43.381805 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.381792    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 12 00:44:43.449283 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.449237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.449449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.449313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.449449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.449365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8sqv\" (UniqueName: \"kubernetes.io/projected/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-api-access-g8sqv\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.449449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.449403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a92f45a-1a82-4176-a084-7cb18f5d8a88-crio-socket\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.449449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.449418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a92f45a-1a82-4176-a084-7cb18f5d8a88-data-volume\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549702 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8sqv\" (UniqueName: \"kubernetes.io/projected/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-api-access-g8sqv\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a92f45a-1a82-4176-a084-7cb18f5d8a88-crio-socket\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a92f45a-1a82-4176-a084-7cb18f5d8a88-data-volume\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.549885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.549808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a92f45a-1a82-4176-a084-7cb18f5d8a88-crio-socket\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.550136 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:43.549899    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:43.550136 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:43.549916    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:44:43.550136 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:43.549950    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:44.04993719 +0000 UTC m=+106.962616105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:43.550136 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:43.549972    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:44.049955381 +0000 UTC m=+106.962634309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : configmap "kube-rbac-proxy" not found
Sep 12 00:44:43.550346 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.550199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a92f45a-1a82-4176-a084-7cb18f5d8a88-data-volume\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:43.559081 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:43.559056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8sqv\" (UniqueName: \"kubernetes.io/projected/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-api-access-g8sqv\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:44.054200 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:44.054167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:44.054586 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:44.054213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:44.054586 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:44.054313    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:44:44.054586 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:44.054350    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:44.054586 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:44.054388    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:45.054367559 +0000 UTC m=+107.967046475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : configmap "kube-rbac-proxy" not found
Sep 12 00:44:44.054586 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:44.054460    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:45.054450258 +0000 UTC m=+107.967129181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:45.061407 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:45.061372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:45.061788 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:45.061421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:45.061788 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.061485    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:44:45.061788 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.061507    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:45.061788 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.061560    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:47.061534176 +0000 UTC m=+109.974213108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : configmap "kube-rbac-proxy" not found
Sep 12 00:44:45.061788 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.061574    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:47.061568448 +0000 UTC m=+109.974247366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:45.665862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:45.665826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:45.665862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:45.665869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:45.666067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:45.665943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:45.666067 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.665974    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:45.666067 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.666025    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:45.666067 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.666029    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:53.666013995 +0000 UTC m=+116.578692910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:45.666195 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.666072    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:53.666061141 +0000 UTC m=+116.578740056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:45.666195 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:45.666082    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:53.666076715 +0000 UTC m=+116.578755630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:46.297931 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:46.297897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2fbp_d8888e2b-d074-4641-bca9-a021cd277d1d/dns-node-resolver/0.log"
Sep 12 00:44:46.875154 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:46.875113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:46.875415 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:46.875268    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 00:44:46.875415 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:46.875301    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56cb5d8758-9tncq: secret "image-registry-tls" not found
Sep 12 00:44:46.875415 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:46.875357    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls podName:69dad759-acf4-4815-97b4-26d36ec3ae7e nodeName:}" failed. No retries permitted until 2026-09-12 00:44:54.875342854 +0000 UTC m=+117.788021773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls") pod "image-registry-56cb5d8758-9tncq" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e") : secret "image-registry-tls" not found
Sep 12 00:44:47.076330 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:47.076296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:47.076505 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:47.076344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:47.076505 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:47.076425    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:44:47.076505 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:47.076502    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:51.076484646 +0000 UTC m=+113.989163568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : configmap "kube-rbac-proxy" not found
Sep 12 00:44:47.076675 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:47.076504    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:47.076675 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:47.076553    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:51.076539404 +0000 UTC m=+113.989218323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:47.098326 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:47.098300    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fftc4_c58d5c08-0d10-4987-b725-33a543ec05b3/node-ca/0.log"
Sep 12 00:44:47.898337 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:47.898306    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s887l_483496b4-b0fe-4213-80fc-6c5e2a4d9b19/serve-healthcheck-canary/0.log"
Sep 12 00:44:51.110290 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:51.110233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:51.110690 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:51.110307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:51.110690 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:51.110345    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 00:44:51.110690 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:51.110406    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:51.110690 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:51.110417    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:59.110401293 +0000 UTC m=+122.023080208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : configmap "kube-rbac-proxy" not found
Sep 12 00:44:51.110690 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:51.110453    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls podName:2a92f45a-1a82-4176-a084-7cb18f5d8a88 nodeName:}" failed. No retries permitted until 2026-09-12 00:44:59.110440917 +0000 UTC m=+122.023119832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbfdv" (UID: "2a92f45a-1a82-4176-a084-7cb18f5d8a88") : secret "insights-runtime-extractor-tls" not found
Sep 12 00:44:53.731081 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:53.731044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:53.731092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:53.731117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:53.731202    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:53.731249    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:09.731233162 +0000 UTC m=+132.643912079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : configmap references non-existent config key: service-ca.crt
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:53.731202    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:53.731312    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls podName:16c3a802-de7d-43c6-a877-d659790ad92e nodeName:}" failed. No retries permitted until 2026-09-12 00:45:09.731298327 +0000 UTC m=+132.643977245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxvrk" (UID: "16c3a802-de7d-43c6-a877-d659790ad92e") : secret "cluster-monitoring-operator-tls" not found
Sep 12 00:44:53.731494 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:44:53.731358    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs podName:9ac9dbd8-da68-47cd-87a5-b886ffc5ad84 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:09.731341608 +0000 UTC m=+132.644020541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs") pod "router-default-764c597d88-hvw2x" (UID: "9ac9dbd8-da68-47cd-87a5-b886ffc5ad84") : secret "router-metrics-certs-default" not found
Sep 12 00:44:54.940650 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:54.940616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:54.942979 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:54.942956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"image-registry-56cb5d8758-9tncq\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") " pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:55.225302 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:55.225206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:55.495598 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:55.495521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:44:55.499426 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:44:55.499399    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69dad759_acf4_4815_97b4_26d36ec3ae7e.slice/crio-88f4ba7d86cf81fe978777920a270aff47b50c4cc18f27434ee8ca36b86988b3 WatchSource:0}: Error finding container 88f4ba7d86cf81fe978777920a270aff47b50c4cc18f27434ee8ca36b86988b3: Status 404 returned error can't find the container with id 88f4ba7d86cf81fe978777920a270aff47b50c4cc18f27434ee8ca36b86988b3
Sep 12 00:44:56.073112 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:56.073074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" event={"ID":"69dad759-acf4-4815-97b4-26d36ec3ae7e","Type":"ContainerStarted","Data":"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"}
Sep 12 00:44:56.073515 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:56.073120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" event={"ID":"69dad759-acf4-4815-97b4-26d36ec3ae7e","Type":"ContainerStarted","Data":"88f4ba7d86cf81fe978777920a270aff47b50c4cc18f27434ee8ca36b86988b3"}
Sep 12 00:44:56.073515 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:56.073215    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:44:56.092542 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:56.092500    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" podStartSLOduration=18.092488088 podStartE2EDuration="18.092488088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:44:56.091658895 +0000 UTC m=+119.004337851" watchObservedRunningTime="2026-09-12 00:44:56.092488088 +0000 UTC m=+119.005167082"
Sep 12 00:44:59.173232 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.173196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:59.173631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.173252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:59.173726 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.173706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a92f45a-1a82-4176-a084-7cb18f5d8a88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:59.175712 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.175694    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a92f45a-1a82-4176-a084-7cb18f5d8a88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbfdv\" (UID: \"2a92f45a-1a82-4176-a084-7cb18f5d8a88\") " pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:59.293104 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.293076    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5lqq\""
Sep 12 00:44:59.301973 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.301954    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sbfdv"
Sep 12 00:44:59.573769 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:44:59.573698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sbfdv"]
Sep 12 00:44:59.576981 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:44:59.576951    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a92f45a_1a82_4176_a084_7cb18f5d8a88.slice/crio-eb5cae702d142abb771454ba3c92868d0bc6a3660a38d29ddbe26773d3b3bf3f WatchSource:0}: Error finding container eb5cae702d142abb771454ba3c92868d0bc6a3660a38d29ddbe26773d3b3bf3f: Status 404 returned error can't find the container with id eb5cae702d142abb771454ba3c92868d0bc6a3660a38d29ddbe26773d3b3bf3f
Sep 12 00:45:00.088189 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:00.088156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbfdv" event={"ID":"2a92f45a-1a82-4176-a084-7cb18f5d8a88","Type":"ContainerStarted","Data":"82f047da321b16f98304869fd5f70093bfe890ba62cf2537d6b3c8cdafc79acd"}
Sep 12 00:45:00.088382 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:00.088210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbfdv" event={"ID":"2a92f45a-1a82-4176-a084-7cb18f5d8a88","Type":"ContainerStarted","Data":"eb5cae702d142abb771454ba3c92868d0bc6a3660a38d29ddbe26773d3b3bf3f"}
Sep 12 00:45:01.094180 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:01.094142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbfdv" event={"ID":"2a92f45a-1a82-4176-a084-7cb18f5d8a88","Type":"ContainerStarted","Data":"9081942520d009ae245c47cb522b9d852ce9fcd04b4d9468e51353e20395f05f"}
Sep 12 00:45:02.099773 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:02.099689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbfdv" event={"ID":"2a92f45a-1a82-4176-a084-7cb18f5d8a88","Type":"ContainerStarted","Data":"6327f92ab4ae59f6c9e6b835222e0df560d08d6565b22fc72323e8be4ffd97ca"}
Sep 12 00:45:02.118870 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:02.118819    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sbfdv" podStartSLOduration=17.154349096 podStartE2EDuration="19.118802221s" totalImagesPullingTime="1.964453125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 00:44:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:02.117530459 +0000 UTC m=+125.030209395" watchObservedRunningTime="2026-09-12 00:45:02.118802221 +0000 UTC m=+125.031481158"
Sep 12 00:45:07.437433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:07.437375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:45:07.439800 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:07.439778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f25892-551d-441f-bbda-21bc93d0feb9-metrics-certs\") pod \"network-metrics-daemon-bmqnt\" (UID: \"19f25892-551d-441f-bbda-21bc93d0feb9\") " pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:45:07.488939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:07.488905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42kqk\""
Sep 12 00:45:07.496970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:07.496950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bmqnt"
Sep 12 00:45:07.762504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:07.762436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bmqnt"]
Sep 12 00:45:07.765614 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:07.765589    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f25892_551d_441f_bbda_21bc93d0feb9.slice/crio-c4a6664e1cedbbf7dc46d8d7bdd7dd8ddd1dfb134769c6b01357ba44ae588a5a WatchSource:0}: Error finding container c4a6664e1cedbbf7dc46d8d7bdd7dd8ddd1dfb134769c6b01357ba44ae588a5a: Status 404 returned error can't find the container with id c4a6664e1cedbbf7dc46d8d7bdd7dd8ddd1dfb134769c6b01357ba44ae588a5a
Sep 12 00:45:08.125966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:08.125885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmqnt" event={"ID":"19f25892-551d-441f-bbda-21bc93d0feb9","Type":"ContainerStarted","Data":"c4a6664e1cedbbf7dc46d8d7bdd7dd8ddd1dfb134769c6b01357ba44ae588a5a"}
Sep 12 00:45:08.189854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:08.189819    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:45:09.131025 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.130936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmqnt" event={"ID":"19f25892-551d-441f-bbda-21bc93d0feb9","Type":"ContainerStarted","Data":"839e2b331966645868e8925aa4cc977d7fe6e6f0e34127c537f3a6d2cf6a355a"}
Sep 12 00:45:09.131025 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.131000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bmqnt" event={"ID":"19f25892-551d-441f-bbda-21bc93d0feb9","Type":"ContainerStarted","Data":"441b38248e78e67db4addd6f155b34f2c484dfd1c02a6d3d69b3c8539aa04179"}
Sep 12 00:45:09.149016 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.148971    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bmqnt" podStartSLOduration=131.19268085 podStartE2EDuration="2m12.148956508s" totalImagesPullingTime="956.275658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:09.148503445 +0000 UTC m=+132.061182393" watchObservedRunningTime="2026-09-12 00:45:09.148956508 +0000 UTC m=+132.061635444"
Sep 12 00:45:09.756888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.756836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:09.756888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.756897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:45:09.757110 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.757014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:09.757665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.757639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-service-ca-bundle\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:09.759361 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.759344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/16c3a802-de7d-43c6-a877-d659790ad92e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxvrk\" (UID: \"16c3a802-de7d-43c6-a877-d659790ad92e\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:45:09.759469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:09.759374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ac9dbd8-da68-47cd-87a5-b886ffc5ad84-metrics-certs\") pod \"router-default-764c597d88-hvw2x\" (UID: \"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84\") " pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:10.012078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.011993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bl2j6\""
Sep 12 00:45:10.017181 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.017168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-49tsw\""
Sep 12 00:45:10.020207 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.020195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"
Sep 12 00:45:10.026084 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.026061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:10.292541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.292521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk"]
Sep 12 00:45:10.294397 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:10.294360    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c3a802_de7d_43c6_a877_d659790ad92e.slice/crio-b0c1d2b13b3fba2ab881b54aa05f581f2b504033f191fd21a52267d45a28e5b3 WatchSource:0}: Error finding container b0c1d2b13b3fba2ab881b54aa05f581f2b504033f191fd21a52267d45a28e5b3: Status 404 returned error can't find the container with id b0c1d2b13b3fba2ab881b54aa05f581f2b504033f191fd21a52267d45a28e5b3
Sep 12 00:45:10.298158 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:10.298133    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-764c597d88-hvw2x"]
Sep 12 00:45:10.300493 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:10.300473    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac9dbd8_da68_47cd_87a5_b886ffc5ad84.slice/crio-9b458e7cf9f6cfd9d9e1768351519047e84276ba46ff00f739bd96cd6d35e247 WatchSource:0}: Error finding container 9b458e7cf9f6cfd9d9e1768351519047e84276ba46ff00f739bd96cd6d35e247: Status 404 returned error can't find the container with id 9b458e7cf9f6cfd9d9e1768351519047e84276ba46ff00f739bd96cd6d35e247
Sep 12 00:45:11.140597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:11.140558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk" event={"ID":"16c3a802-de7d-43c6-a877-d659790ad92e","Type":"ContainerStarted","Data":"b0c1d2b13b3fba2ab881b54aa05f581f2b504033f191fd21a52267d45a28e5b3"}
Sep 12 00:45:11.142403 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:11.142371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-764c597d88-hvw2x" event={"ID":"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84","Type":"ContainerStarted","Data":"74b48e2e03afa6f07d87e1bdcbf207f9cc57e3081689ad51046119ce48f9d3a4"}
Sep 12 00:45:11.142542 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:11.142423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-764c597d88-hvw2x" event={"ID":"9ac9dbd8-da68-47cd-87a5-b886ffc5ad84","Type":"ContainerStarted","Data":"9b458e7cf9f6cfd9d9e1768351519047e84276ba46ff00f739bd96cd6d35e247"}
Sep 12 00:45:11.168186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:11.168141    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-764c597d88-hvw2x" podStartSLOduration=34.168122151 podStartE2EDuration="34.168122151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:44:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:11.166976786 +0000 UTC m=+134.079655749" watchObservedRunningTime="2026-09-12 00:45:11.168122151 +0000 UTC m=+134.080801089"
Sep 12 00:45:12.027046 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.026995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:12.029972 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.029950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:12.147505 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.147410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk" event={"ID":"16c3a802-de7d-43c6-a877-d659790ad92e","Type":"ContainerStarted","Data":"b35e88c63fe8c6613082a9b5cad5fc8652a086124ca5fecc1bfbdbc15c6eaf10"}
Sep 12 00:45:12.147670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.147654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:12.148843 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.148823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-764c597d88-hvw2x"
Sep 12 00:45:12.170057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.170012    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxvrk" podStartSLOduration=33.573563369 podStartE2EDuration="35.169997769s" totalImagesPullingTime="1.5964344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:12.169005292 +0000 UTC m=+135.081684260" watchObservedRunningTime="2026-09-12 00:45:12.169997769 +0000 UTC m=+135.082676705"
Sep 12 00:45:12.358216 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.358191    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"]
Sep 12 00:45:12.361330 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.361309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:12.363699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.363671    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 12 00:45:12.363809 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.363789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f8b9k\""
Sep 12 00:45:12.372714 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.372697    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"]
Sep 12 00:45:12.476496 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.476452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fxgpn\" (UID: \"d21b87d6-da75-4a79-a3ea-815f3904da52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:12.576960 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.576922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fxgpn\" (UID: \"d21b87d6-da75-4a79-a3ea-815f3904da52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:12.577127 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:12.577086    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 12 00:45:12.577192 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:12.577177    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates podName:d21b87d6-da75-4a79-a3ea-815f3904da52 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:13.077155229 +0000 UTC m=+135.989834143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-fxgpn" (UID: "d21b87d6-da75-4a79-a3ea-815f3904da52") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 12 00:45:12.901744 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.901673    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:45:12.904761 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.904743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.909199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mlzth\""
Sep 12 00:45:12.909339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909201    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 12 00:45:12.909418 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909402    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 12 00:45:12.909522 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909506    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 12 00:45:12.909942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909922    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 12 00:45:12.909942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 12 00:45:12.910137 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.909976    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 12 00:45:12.910137 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.910006    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 12 00:45:12.916739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.916718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:45:12.981031 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxd4\" (UniqueName: \"kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.981031 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.981225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.981225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.981225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:12.981225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:12.981199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.081917 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.081873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.081917 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.081925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.082425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.081959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fxgpn\" (UID: \"d21b87d6-da75-4a79-a3ea-815f3904da52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:13.082425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.081987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.082425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.082014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxd4\" (UniqueName: \"kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.082425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.082041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.082425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.082099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.082883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.082855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.083016 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.082993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.083074 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.083054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.084515 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.084495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d21b87d6-da75-4a79-a3ea-815f3904da52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-fxgpn\" (UID: \"d21b87d6-da75-4a79-a3ea-815f3904da52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:13.084604 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.084503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.084604 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.084577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.091971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.091944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxd4\" (UniqueName: \"kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4\") pod \"console-9db6b9fd7-n48p9\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") " pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.212988 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.212960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:13.269705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.269672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:13.484232 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.484154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:45:13.486703 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:13.486679    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd1a394_3321_403f_ae22_4ae541eeb2b7.slice/crio-966bea954d1abc47964787f4ae932e6aae09e8938579b91c65403fcb37b07d56 WatchSource:0}: Error finding container 966bea954d1abc47964787f4ae932e6aae09e8938579b91c65403fcb37b07d56: Status 404 returned error can't find the container with id 966bea954d1abc47964787f4ae932e6aae09e8938579b91c65403fcb37b07d56
Sep 12 00:45:13.548702 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:13.548675    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"]
Sep 12 00:45:13.551249 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:13.551215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21b87d6_da75_4a79_a3ea_815f3904da52.slice/crio-6ba2ee379b67342dfcf144728a308fa7dff898ba37dadca9630126e5d99c052a WatchSource:0}: Error finding container 6ba2ee379b67342dfcf144728a308fa7dff898ba37dadca9630126e5d99c052a: Status 404 returned error can't find the container with id 6ba2ee379b67342dfcf144728a308fa7dff898ba37dadca9630126e5d99c052a
Sep 12 00:45:14.156655 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:14.156586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn" event={"ID":"d21b87d6-da75-4a79-a3ea-815f3904da52","Type":"ContainerStarted","Data":"6ba2ee379b67342dfcf144728a308fa7dff898ba37dadca9630126e5d99c052a"}
Sep 12 00:45:14.158162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:14.158121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9db6b9fd7-n48p9" event={"ID":"4bd1a394-3321-403f-ae22-4ae541eeb2b7","Type":"ContainerStarted","Data":"966bea954d1abc47964787f4ae932e6aae09e8938579b91c65403fcb37b07d56"}
Sep 12 00:45:15.168548 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.168514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn" event={"ID":"d21b87d6-da75-4a79-a3ea-815f3904da52","Type":"ContainerStarted","Data":"06da81ce79ed41889ec50f16f8cf3e86b495e600af3d64d5801d2b6e58e2f1f7"}
Sep 12 00:45:15.168944 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.168755    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:15.174262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.174236    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn"
Sep 12 00:45:15.186394 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.186357    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-fxgpn" podStartSLOduration=2.044362828 podStartE2EDuration="3.186340958s" totalImagesPullingTime="1.14197813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:15.18568344 +0000 UTC m=+138.098362391" watchObservedRunningTime="2026-09-12 00:45:15.186340958 +0000 UTC m=+138.099019896"
Sep 12 00:45:15.429971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.429895    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"]
Sep 12 00:45:15.433492 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.433470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.436824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.436677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 12 00:45:15.436824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.436703    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 12 00:45:15.436824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.436712    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nl8sf\""
Sep 12 00:45:15.436824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.436741    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 12 00:45:15.441628 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.441608    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"]
Sep 12 00:45:15.605264 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.605229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.605445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.605316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd24b4d-c284-44ae-8728-73e252083631-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.605445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.605344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvjn\" (UniqueName: \"kubernetes.io/projected/2bd24b4d-c284-44ae-8728-73e252083631-kube-api-access-zrvjn\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.605445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.605361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.705881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.705787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd24b4d-c284-44ae-8728-73e252083631-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.705881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.705835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvjn\" (UniqueName: \"kubernetes.io/projected/2bd24b4d-c284-44ae-8728-73e252083631-kube-api-access-zrvjn\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.706159 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.706141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.706240 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.706229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.706451 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:15.706375    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 12 00:45:15.706554 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:15.706456    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls podName:2bd24b4d-c284-44ae-8728-73e252083631 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:16.20643627 +0000 UTC m=+139.119115192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-wnwgx" (UID: "2bd24b4d-c284-44ae-8728-73e252083631") : secret "prometheus-operator-tls" not found
Sep 12 00:45:15.706554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.706539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bd24b4d-c284-44ae-8728-73e252083631-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.709158 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.709130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:15.714793 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:15.714765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvjn\" (UniqueName: \"kubernetes.io/projected/2bd24b4d-c284-44ae-8728-73e252083631-kube-api-access-zrvjn\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:16.211107 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:16.211073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:16.213580 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:16.213558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2bd24b4d-c284-44ae-8728-73e252083631-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-wnwgx\" (UID: \"2bd24b4d-c284-44ae-8728-73e252083631\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:16.343833 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:16.343797    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"
Sep 12 00:45:16.614235 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:16.614158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx"]
Sep 12 00:45:16.616999 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:16.616971    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd24b4d_c284_44ae_8728_73e252083631.slice/crio-03300b7bb20f1f0520439baf91294ade1fb53bf7cb7ed213fe450cdcff18558c WatchSource:0}: Error finding container 03300b7bb20f1f0520439baf91294ade1fb53bf7cb7ed213fe450cdcff18558c: Status 404 returned error can't find the container with id 03300b7bb20f1f0520439baf91294ade1fb53bf7cb7ed213fe450cdcff18558c
Sep 12 00:45:17.176621 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:17.176582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx" event={"ID":"2bd24b4d-c284-44ae-8728-73e252083631","Type":"ContainerStarted","Data":"03300b7bb20f1f0520439baf91294ade1fb53bf7cb7ed213fe450cdcff18558c"}
Sep 12 00:45:17.178177 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:17.178149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9db6b9fd7-n48p9" event={"ID":"4bd1a394-3321-403f-ae22-4ae541eeb2b7","Type":"ContainerStarted","Data":"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"}
Sep 12 00:45:17.198924 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:17.198842    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9db6b9fd7-n48p9" podStartSLOduration=2.466997385 podStartE2EDuration="5.198821444s" totalImagesPullingTime="2.731824059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:17.196997256 +0000 UTC m=+140.109676217" watchObservedRunningTime="2026-09-12 00:45:17.198821444 +0000 UTC m=+140.111500381"
Sep 12 00:45:18.185802 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:18.185746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx" event={"ID":"2bd24b4d-c284-44ae-8728-73e252083631","Type":"ContainerStarted","Data":"95b9040ff1e2b09cddc13ad6834024c014cbcdfd89ffec7b0b42a9474fb568fb"}
Sep 12 00:45:18.186229 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:18.185855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx" event={"ID":"2bd24b4d-c284-44ae-8728-73e252083631","Type":"ContainerStarted","Data":"685c781c57caa762ca4c811fdf10afccf15416a861ca9a873761d0744320ce55"}
Sep 12 00:45:18.195924 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:18.195897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:45:18.205075 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:18.205016    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-wnwgx" podStartSLOduration=1.857549809 podStartE2EDuration="3.205001951s" totalImagesPullingTime="1.347452142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:18.20399898 +0000 UTC m=+141.116677929" watchObservedRunningTime="2026-09-12 00:45:18.205001951 +0000 UTC m=+141.117680887"
Sep 12 00:45:19.794970 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.794935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"]
Sep 12 00:45:19.798180 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.798164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:19.802854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.802834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 12 00:45:19.802988 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.802888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2btb8\""
Sep 12 00:45:19.803335 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.803316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 12 00:45:19.815217 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.815196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"]
Sep 12 00:45:19.820264 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.820245    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"]
Sep 12 00:45:19.826925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.826908    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vvcb5"]
Sep 12 00:45:19.827055 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.827039    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.829683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.829663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 12 00:45:19.829683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.829674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 12 00:45:19.829837 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.829713    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 12 00:45:19.829837 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.829733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dthzv\""
Sep 12 00:45:19.830056 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.830038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.832393 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.832375    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 12 00:45:19.832513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.832459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-45bhm\""
Sep 12 00:45:19.832625 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.832609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 12 00:45:19.834639 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.834616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 12 00:45:19.838423 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.838405    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"]
Sep 12 00:45:19.944920 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.944889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lj46\" (UniqueName: \"kubernetes.io/projected/e6a728c4-5006-4443-8129-3cf84ab32499-kube-api-access-7lj46\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.944927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-metrics-client-ca\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.944961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.944989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:19.945087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnrw\" (UniqueName: \"kubernetes.io/projected/ac750cc6-e520-46e6-805d-81f7ec60bbc5-kube-api-access-gnnrw\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kfbh\" (UniqueName: \"kubernetes.io/projected/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-api-access-4kfbh\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-tls\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-wtmp\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-textfile\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945305 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-root\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac750cc6-e520-46e6-805d-81f7ec60bbc5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1c8f5b3-6961-41b2-b431-1dd0144504a7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:19.945609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:19.945477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-sys\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.045946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac750cc6-e520-46e6-805d-81f7ec60bbc5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.046009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.045976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.045992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1c8f5b3-6961-41b2-b431-1dd0144504a7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-sys\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lj46\" (UniqueName: \"kubernetes.io/projected/e6a728c4-5006-4443-8129-3cf84ab32499-kube-api-access-7lj46\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-metrics-client-ca\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-sys\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnrw\" (UniqueName: \"kubernetes.io/projected/ac750cc6-e520-46e6-805d-81f7ec60bbc5-kube-api-access-gnnrw\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kfbh\" (UniqueName: \"kubernetes.io/projected/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-api-access-4kfbh\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-tls\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-wtmp\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-textfile\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b1c8f5b3-6961-41b2-b431-1dd0144504a7-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:20.046521    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-root\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:20.046589    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls podName:ac750cc6-e520-46e6-805d-81f7ec60bbc5 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:20.546571063 +0000 UTC m=+143.459249998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-4lqnh" (UID: "ac750cc6-e520-46e6-805d-81f7ec60bbc5") : secret "openshift-state-metrics-tls" not found
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-root\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.046745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-textfile\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:20.046773    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-accelerators-collector-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac750cc6-e520-46e6-805d-81f7ec60bbc5-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:20.046815    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls podName:b1c8f5b3-6961-41b2-b431-1dd0144504a7 nodeName:}" failed. No retries permitted until 2026-09-12 00:45:20.546802315 +0000 UTC m=+143.459481244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-6ckbr" (UID: "b1c8f5b3-6961-41b2-b431-1dd0144504a7") : secret "kube-state-metrics-tls" not found
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.046937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-wtmp\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.047061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.047365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.047183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8f5b3-6961-41b2-b431-1dd0144504a7-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.047938 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.047672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6a728c4-5006-4443-8129-3cf84ab32499-metrics-client-ca\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.048737 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.048717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.049167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.049150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.049315 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.049296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.049470 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.049452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e6a728c4-5006-4443-8129-3cf84ab32499-node-exporter-tls\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.055722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.055698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lj46\" (UniqueName: \"kubernetes.io/projected/e6a728c4-5006-4443-8129-3cf84ab32499-kube-api-access-7lj46\") pod \"node-exporter-vvcb5\" (UID: \"e6a728c4-5006-4443-8129-3cf84ab32499\") " pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.055966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.055942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnrw\" (UniqueName: \"kubernetes.io/projected/ac750cc6-e520-46e6-805d-81f7ec60bbc5-kube-api-access-gnnrw\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.056083 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.056022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kfbh\" (UniqueName: \"kubernetes.io/projected/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-api-access-4kfbh\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.142320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.142270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vvcb5"
Sep 12 00:45:20.153568 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:20.153541    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a728c4_5006_4443_8129_3cf84ab32499.slice/crio-6f36bc6aa83c8d2ef53664daab5ad28373fe0c3fdbb745accdbbf32db680badd WatchSource:0}: Error finding container 6f36bc6aa83c8d2ef53664daab5ad28373fe0c3fdbb745accdbbf32db680badd: Status 404 returned error can't find the container with id 6f36bc6aa83c8d2ef53664daab5ad28373fe0c3fdbb745accdbbf32db680badd
Sep 12 00:45:20.193459 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.193430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvcb5" event={"ID":"e6a728c4-5006-4443-8129-3cf84ab32499","Type":"ContainerStarted","Data":"6f36bc6aa83c8d2ef53664daab5ad28373fe0c3fdbb745accdbbf32db680badd"}
Sep 12 00:45:20.551029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.550997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.551193 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.551048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.553676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.553649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1c8f5b3-6961-41b2-b431-1dd0144504a7-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-6ckbr\" (UID: \"b1c8f5b3-6961-41b2-b431-1dd0144504a7\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.553676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.553662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ac750cc6-e520-46e6-805d-81f7ec60bbc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-4lqnh\" (UID: \"ac750cc6-e520-46e6-805d-81f7ec60bbc5\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.707352 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.707318    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"
Sep 12 00:45:20.737168 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.737120    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"
Sep 12 00:45:20.994769 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:20.994735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh"]
Sep 12 00:45:21.027576 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.027465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr"]
Sep 12 00:45:21.126404 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:21.126338    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac750cc6_e520_46e6_805d_81f7ec60bbc5.slice/crio-066b616a6f90b592f97fbe647d339e1365b4c7f557a03c27f9240bb8b21e0c72 WatchSource:0}: Error finding container 066b616a6f90b592f97fbe647d339e1365b4c7f557a03c27f9240bb8b21e0c72: Status 404 returned error can't find the container with id 066b616a6f90b592f97fbe647d339e1365b4c7f557a03c27f9240bb8b21e0c72
Sep 12 00:45:21.126917 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:21.126884    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c8f5b3_6961_41b2_b431_1dd0144504a7.slice/crio-fb77cb2ae3b4757ebc0b08102e9deaf8e08f2c6033cee553257f6824455cc156 WatchSource:0}: Error finding container fb77cb2ae3b4757ebc0b08102e9deaf8e08f2c6033cee553257f6824455cc156: Status 404 returned error can't find the container with id fb77cb2ae3b4757ebc0b08102e9deaf8e08f2c6033cee553257f6824455cc156
Sep 12 00:45:21.199074 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.199045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr" event={"ID":"b1c8f5b3-6961-41b2-b431-1dd0144504a7","Type":"ContainerStarted","Data":"fb77cb2ae3b4757ebc0b08102e9deaf8e08f2c6033cee553257f6824455cc156"}
Sep 12 00:45:21.201401 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.201378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh" event={"ID":"ac750cc6-e520-46e6-805d-81f7ec60bbc5","Type":"ContainerStarted","Data":"929c9dea7ef93fef583595948441179776a00413a9671df7962409e06284209b"}
Sep 12 00:45:21.201491 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.201435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh" event={"ID":"ac750cc6-e520-46e6-805d-81f7ec60bbc5","Type":"ContainerStarted","Data":"066b616a6f90b592f97fbe647d339e1365b4c7f557a03c27f9240bb8b21e0c72"}
Sep 12 00:45:21.785190 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.785151    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"]
Sep 12 00:45:21.789439 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.789409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.792023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.791988    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 12 00:45:21.792147 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792117    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sm695\""
Sep 12 00:45:21.792147 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792129    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 12 00:45:21.792309 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c0al08sv2sqbc\""
Sep 12 00:45:21.792497 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792472    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 12 00:45:21.792569 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 12 00:45:21.792607 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.792570    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 12 00:45:21.805774 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.805688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"]
Sep 12 00:45:21.962486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962532    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f30a0-8c63-4663-a455-074c34baf1f6-metrics-client-ca\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jp6f\" (UniqueName: \"kubernetes.io/projected/6b3f30a0-8c63-4663-a455-074c34baf1f6-kube-api-access-7jp6f\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-grpc-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962929 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:21.962929 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:21.962808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.063708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f30a0-8c63-4663-a455-074c34baf1f6-metrics-client-ca\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064124 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.063841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jp6f\" (UniqueName: \"kubernetes.io/projected/6b3f30a0-8c63-4663-a455-074c34baf1f6-kube-api-access-7jp6f\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.064298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-grpc-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.064730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.064662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b3f30a0-8c63-4663-a455-074c34baf1f6-metrics-client-ca\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.066974 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.066902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.067188 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.067162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.067385 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.067362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.067527 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.067478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.067647 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.067613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-grpc-tls\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.067755 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.067738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b3f30a0-8c63-4663-a455-074c34baf1f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.072512 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.072494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jp6f\" (UniqueName: \"kubernetes.io/projected/6b3f30a0-8c63-4663-a455-074c34baf1f6-kube-api-access-7jp6f\") pod \"thanos-querier-6759b5f5cc-gdhf7\" (UID: \"6b3f30a0-8c63-4663-a455-074c34baf1f6\") " pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.101494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.101466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:22.207554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.207516    2576 generic.go:356] "Generic (PLEG): container finished" podID="e6a728c4-5006-4443-8129-3cf84ab32499" containerID="691cead32b5532913cd878b64acb488bef3f49cfafaa4819f3cd6112168b55e6" exitCode=0
Sep 12 00:45:22.207742 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.207608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvcb5" event={"ID":"e6a728c4-5006-4443-8129-3cf84ab32499","Type":"ContainerDied","Data":"691cead32b5532913cd878b64acb488bef3f49cfafaa4819f3cd6112168b55e6"}
Sep 12 00:45:22.209905 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.209878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh" event={"ID":"ac750cc6-e520-46e6-805d-81f7ec60bbc5","Type":"ContainerStarted","Data":"1b9211f2d0bf082bc956f91dc966f123fbec034716387c02f4294866fa3582e3"}
Sep 12 00:45:22.793986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:22.793963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"]
Sep 12 00:45:22.796481 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:22.796450    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3f30a0_8c63_4663_a455_074c34baf1f6.slice/crio-0e72b9304d38dcbbc83a0510293aea177494fbc8868239dbd6c03572a30d452a WatchSource:0}: Error finding container 0e72b9304d38dcbbc83a0510293aea177494fbc8868239dbd6c03572a30d452a: Status 404 returned error can't find the container with id 0e72b9304d38dcbbc83a0510293aea177494fbc8868239dbd6c03572a30d452a
Sep 12 00:45:23.213646 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.213606    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:23.214075 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.213674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:23.216251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.216222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh" event={"ID":"ac750cc6-e520-46e6-805d-81f7ec60bbc5","Type":"ContainerStarted","Data":"50980f3418ec921484047a17bdccf502c2bb1f311bee58233b27ff6de4e0dc2c"}
Sep 12 00:45:23.218736 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.218714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvcb5" event={"ID":"e6a728c4-5006-4443-8129-3cf84ab32499","Type":"ContainerStarted","Data":"c42d6d313fa830cb374add673891dee5cf2065aebd1467d0c56f5ec5e03d963f"}
Sep 12 00:45:23.218851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.218760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vvcb5" event={"ID":"e6a728c4-5006-4443-8129-3cf84ab32499","Type":"ContainerStarted","Data":"e7d1e3e4e3e8053d2de3a618f33f87bc02e2d758a71a0d627bd837f1197fed09"}
Sep 12 00:45:23.220085 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.220047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:23.220879 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.220854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"0e72b9304d38dcbbc83a0510293aea177494fbc8868239dbd6c03572a30d452a"}
Sep 12 00:45:23.223140 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.223116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr" event={"ID":"b1c8f5b3-6961-41b2-b431-1dd0144504a7","Type":"ContainerStarted","Data":"dd5aee32c9d537e8cef2886f6beaf9d5e965fe48531772d0902002ad907506cb"}
Sep 12 00:45:23.223253 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.223163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr" event={"ID":"b1c8f5b3-6961-41b2-b431-1dd0144504a7","Type":"ContainerStarted","Data":"578195865d7dd04962100e302adf914b4bb05a47b003401820800d9fb77cacbe"}
Sep 12 00:45:23.223253 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.223191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr" event={"ID":"b1c8f5b3-6961-41b2-b431-1dd0144504a7","Type":"ContainerStarted","Data":"93df381b836616124667309fdb53056ed212aef6bde2081a8586d58d0436dfcd"}
Sep 12 00:45:23.235909 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.235869    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-4lqnh" podStartSLOduration=2.978594136 podStartE2EDuration="4.235856675s" totalImagesPullingTime="1.257262539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:23.235089534 +0000 UTC m=+146.147768494" watchObservedRunningTime="2026-09-12 00:45:23.235856675 +0000 UTC m=+146.148535613"
Sep 12 00:45:23.277570 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.277530    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-6ckbr" podStartSLOduration=2.899161671 podStartE2EDuration="4.277513809s" totalImagesPullingTime="1.378352138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:23.275527198 +0000 UTC m=+146.188206145" watchObservedRunningTime="2026-09-12 00:45:23.277513809 +0000 UTC m=+146.190192745"
Sep 12 00:45:23.294901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:23.294834    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vvcb5" podStartSLOduration=3.198548462 podStartE2EDuration="4.294822482s" totalImagesPullingTime="1.023679627s" totalInitContainerRuntime="72.594393ms" isStatefulPod=true podCreationTimestamp="2026-09-12 00:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:23.293798558 +0000 UTC m=+146.206477513" watchObservedRunningTime="2026-09-12 00:45:23.294822482 +0000 UTC m=+146.207501443"
Sep 12 00:45:24.231189 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.231143    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:45:24.565056 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.564978    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"]
Sep 12 00:45:24.569770 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.569749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.572238 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.572209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 12 00:45:24.572238 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.572217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wh7wd\""
Sep 12 00:45:24.581793 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.581770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"]
Sep 12 00:45:24.691035 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.690995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/796c1688-f516-4876-9a21-505ec1e34f2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.691035 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.691039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5xvl\" (UniqueName: \"kubernetes.io/projected/796c1688-f516-4876-9a21-505ec1e34f2e-kube-api-access-d5xvl\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.791506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.791482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5xvl\" (UniqueName: \"kubernetes.io/projected/796c1688-f516-4876-9a21-505ec1e34f2e-kube-api-access-d5xvl\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.791661 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.791641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/796c1688-f516-4876-9a21-505ec1e34f2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.795790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.795761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/796c1688-f516-4876-9a21-505ec1e34f2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.800143 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.800117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5xvl\" (UniqueName: \"kubernetes.io/projected/796c1688-f516-4876-9a21-505ec1e34f2e-kube-api-access-d5xvl\") pod \"monitoring-plugin-5d85778b9d-gm7zl\" (UID: \"796c1688-f516-4876-9a21-505ec1e34f2e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.882008 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.881985    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:24.932001 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.931965    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"]
Sep 12 00:45:24.936638 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.935884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:24.938982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.938831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 12 00:45:24.938982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.938903    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 12 00:45:24.939651 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.939125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mrz4q\""
Sep 12 00:45:24.939651 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.939589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 12 00:45:24.939651 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.939639    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 12 00:45:24.940568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.940020    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 12 00:45:24.945253 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.945007    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 12 00:45:24.958731 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:24.958657    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"]
Sep 12 00:45:25.094720 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094720 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-federate-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-serving-certs-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-metrics-client-ca\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb57g\" (UniqueName: \"kubernetes.io/projected/23b48a3a-d5bc-4f92-87e2-68538d9d802e-kube-api-access-rb57g\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.094987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.094966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.158730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.158695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"]
Sep 12 00:45:25.161341 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:25.161317    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796c1688_f516_4876_9a21_505ec1e34f2e.slice/crio-ced313162f8061cdd304b25402660c949edd0855f812b2684cb6c71d8c7bcd27 WatchSource:0}: Error finding container ced313162f8061cdd304b25402660c949edd0855f812b2684cb6c71d8c7bcd27: Status 404 returned error can't find the container with id ced313162f8061cdd304b25402660c949edd0855f812b2684cb6c71d8c7bcd27
Sep 12 00:45:25.196433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-federate-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-serving-certs-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-metrics-client-ca\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb57g\" (UniqueName: \"kubernetes.io/projected/23b48a3a-d5bc-4f92-87e2-68538d9d802e-kube-api-access-rb57g\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.196904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.196679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.197562 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.197437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-serving-certs-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.197562 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.197474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.197562 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.197543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23b48a3a-d5bc-4f92-87e2-68538d9d802e-metrics-client-ca\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.199348 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.199324    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.199463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.199367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.199463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.199414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-federate-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.199463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.199450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/23b48a3a-d5bc-4f92-87e2-68538d9d802e-telemeter-client-tls\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.204592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.204574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb57g\" (UniqueName: \"kubernetes.io/projected/23b48a3a-d5bc-4f92-87e2-68538d9d802e-kube-api-access-rb57g\") pod \"telemeter-client-7fd47c8b86-s2dg6\" (UID: \"23b48a3a-d5bc-4f92-87e2-68538d9d802e\") " pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.233072 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.233035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"bf85c1c0e62befec95c50ef472fab07ead423623b40f2509003e3c9759c9712b"}
Sep 12 00:45:25.233486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.233113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"3a8aaefffed7cdb7c9a9220dac2e802ef7e8ba1d657ce74c450f608306933dff"}
Sep 12 00:45:25.233486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.233154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"a9324544696455a6407f487b210ca147e10f8586ce6cfd3e13727ca7c9ad6954"}
Sep 12 00:45:25.234301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.234260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl" event={"ID":"796c1688-f516-4876-9a21-505ec1e34f2e","Type":"ContainerStarted","Data":"ced313162f8061cdd304b25402660c949edd0855f812b2684cb6c71d8c7bcd27"}
Sep 12 00:45:25.250696 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.250675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"
Sep 12 00:45:25.532031 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:25.531996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6"]
Sep 12 00:45:25.595006 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:25.594973    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b48a3a_d5bc_4f92_87e2_68538d9d802e.slice/crio-09e88c394ed3d6213afb207a84be889b567eba98b17f0e4064e5b828fa01f077 WatchSource:0}: Error finding container 09e88c394ed3d6213afb207a84be889b567eba98b17f0e4064e5b828fa01f077: Status 404 returned error can't find the container with id 09e88c394ed3d6213afb207a84be889b567eba98b17f0e4064e5b828fa01f077
Sep 12 00:45:26.246500 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.246463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"3976e0f376c6ee9fbb17ac15ad9be534c39d2f82b608fc0a7081352d151c2e61"}
Sep 12 00:45:26.246935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.246546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"9225c352801796fcae687867bdf7dfe250498ed8277440655ef71942bd4a3d90"}
Sep 12 00:45:26.246935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.246589    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" event={"ID":"6b3f30a0-8c63-4663-a455-074c34baf1f6","Type":"ContainerStarted","Data":"1ecaf4bd84ec67d71dcdf03baf14c47c331ac84cf67bf7aba710a14889f161f9"}
Sep 12 00:45:26.246935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.246637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:26.248049 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.248020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6" event={"ID":"23b48a3a-d5bc-4f92-87e2-68538d9d802e","Type":"ContainerStarted","Data":"09e88c394ed3d6213afb207a84be889b567eba98b17f0e4064e5b828fa01f077"}
Sep 12 00:45:26.270063 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:26.269995    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7" podStartSLOduration=2.664405489 podStartE2EDuration="5.26997419s" totalImagesPullingTime="2.605568701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:26.268425623 +0000 UTC m=+149.181104583" watchObservedRunningTime="2026-09-12 00:45:26.26997419 +0000 UTC m=+149.182653130"
Sep 12 00:45:27.253771 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.253733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl" event={"ID":"796c1688-f516-4876-9a21-505ec1e34f2e","Type":"ContainerStarted","Data":"e348188885f65b1e58dff0ca644f8ec8a3f0eebe9e0a8dc8071f738b9e6cdfd0"}
Sep 12 00:45:27.254237 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.254113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:27.258745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.258720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl"
Sep 12 00:45:27.272881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.272838    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-gm7zl" podStartSLOduration=1.819824087 podStartE2EDuration="3.272823889s" totalImagesPullingTime="1.452999802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:27.271881636 +0000 UTC m=+150.184560593" watchObservedRunningTime="2026-09-12 00:45:27.272823889 +0000 UTC m=+150.185502844"
Sep 12 00:45:27.531906 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.531824    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:27.535425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.535401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.543022 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.542985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 12 00:45:27.547919 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.547897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:27.618374 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5flnh\" (UniqueName: \"kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.618808 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.618666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719666 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5flnh\" (UniqueName: \"kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.719939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.719930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.720627 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.720580    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.720743 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.720659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.720743 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.720661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.720876 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.720841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.723187 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.723127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.723332 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.723247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.728844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.728823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5flnh\" (UniqueName: \"kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh\") pod \"console-584589b76-b4kfb\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") " pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:27.847373 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:27.847301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:28.136922 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:28.136845    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:28.139801 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:28.139779    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e31aab_6b18_4d75_ad21_ed166240a878.slice/crio-c4f547dd1742dcab66fc248cab27ae152ac01f167e18d634561291b6f5c84e7d WatchSource:0}: Error finding container c4f547dd1742dcab66fc248cab27ae152ac01f167e18d634561291b6f5c84e7d: Status 404 returned error can't find the container with id c4f547dd1742dcab66fc248cab27ae152ac01f167e18d634561291b6f5c84e7d
Sep 12 00:45:28.258883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:28.258844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584589b76-b4kfb" event={"ID":"97e31aab-6b18-4d75-ad21-ed166240a878","Type":"ContainerStarted","Data":"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"}
Sep 12 00:45:28.259320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:28.258915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584589b76-b4kfb" event={"ID":"97e31aab-6b18-4d75-ad21-ed166240a878","Type":"ContainerStarted","Data":"c4f547dd1742dcab66fc248cab27ae152ac01f167e18d634561291b6f5c84e7d"}
Sep 12 00:45:28.260734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:28.260713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6" event={"ID":"23b48a3a-d5bc-4f92-87e2-68538d9d802e","Type":"ContainerStarted","Data":"78219a645a2d987ba5ddf17edffc763da0b98a1320ef9ed072ecfef26b9919af"}
Sep 12 00:45:28.300341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:28.300270    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584589b76-b4kfb" podStartSLOduration=1.300255958 podStartE2EDuration="1.300255958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:28.298591306 +0000 UTC m=+151.211270259" watchObservedRunningTime="2026-09-12 00:45:28.300255958 +0000 UTC m=+151.212934895"
Sep 12 00:45:29.267610 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:29.267521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6" event={"ID":"23b48a3a-d5bc-4f92-87e2-68538d9d802e","Type":"ContainerStarted","Data":"4671bbf9091723be883706e9c1fd71722fe19ef85d06655a155055ee49b362a7"}
Sep 12 00:45:29.267610 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:29.267587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6" event={"ID":"23b48a3a-d5bc-4f92-87e2-68538d9d802e","Type":"ContainerStarted","Data":"182bfe9b29b7f27eb435a17c2ca80d929ed32fddeb316a817d2af0f8553ec7f8"}
Sep 12 00:45:29.290090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:29.290021    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7fd47c8b86-s2dg6" podStartSLOduration=2.003969085 podStartE2EDuration="5.289998581s" totalImagesPullingTime="3.286029496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:29.289656571 +0000 UTC m=+152.202335520" watchObservedRunningTime="2026-09-12 00:45:29.289998581 +0000 UTC m=+152.202677519"
Sep 12 00:45:31.264789 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.264753    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:31.290004 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.289975    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:45:31.295610 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.295593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.303301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.303259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:45:31.354747 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.354869 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.354869 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xm6\" (UniqueName: \"kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.354869 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.354869 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.355010 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.355010 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.354961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455836 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xm6\" (UniqueName: \"kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455836 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455836 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.455836 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.456020 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.455846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.456399 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.456372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.456567 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.456547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.456680 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.456659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.456730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.456701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.458199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.458177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.458269 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.458221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.464198 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.464178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xm6\" (UniqueName: \"kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6\") pod \"console-799bfc4864-skf45\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") " pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.605382 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.605319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:31.909228 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:31.909203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:45:31.910861 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:31.910837    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb08f34_0dfe_4a0f_a9ef_95de7faf955d.slice/crio-48b8789d8cad87ce9048a410540c0ce62f8a0aeaea07b5d4c3eb3fe460f3b36f WatchSource:0}: Error finding container 48b8789d8cad87ce9048a410540c0ce62f8a0aeaea07b5d4c3eb3fe460f3b36f: Status 404 returned error can't find the container with id 48b8789d8cad87ce9048a410540c0ce62f8a0aeaea07b5d4c3eb3fe460f3b36f
Sep 12 00:45:32.260384 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:32.260298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6759b5f5cc-gdhf7"
Sep 12 00:45:32.285731 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:32.285576    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799bfc4864-skf45" event={"ID":"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d","Type":"ContainerStarted","Data":"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"}
Sep 12 00:45:32.285731 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:32.285628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799bfc4864-skf45" event={"ID":"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d","Type":"ContainerStarted","Data":"48b8789d8cad87ce9048a410540c0ce62f8a0aeaea07b5d4c3eb3fe460f3b36f"}
Sep 12 00:45:32.302502 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:32.302448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-799bfc4864-skf45" podStartSLOduration=1.3024279650000001 podStartE2EDuration="1.302427965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:32.30221047 +0000 UTC m=+155.214889435" watchObservedRunningTime="2026-09-12 00:45:32.302427965 +0000 UTC m=+155.215106903"
Sep 12 00:45:33.208319 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.208236    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" containerName="registry" containerID="cri-o://06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be" gracePeriod=30
Sep 12 00:45:33.443122 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.443101    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:45:33.472516 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472516 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472522    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472539    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472635    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.472892 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472685    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4djtc\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc\") pod \"69dad759-acf4-4815-97b4-26d36ec3ae7e\" (UID: \"69dad759-acf4-4815-97b4-26d36ec3ae7e\") "
Sep 12 00:45:33.473027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.472989    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:33.473027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.473002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:33.475241 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.475208    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:45:33.475379 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.475233    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc" (OuterVolumeSpecName: "kube-api-access-4djtc") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "kube-api-access-4djtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:45:33.475379 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.475216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:45:33.475560 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.475537    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:45:33.475642 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.475626    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:45:33.484362 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.484336    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "69dad759-acf4-4815-97b4-26d36ec3ae7e" (UID: "69dad759-acf4-4815-97b4-26d36ec3ae7e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:45:33.573440 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573416    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4djtc\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-kube-api-access-4djtc\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573440 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573437    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-bound-sa-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573447    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-tls\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573455    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-trusted-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573463    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/69dad759-acf4-4815-97b4-26d36ec3ae7e-registry-certificates\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573472    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/69dad759-acf4-4815-97b4-26d36ec3ae7e-ca-trust-extracted\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573480    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-image-registry-private-configuration\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:33.573571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:33.573489    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/69dad759-acf4-4815-97b4-26d36ec3ae7e-installation-pull-secrets\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:34.294105 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.294070    2576 generic.go:356] "Generic (PLEG): container finished" podID="69dad759-acf4-4815-97b4-26d36ec3ae7e" containerID="06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be" exitCode=0
Sep 12 00:45:34.294292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.294124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" event={"ID":"69dad759-acf4-4815-97b4-26d36ec3ae7e","Type":"ContainerDied","Data":"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"}
Sep 12 00:45:34.294292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.294132    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq"
Sep 12 00:45:34.294292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.294165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56cb5d8758-9tncq" event={"ID":"69dad759-acf4-4815-97b4-26d36ec3ae7e","Type":"ContainerDied","Data":"88f4ba7d86cf81fe978777920a270aff47b50c4cc18f27434ee8ca36b86988b3"}
Sep 12 00:45:34.294292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.294183    2576 scope.go:117] "RemoveContainer" containerID="06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"
Sep 12 00:45:34.302505 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.302483    2576 scope.go:117] "RemoveContainer" containerID="06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"
Sep 12 00:45:34.302758 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:34.302737    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be\": container with ID starting with 06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be not found: ID does not exist" containerID="06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"
Sep 12 00:45:34.302827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.302765    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be"} err="failed to get container status \"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be\": rpc error: code = NotFound desc = could not find container \"06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be\": container with ID starting with 06d5950c37adabb1f83fbe2919dfd621d3a0023a7b45e9cdbd17a3502267d1be not found: ID does not exist"
Sep 12 00:45:34.310957 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.310935    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:45:34.319851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:34.319824    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56cb5d8758-9tncq"]
Sep 12 00:45:35.580501 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:35.580463    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" path="/var/lib/kubelet/pods/69dad759-acf4-4815-97b4-26d36ec3ae7e/volumes"
Sep 12 00:45:36.013001 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:36.012963    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c6t79" podUID="1af5db43-0ae2-40bb-beaf-96395ad3362a"
Sep 12 00:45:36.301776 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:36.301704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:37.847397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:37.847370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:40.833197 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:40.833159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:40.835660 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:40.835631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1af5db43-0ae2-40bb-beaf-96395ad3362a-metrics-tls\") pod \"dns-default-c6t79\" (UID: \"1af5db43-0ae2-40bb-beaf-96395ad3362a\") " pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:41.105743 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.105650    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2gxdg\""
Sep 12 00:45:41.113547 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.113520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:41.393369 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.393346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c6t79"]
Sep 12 00:45:41.395686 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:45:41.395652    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af5db43_0ae2_40bb_beaf_96395ad3362a.slice/crio-c3c52be1b3a97c8296e2773a68798ad26563840f36736e96842aa1d5460fc39b WatchSource:0}: Error finding container c3c52be1b3a97c8296e2773a68798ad26563840f36736e96842aa1d5460fc39b: Status 404 returned error can't find the container with id c3c52be1b3a97c8296e2773a68798ad26563840f36736e96842aa1d5460fc39b
Sep 12 00:45:41.606311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.606263    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:41.606459 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.606332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:41.611160 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:41.611131    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:42.329264 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:42.329227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6t79" event={"ID":"1af5db43-0ae2-40bb-beaf-96395ad3362a","Type":"ContainerStarted","Data":"c3c52be1b3a97c8296e2773a68798ad26563840f36736e96842aa1d5460fc39b"}
Sep 12 00:45:42.333774 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:42.333750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:45:42.388299 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:42.388244    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:45:43.334831 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:43.334740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6t79" event={"ID":"1af5db43-0ae2-40bb-beaf-96395ad3362a","Type":"ContainerStarted","Data":"4b60eafd47ff61ab748126c1683e551a4a3f49200b4ca77994e7704bce4f4274"}
Sep 12 00:45:43.335209 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:43.334832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c6t79" event={"ID":"1af5db43-0ae2-40bb-beaf-96395ad3362a","Type":"ContainerStarted","Data":"0a2a85e9776fd3143e454eb8251fd2c988314306e8a37a91aaf1f1ae73167d1e"}
Sep 12 00:45:43.335209 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:43.334963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:43.355361 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:43.355321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c6t79" podStartSLOduration=129.778232814 podStartE2EDuration="2m11.355309588s" totalImagesPullingTime="1.577076774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:45:43.354498556 +0000 UTC m=+166.267177512" watchObservedRunningTime="2026-09-12 00:45:43.355309588 +0000 UTC m=+166.267988525"
Sep 12 00:45:53.340940 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:53.340870    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c6t79"
Sep 12 00:45:56.284473 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.284409    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-584589b76-b4kfb" podUID="97e31aab-6b18-4d75-ad21-ed166240a878" containerName="console" containerID="cri-o://ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec" gracePeriod=15
Sep 12 00:45:56.526447 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.526426    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:56.668078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668054    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5flnh\" (UniqueName: \"kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668179    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668470 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668232    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config\") pod \"97e31aab-6b18-4d75-ad21-ed166240a878\" (UID: \"97e31aab-6b18-4d75-ad21-ed166240a878\") "
Sep 12 00:45:56.668525 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668472    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca" (OuterVolumeSpecName: "service-ca") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:56.668611 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668585    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:56.668709 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668688    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:56.668766 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.668743    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config" (OuterVolumeSpecName: "console-config") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:45:56.670534 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.670510    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh" (OuterVolumeSpecName: "kube-api-access-5flnh") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "kube-api-access-5flnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:45:56.670907 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.670880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:45:56.670948 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.670895    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97e31aab-6b18-4d75-ad21-ed166240a878" (UID: "97e31aab-6b18-4d75-ad21-ed166240a878"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:45:56.769488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769460    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-oauth-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769483    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769492    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5flnh\" (UniqueName: \"kubernetes.io/projected/97e31aab-6b18-4d75-ad21-ed166240a878-kube-api-access-5flnh\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769501    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-oauth-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769509    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97e31aab-6b18-4d75-ad21-ed166240a878-console-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769517    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-trusted-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:56.769664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:56.769525    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97e31aab-6b18-4d75-ad21-ed166240a878-console-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:45:57.394480 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.394449    2576 generic.go:356] "Generic (PLEG): container finished" podID="97e31aab-6b18-4d75-ad21-ed166240a878" containerID="ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec" exitCode=0
Sep 12 00:45:57.394887 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.394499    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584589b76-b4kfb"
Sep 12 00:45:57.394887 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.394508    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584589b76-b4kfb" event={"ID":"97e31aab-6b18-4d75-ad21-ed166240a878","Type":"ContainerDied","Data":"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"}
Sep 12 00:45:57.394887 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.394548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584589b76-b4kfb" event={"ID":"97e31aab-6b18-4d75-ad21-ed166240a878","Type":"ContainerDied","Data":"c4f547dd1742dcab66fc248cab27ae152ac01f167e18d634561291b6f5c84e7d"}
Sep 12 00:45:57.394887 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.394567    2576 scope.go:117] "RemoveContainer" containerID="ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"
Sep 12 00:45:57.404055 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.404037    2576 scope.go:117] "RemoveContainer" containerID="ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"
Sep 12 00:45:57.404336 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:45:57.404318    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec\": container with ID starting with ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec not found: ID does not exist" containerID="ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"
Sep 12 00:45:57.404395 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.404344    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec"} err="failed to get container status \"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec\": rpc error: code = NotFound desc = could not find container \"ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec\": container with ID starting with ccdb6b1f4ab4a3c1aa8e0bad9642871312a94b99aecadc9bba0165364bcd21ec not found: ID does not exist"
Sep 12 00:45:57.416891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.416861    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:57.421504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.421484    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584589b76-b4kfb"]
Sep 12 00:45:57.581134 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:45:57.581105    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e31aab-6b18-4d75-ad21-ed166240a878" path="/var/lib/kubelet/pods/97e31aab-6b18-4d75-ad21-ed166240a878/volumes"
Sep 12 00:46:07.415258 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.415199    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9db6b9fd7-n48p9" podUID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" containerName="console" containerID="cri-o://0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6" gracePeriod=15
Sep 12 00:46:07.652788 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.652768    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:46:07.667745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.667745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.667886 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.667886 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667783    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.667886 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.667886 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.667830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcxd4\" (UniqueName: \"kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4\") pod \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\" (UID: \"4bd1a394-3321-403f-ae22-4ae541eeb2b7\") "
Sep 12 00:46:07.668139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.668112    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:46:07.668225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.668147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:46:07.668302 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.668222    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config" (OuterVolumeSpecName: "console-config") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:46:07.670462 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.670079    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4" (OuterVolumeSpecName: "kube-api-access-rcxd4") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "kube-api-access-rcxd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:46:07.670676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.670651    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:46:07.671166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.671138    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4bd1a394-3321-403f-ae22-4ae541eeb2b7" (UID: "4bd1a394-3321-403f-ae22-4ae541eeb2b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:46:07.768783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768745    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-oauth-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:07.768783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768776    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:07.768783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768785    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcxd4\" (UniqueName: \"kubernetes.io/projected/4bd1a394-3321-403f-ae22-4ae541eeb2b7-kube-api-access-rcxd4\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:07.769014 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768794    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:07.769014 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768805    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-oauth-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:07.769014 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:07.768814    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bd1a394-3321-403f-ae22-4ae541eeb2b7-console-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:46:08.438058 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.438021    2576 generic.go:356] "Generic (PLEG): container finished" podID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" containerID="0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6" exitCode=0
Sep 12 00:46:08.438592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.438072    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9db6b9fd7-n48p9"
Sep 12 00:46:08.438592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.438072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9db6b9fd7-n48p9" event={"ID":"4bd1a394-3321-403f-ae22-4ae541eeb2b7","Type":"ContainerDied","Data":"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"}
Sep 12 00:46:08.438592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.438192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9db6b9fd7-n48p9" event={"ID":"4bd1a394-3321-403f-ae22-4ae541eeb2b7","Type":"ContainerDied","Data":"966bea954d1abc47964787f4ae932e6aae09e8938579b91c65403fcb37b07d56"}
Sep 12 00:46:08.438592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.438219    2576 scope.go:117] "RemoveContainer" containerID="0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"
Sep 12 00:46:08.446646 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.446628    2576 scope.go:117] "RemoveContainer" containerID="0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"
Sep 12 00:46:08.446904 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:46:08.446887    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6\": container with ID starting with 0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6 not found: ID does not exist" containerID="0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"
Sep 12 00:46:08.446953 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.446913    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6"} err="failed to get container status \"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6\": rpc error: code = NotFound desc = could not find container \"0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6\": container with ID starting with 0e9eb6493b324c4f4dba260011979b88c555ebb1d51eab24de6894bb5f6d65f6 not found: ID does not exist"
Sep 12 00:46:08.463235 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.463205    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:46:08.471840 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:08.471818    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9db6b9fd7-n48p9"]
Sep 12 00:46:09.580254 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:09.580221    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" path="/var/lib/kubelet/pods/4bd1a394-3321-403f-ae22-4ae541eeb2b7/volumes"
Sep 12 00:46:42.129221 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129179    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129630    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e31aab-6b18-4d75-ad21-ed166240a878" containerName="console"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129649    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e31aab-6b18-4d75-ad21-ed166240a878" containerName="console"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129670    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" containerName="registry"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129678    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" containerName="registry"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129692    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" containerName="console"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129700    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" containerName="console"
Sep 12 00:46:42.129790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129786    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69dad759-acf4-4815-97b4-26d36ec3ae7e" containerName="registry"
Sep 12 00:46:42.130136 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129799    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e31aab-6b18-4d75-ad21-ed166240a878" containerName="console"
Sep 12 00:46:42.130136 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.129810    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd1a394-3321-403f-ae22-4ae541eeb2b7" containerName="console"
Sep 12 00:46:42.134908 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.134887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.138493 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.138467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 12 00:46:42.138615 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.138471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 12 00:46:42.138667 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.138626    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 12 00:46:42.138925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.138897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 12 00:46:42.139153 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.139136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-27jp7\""
Sep 12 00:46:42.139153 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.139140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 12 00:46:42.139361 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.139140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 12 00:46:42.139361 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.139154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 12 00:46:42.139619 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.139598    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 12 00:46:42.144987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.144969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 12 00:46:42.148362 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.148345    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:46:42.233594 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233594 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75x8\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-kube-api-access-t75x8\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-web-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-config-out\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.233834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.234029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.233939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.334982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.334951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.334982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.334987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335223 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-web-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335223 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-config-out\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335418 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335472 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335593 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335593 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335696 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.335696 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.335626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75x8\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-kube-api-access-t75x8\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.336150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.336122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.337115 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.337084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-web-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338446    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338750 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9365273e-4d07-4523-a60d-532fbb2c3117-config-out\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.338891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.339010 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.338988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-config-volume\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.339344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.339322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.339614 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.339599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.340583 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.340561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9365273e-4d07-4523-a60d-532fbb2c3117-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.344731 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.344709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75x8\" (UniqueName: \"kubernetes.io/projected/9365273e-4d07-4523-a60d-532fbb2c3117-kube-api-access-t75x8\") pod \"alertmanager-main-0\" (UID: \"9365273e-4d07-4523-a60d-532fbb2c3117\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.445231 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.445205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 00:46:42.726590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:42.726569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 00:46:42.728244 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:46:42.728224    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9365273e_4d07_4523_a60d_532fbb2c3117.slice/crio-ad68aba0a3ccfde96c21b9cdf9661ffddd316f83fff7ede9868ed6bf0953cd0d WatchSource:0}: Error finding container ad68aba0a3ccfde96c21b9cdf9661ffddd316f83fff7ede9868ed6bf0953cd0d: Status 404 returned error can't find the container with id ad68aba0a3ccfde96c21b9cdf9661ffddd316f83fff7ede9868ed6bf0953cd0d
Sep 12 00:46:43.577634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:43.577599    2576 generic.go:356] "Generic (PLEG): container finished" podID="9365273e-4d07-4523-a60d-532fbb2c3117" containerID="a52a6acd8640867cfee29e6530e74771b2232d2f6d11f5838b6009a9c9e68d31" exitCode=0
Sep 12 00:46:43.581190 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:43.581162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerDied","Data":"a52a6acd8640867cfee29e6530e74771b2232d2f6d11f5838b6009a9c9e68d31"}
Sep 12 00:46:43.581324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:43.581237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"ad68aba0a3ccfde96c21b9cdf9661ffddd316f83fff7ede9868ed6bf0953cd0d"}
Sep 12 00:46:45.591012 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.590980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"3a50261dffa670929d869d28cc8170d353085b50065ee72ab7bf4b5c3397049b"}
Sep 12 00:46:45.591466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.591043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"7eccd793ebd789636507f8faf69956ad49b8c48b1c7dc903ceb5375ef19f37b7"}
Sep 12 00:46:45.591466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.591071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"57357e8dcc0665b83675bd168e8e3d027ef619762413734c32e006de0adea7cb"}
Sep 12 00:46:45.591466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.591096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"a0400a075328165f1bb1a39e5cb32f9aa3b0c678abd3cfd81533ca549779ecbe"}
Sep 12 00:46:45.591466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.591118    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"eae444e77b0e525ec9947d6b5ac3ce9ac6a7f746a5e184bcffe99d9e8f6c20dd"}
Sep 12 00:46:45.591466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.591141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9365273e-4d07-4523-a60d-532fbb2c3117","Type":"ContainerStarted","Data":"59190fdd4c396422402d2d51f0b7452cbcb083fda966b1e6adf6ba504c7f6981"}
Sep 12 00:46:45.621529 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:46:45.621482    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.381850721 podStartE2EDuration="3.621466847s" totalImagesPullingTime="1.221355646s" totalInitContainerRuntime="18.26048ms" isStatefulPod=false podCreationTimestamp="2026-09-12 00:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:46:45.619224733 +0000 UTC m=+228.531903704" watchObservedRunningTime="2026-09-12 00:46:45.621466847 +0000 UTC m=+228.534145783"
Sep 12 00:47:03.645882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.645844    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:47:03.650558 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.650529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.660449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.660426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:47:03.820297 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820297 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820511 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820511 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820511 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820511 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krvsx\" (UniqueName: \"kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.820632 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.820547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krvsx\" (UniqueName: \"kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.921577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.921565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.922108 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.922082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.922212 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.922160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.922252 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.922237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.922489 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.922468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.923748 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.923721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.923984 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.923964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.928843 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.928820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krvsx\" (UniqueName: \"kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx\") pod \"console-867d4448cc-8qqs4\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") " pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:03.961147 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:03.961123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:04.233438 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:04.233412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:47:04.235493 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:47:04.235465    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cf8dc1_787d_4ed3_bcca_1d2cae216018.slice/crio-7f0f279c223749b84c282ba03df6e71f4a031a6d3ce9c9303f8d672a949b446c WatchSource:0}: Error finding container 7f0f279c223749b84c282ba03df6e71f4a031a6d3ce9c9303f8d672a949b446c: Status 404 returned error can't find the container with id 7f0f279c223749b84c282ba03df6e71f4a031a6d3ce9c9303f8d672a949b446c
Sep 12 00:47:04.673553 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:04.673516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4448cc-8qqs4" event={"ID":"f1cf8dc1-787d-4ed3-bcca-1d2cae216018","Type":"ContainerStarted","Data":"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"}
Sep 12 00:47:04.673930 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:04.673570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4448cc-8qqs4" event={"ID":"f1cf8dc1-787d-4ed3-bcca-1d2cae216018","Type":"ContainerStarted","Data":"7f0f279c223749b84c282ba03df6e71f4a031a6d3ce9c9303f8d672a949b446c"}
Sep 12 00:47:04.693088 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:04.693039    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867d4448cc-8qqs4" podStartSLOduration=1.6930227709999999 podStartE2EDuration="1.693022771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:47:04.691233012 +0000 UTC m=+247.603911964" watchObservedRunningTime="2026-09-12 00:47:04.693022771 +0000 UTC m=+247.605701707"
Sep 12 00:47:13.961541 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:13.961483    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:13.962050 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:13.961568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:13.966169 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:13.966149    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:14.716178 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:14.716147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:47:14.766375 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:14.766338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:47:39.787254 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:39.787195    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-799bfc4864-skf45" podUID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" containerName="console" containerID="cri-o://abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9" gracePeriod=15
Sep 12 00:47:40.026219 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.026193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:47:40.124531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5xm6\" (UniqueName: \"kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124501    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124531    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124559    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124662    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config\") pod \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\" (UID: \"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d\") "
Sep 12 00:47:40.124975 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.124916    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:40.125199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.125166    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config" (OuterVolumeSpecName: "console-config") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:40.125199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.125174    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:40.125199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.125189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:47:40.127011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.126986    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6" (OuterVolumeSpecName: "kube-api-access-b5xm6") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "kube-api-access-b5xm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:47:40.127606 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.127571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:40.127740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.127715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" (UID: "0fb08f34-0dfe-4a0f-a9ef-95de7faf955d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:47:40.225456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225422    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-oauth-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225449    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5xm6\" (UniqueName: \"kubernetes.io/projected/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-kube-api-access-b5xm6\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225459    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-trusted-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225671 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225467    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225671 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225476    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-console-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225671 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225484    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-oauth-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.225671 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.225493    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:47:40.819142 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.819107    2576 generic.go:356] "Generic (PLEG): container finished" podID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" containerID="abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9" exitCode=0
Sep 12 00:47:40.819574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.819164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799bfc4864-skf45"
Sep 12 00:47:40.819574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.819195    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799bfc4864-skf45" event={"ID":"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d","Type":"ContainerDied","Data":"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"}
Sep 12 00:47:40.819574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.819245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799bfc4864-skf45" event={"ID":"0fb08f34-0dfe-4a0f-a9ef-95de7faf955d","Type":"ContainerDied","Data":"48b8789d8cad87ce9048a410540c0ce62f8a0aeaea07b5d4c3eb3fe460f3b36f"}
Sep 12 00:47:40.819574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.819269    2576 scope.go:117] "RemoveContainer" containerID="abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"
Sep 12 00:47:40.827954 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.827937    2576 scope.go:117] "RemoveContainer" containerID="abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"
Sep 12 00:47:40.828207 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:47:40.828189    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9\": container with ID starting with abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9 not found: ID does not exist" containerID="abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"
Sep 12 00:47:40.828253 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.828217    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9"} err="failed to get container status \"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9\": rpc error: code = NotFound desc = could not find container \"abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9\": container with ID starting with abee13ce1ebfcf7ec0a126707dabf676d9397a16dc3bcd9aaa8fd28be8cb0bb9 not found: ID does not exist"
Sep 12 00:47:40.839239 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.839220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:47:40.841827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.841809    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-799bfc4864-skf45"]
Sep 12 00:47:40.895526 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.895501    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"]
Sep 12 00:47:40.895813 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.895802    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" containerName="console"
Sep 12 00:47:40.895864 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.895815    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" containerName="console"
Sep 12 00:47:40.895900 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.895871    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" containerName="console"
Sep 12 00:47:40.898737 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.898723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:40.901166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.901145    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cp79k\""
Sep 12 00:47:40.901166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.901160    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:47:40.901317 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.901162    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:47:40.907482 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:40.907465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"]
Sep 12 00:47:41.031383 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.031358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx68f\" (UniqueName: \"kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.031534 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.031414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.031534 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.031519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.132334 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.132252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.132457 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.132357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.132457 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.132376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx68f\" (UniqueName: \"kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.132728 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.132707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.132767 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.132707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.143080 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.143054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx68f\" (UniqueName: \"kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.208468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.208444    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:47:41.481957 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.481936    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"]
Sep 12 00:47:41.483941 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:47:41.483917    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a67c2ef_37f0_43f7_9adb_70171750c899.slice/crio-bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f WatchSource:0}: Error finding container bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f: Status 404 returned error can't find the container with id bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f
Sep 12 00:47:41.580289 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.580235    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb08f34-0dfe-4a0f-a9ef-95de7faf955d" path="/var/lib/kubelet/pods/0fb08f34-0dfe-4a0f-a9ef-95de7faf955d/volumes"
Sep 12 00:47:41.824002 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:41.823909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg" event={"ID":"6a67c2ef-37f0-43f7-9adb-70171750c899","Type":"ContainerStarted","Data":"bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f"}
Sep 12 00:47:47.853455 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:47.853421    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerID="5b9b68afb33351a2175fcbc26cfcfcda5d155a1cb8935d090130f654485cdf10" exitCode=0
Sep 12 00:47:47.853853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:47.853509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg" event={"ID":"6a67c2ef-37f0-43f7-9adb-70171750c899","Type":"ContainerDied","Data":"5b9b68afb33351a2175fcbc26cfcfcda5d155a1cb8935d090130f654485cdf10"}
Sep 12 00:47:50.869374 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:50.869341    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerID="3dfcfc4e2752302d6c5cc579ffbfab30b0d867fe6fceb4ffba3989178458848c" exitCode=0
Sep 12 00:47:50.869740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:50.869389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg" event={"ID":"6a67c2ef-37f0-43f7-9adb-70171750c899","Type":"ContainerDied","Data":"3dfcfc4e2752302d6c5cc579ffbfab30b0d867fe6fceb4ffba3989178458848c"}
Sep 12 00:47:58.513926 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:58.513898    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 12 00:47:58.906954 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:58.906922    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerID="45ccb20299e5624604af796e171e6663ee76e52c5590f0ffeed29f4c03ed739f" exitCode=0
Sep 12 00:47:58.907141 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:47:58.906995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg" event={"ID":"6a67c2ef-37f0-43f7-9adb-70171750c899","Type":"ContainerDied","Data":"45ccb20299e5624604af796e171e6663ee76e52c5590f0ffeed29f4c03ed739f"}
Sep 12 00:48:00.040112 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.040080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:48:00.197166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.197062    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util\") pod \"6a67c2ef-37f0-43f7-9adb-70171750c899\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") "
Sep 12 00:48:00.197166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.197138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx68f\" (UniqueName: \"kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f\") pod \"6a67c2ef-37f0-43f7-9adb-70171750c899\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") "
Sep 12 00:48:00.197407 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.197214    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle\") pod \"6a67c2ef-37f0-43f7-9adb-70171750c899\" (UID: \"6a67c2ef-37f0-43f7-9adb-70171750c899\") "
Sep 12 00:48:00.197975 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.197938    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle" (OuterVolumeSpecName: "bundle") pod "6a67c2ef-37f0-43f7-9adb-70171750c899" (UID: "6a67c2ef-37f0-43f7-9adb-70171750c899"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:00.199517 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.199495    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f" (OuterVolumeSpecName: "kube-api-access-wx68f") pod "6a67c2ef-37f0-43f7-9adb-70171750c899" (UID: "6a67c2ef-37f0-43f7-9adb-70171750c899"). InnerVolumeSpecName "kube-api-access-wx68f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:00.202893 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.202868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util" (OuterVolumeSpecName: "util") pod "6a67c2ef-37f0-43f7-9adb-70171750c899" (UID: "6a67c2ef-37f0-43f7-9adb-70171750c899"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:00.298336 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.298298    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx68f\" (UniqueName: \"kubernetes.io/projected/6a67c2ef-37f0-43f7-9adb-70171750c899-kube-api-access-wx68f\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:00.298336 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.298328    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:00.298336 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.298337    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a67c2ef-37f0-43f7-9adb-70171750c899-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:00.917109 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.917081    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg"
Sep 12 00:48:00.917109 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.917094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hztlg" event={"ID":"6a67c2ef-37f0-43f7-9adb-70171750c899","Type":"ContainerDied","Data":"bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f"}
Sep 12 00:48:00.917331 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:00.917134    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bebeaa5c8e5dfc307982d709c9733e25ab45a8ddfcf575a1b225e0559ea0052f"
Sep 12 00:48:04.052067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052031    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"]
Sep 12 00:48:04.052573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052529    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="util"
Sep 12 00:48:04.052573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052547    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="util"
Sep 12 00:48:04.052573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052557    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="pull"
Sep 12 00:48:04.052573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052564    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="pull"
Sep 12 00:48:04.052573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052573    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="extract"
Sep 12 00:48:04.052855 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052583    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="extract"
Sep 12 00:48:04.052855 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.052676    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a67c2ef-37f0-43f7-9adb-70171750c899" containerName="extract"
Sep 12 00:48:04.082370 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.082336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"]
Sep 12 00:48:04.082527 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.082442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.085460 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.085422    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 12 00:48:04.085577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.085438    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:48:04.085577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.085550    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vsdjn\""
Sep 12 00:48:04.230429 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.230393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.230601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.230480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl62v\" (UniqueName: \"kubernetes.io/projected/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-kube-api-access-pl62v\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.331394 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.331319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl62v\" (UniqueName: \"kubernetes.io/projected/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-kube-api-access-pl62v\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.331503 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.331418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.331845 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.331821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.342509 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.342487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl62v\" (UniqueName: \"kubernetes.io/projected/e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71-kube-api-access-pl62v\") pod \"cert-manager-operator-controller-manager-55c444bf86-r442q\" (UID: \"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.393405 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.393361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"
Sep 12 00:48:04.691402 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.691254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q"]
Sep 12 00:48:04.692663 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:04.692630    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d9e4f9_7610_4c5f_bf6a_74b4e3e2ab71.slice/crio-9ffd967e775208712e62d2a4a3bbba346122caa2d3d4b813f758f86ea0767e6e WatchSource:0}: Error finding container 9ffd967e775208712e62d2a4a3bbba346122caa2d3d4b813f758f86ea0767e6e: Status 404 returned error can't find the container with id 9ffd967e775208712e62d2a4a3bbba346122caa2d3d4b813f758f86ea0767e6e
Sep 12 00:48:04.695823 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.695804    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:48:04.934776 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:04.934742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q" event={"ID":"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71","Type":"ContainerStarted","Data":"9ffd967e775208712e62d2a4a3bbba346122caa2d3d4b813f758f86ea0767e6e"}
Sep 12 00:48:06.946502 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:06.946465    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q" event={"ID":"e5d9e4f9-7610-4c5f-bf6a-74b4e3e2ab71","Type":"ContainerStarted","Data":"d1e25197b4f18ea9b1c27f14cadc5a9ed7adc38e8d5471eac566c537b5343d8d"}
Sep 12 00:48:06.967753 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:06.967700    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-r442q" podStartSLOduration=1.430682107 podStartE2EDuration="2.967682809s" totalImagesPullingTime="1.537000702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:06.966591152 +0000 UTC m=+309.879270089" watchObservedRunningTime="2026-09-12 00:48:06.967682809 +0000 UTC m=+309.880361747"
Sep 12 00:48:08.155807 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.155774    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"]
Sep 12 00:48:08.158191 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.158176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.160613 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.160590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:48:08.161360 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.161342    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:48:08.161413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.161346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cp79k\""
Sep 12 00:48:08.168126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.168102    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"]
Sep 12 00:48:08.264862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.264834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r848l\" (UniqueName: \"kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.265036 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.264880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.265036 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.264904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.365455 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.365421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r848l\" (UniqueName: \"kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.365613 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.365466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.365613 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.365489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.365837 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.365819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.365922 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.365906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.375354 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.375329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r848l\" (UniqueName: \"kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.466712 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.466645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:08.737197 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.737176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"]
Sep 12 00:48:08.739187 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:08.739156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bea36f6_e6a8_4616_acc5_62d4f4be81e8.slice/crio-76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6 WatchSource:0}: Error finding container 76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6: Status 404 returned error can't find the container with id 76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6
Sep 12 00:48:08.961373 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.961334    2576 generic.go:356] "Generic (PLEG): container finished" podID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerID="a450aa7344a609ae826d43bd44daa3d7e6fd363001e9d966f14f16aaa33aea6a" exitCode=0
Sep 12 00:48:08.961540 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.961412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws" event={"ID":"6bea36f6-e6a8-4616-acc5-62d4f4be81e8","Type":"ContainerDied","Data":"a450aa7344a609ae826d43bd44daa3d7e6fd363001e9d966f14f16aaa33aea6a"}
Sep 12 00:48:08.961540 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:08.961497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws" event={"ID":"6bea36f6-e6a8-4616-acc5-62d4f4be81e8","Type":"ContainerStarted","Data":"76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6"}
Sep 12 00:48:10.257683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.257647    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cshfr"]
Sep 12 00:48:10.260160 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.260141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.262630 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.262607    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 12 00:48:10.263646 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.263631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-858dj\""
Sep 12 00:48:10.263737 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.263643    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 12 00:48:10.269432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.269410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cshfr"]
Sep 12 00:48:10.382719 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.382686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lkf\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-kube-api-access-t2lkf\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.382908 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.382830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.483585 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.483546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lkf\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-kube-api-access-t2lkf\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.483727 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.483616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.492897 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.492862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.492998 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.492984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lkf\" (UniqueName: \"kubernetes.io/projected/f15dd726-8160-41e0-bcea-220d3a44ed6c-kube-api-access-t2lkf\") pod \"cert-manager-webhook-6486ffd997-cshfr\" (UID: \"f15dd726-8160-41e0-bcea-220d3a44ed6c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.579881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.579789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:10.849080 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.849054    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cshfr"]
Sep 12 00:48:10.851951 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:10.851927    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf15dd726_8160_41e0_bcea_220d3a44ed6c.slice/crio-6abaca645f05d59b83d8a37d0c02d61860a47b394ff65717bfc922b75c7c97a5 WatchSource:0}: Error finding container 6abaca645f05d59b83d8a37d0c02d61860a47b394ff65717bfc922b75c7c97a5: Status 404 returned error can't find the container with id 6abaca645f05d59b83d8a37d0c02d61860a47b394ff65717bfc922b75c7c97a5
Sep 12 00:48:10.857550 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.857529    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"]
Sep 12 00:48:10.860498 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.860482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:10.863133 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.863116    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kddt9\""
Sep 12 00:48:10.869994 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.869973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"]
Sep 12 00:48:10.973341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.973302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr" event={"ID":"f15dd726-8160-41e0-bcea-220d3a44ed6c","Type":"ContainerStarted","Data":"6abaca645f05d59b83d8a37d0c02d61860a47b394ff65717bfc922b75c7c97a5"}
Sep 12 00:48:10.987830 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.987802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgq8\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-kube-api-access-rbgq8\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:10.987988 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:10.987838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.088943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.088903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgq8\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-kube-api-access-rbgq8\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.088943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.088943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.097833 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.097806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.097971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.097929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgq8\" (UniqueName: \"kubernetes.io/projected/0755e541-0323-4c77-bf12-aa935e8fcf73-kube-api-access-rbgq8\") pod \"cert-manager-cainjector-559cdd8c87-w45xw\" (UID: \"0755e541-0323-4c77-bf12-aa935e8fcf73\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.169455 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.169415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"
Sep 12 00:48:11.447813 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.447780    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w45xw"]
Sep 12 00:48:11.449766 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:11.449734    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0755e541_0323_4c77_bf12_aa935e8fcf73.slice/crio-c0ce13077956ec336b819b5bb2ee1b536d9a4eea654679552b0f012e12bcf386 WatchSource:0}: Error finding container c0ce13077956ec336b819b5bb2ee1b536d9a4eea654679552b0f012e12bcf386: Status 404 returned error can't find the container with id c0ce13077956ec336b819b5bb2ee1b536d9a4eea654679552b0f012e12bcf386
Sep 12 00:48:11.980936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:11.980900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw" event={"ID":"0755e541-0323-4c77-bf12-aa935e8fcf73","Type":"ContainerStarted","Data":"c0ce13077956ec336b819b5bb2ee1b536d9a4eea654679552b0f012e12bcf386"}
Sep 12 00:48:12.989946 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:12.989912    2576 generic.go:356] "Generic (PLEG): container finished" podID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerID="b60e9de8086cb913ef9eb31fc6231758d64c6408bb881f14148e7809e25e58a0" exitCode=0
Sep 12 00:48:12.990445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:12.990006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws" event={"ID":"6bea36f6-e6a8-4616-acc5-62d4f4be81e8","Type":"ContainerDied","Data":"b60e9de8086cb913ef9eb31fc6231758d64c6408bb881f14148e7809e25e58a0"}
Sep 12 00:48:13.998821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:13.998782    2576 generic.go:356] "Generic (PLEG): container finished" podID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerID="40f307684b63036834153b03b2782946ffb0f75c720951ca243a2ce3c0e422d0" exitCode=0
Sep 12 00:48:13.999295 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:13.998889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws" event={"ID":"6bea36f6-e6a8-4616-acc5-62d4f4be81e8","Type":"ContainerDied","Data":"40f307684b63036834153b03b2782946ffb0f75c720951ca243a2ce3c0e422d0"}
Sep 12 00:48:15.005798 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.005761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw" event={"ID":"0755e541-0323-4c77-bf12-aa935e8fcf73","Type":"ContainerStarted","Data":"faa9103b1762f60b9d6b3ecf1cc52e63e02be86d236f5de9cc8d0781e598b221"}
Sep 12 00:48:15.007416 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.007391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr" event={"ID":"f15dd726-8160-41e0-bcea-220d3a44ed6c","Type":"ContainerStarted","Data":"66c4b57c97d95d1af33ea81fbe5ec8c77c70d6fa173df024211ed8c18177e51e"}
Sep 12 00:48:15.007547 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.007437    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:15.023176 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.023132    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w45xw" podStartSLOduration=2.0715557 podStartE2EDuration="5.023116317s" totalImagesPullingTime="2.951560617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:15.020976816 +0000 UTC m=+317.933655754" watchObservedRunningTime="2026-09-12 00:48:15.023116317 +0000 UTC m=+317.935795253"
Sep 12 00:48:15.039090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.039016    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr" podStartSLOduration=1.496199495 podStartE2EDuration="5.038995941s" totalImagesPullingTime="3.542796446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:15.037029344 +0000 UTC m=+317.949708283" watchObservedRunningTime="2026-09-12 00:48:15.038995941 +0000 UTC m=+317.951674877"
Sep 12 00:48:15.144536 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.144511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:15.227844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.227810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle\") pod \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") "
Sep 12 00:48:15.228005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.227858    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r848l\" (UniqueName: \"kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l\") pod \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") "
Sep 12 00:48:15.228005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.227897    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util\") pod \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\" (UID: \"6bea36f6-e6a8-4616-acc5-62d4f4be81e8\") "
Sep 12 00:48:15.228298 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.228150    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle" (OuterVolumeSpecName: "bundle") pod "6bea36f6-e6a8-4616-acc5-62d4f4be81e8" (UID: "6bea36f6-e6a8-4616-acc5-62d4f4be81e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:15.230201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.230178    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l" (OuterVolumeSpecName: "kube-api-access-r848l") pod "6bea36f6-e6a8-4616-acc5-62d4f4be81e8" (UID: "6bea36f6-e6a8-4616-acc5-62d4f4be81e8"). InnerVolumeSpecName "kube-api-access-r848l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:15.233298 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.233255    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util" (OuterVolumeSpecName: "util") pod "6bea36f6-e6a8-4616-acc5-62d4f4be81e8" (UID: "6bea36f6-e6a8-4616-acc5-62d4f4be81e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:15.329510 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.329433    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:15.329510 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.329464    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r848l\" (UniqueName: \"kubernetes.io/projected/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-kube-api-access-r848l\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:15.329510 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:15.329480    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6bea36f6-e6a8-4616-acc5-62d4f4be81e8-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:16.014397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:16.014362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws"
Sep 12 00:48:16.014397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:16.014386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frjsws" event={"ID":"6bea36f6-e6a8-4616-acc5-62d4f4be81e8","Type":"ContainerDied","Data":"76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6"}
Sep 12 00:48:16.014925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:16.014437    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76dd7ceb53cf96b587c82576d530e4bb925973c184ed00876564856b8c68ced6"
Sep 12 00:48:21.016957 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:21.016929    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cshfr"
Sep 12 00:48:22.835214 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835186    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"]
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835524    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="extract"
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835534    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="extract"
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835551    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="util"
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835557    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="util"
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835570    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="pull"
Sep 12 00:48:22.835601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835576    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="pull"
Sep 12 00:48:22.835784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.835628    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bea36f6-e6a8-4616-acc5-62d4f4be81e8" containerName="extract"
Sep 12 00:48:22.838416 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.838402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:22.840903 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.840876    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 12 00:48:22.840903 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.840881    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fpbdk\""
Sep 12 00:48:22.841585 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.841568    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 12 00:48:22.848604 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.848581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"]
Sep 12 00:48:22.893888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.893854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836a1e74-61a6-4f47-8133-2b6fa944de55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:22.893888 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.893884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qxk\" (UniqueName: \"kubernetes.io/projected/836a1e74-61a6-4f47-8133-2b6fa944de55-kube-api-access-24qxk\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:22.994465 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.994424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836a1e74-61a6-4f47-8133-2b6fa944de55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:22.994465 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.994463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qxk\" (UniqueName: \"kubernetes.io/projected/836a1e74-61a6-4f47-8133-2b6fa944de55-kube-api-access-24qxk\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:22.994819 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:22.994799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/836a1e74-61a6-4f47-8133-2b6fa944de55-tmp\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:23.002860 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:23.002831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qxk\" (UniqueName: \"kubernetes.io/projected/836a1e74-61a6-4f47-8133-2b6fa944de55-kube-api-access-24qxk\") pod \"openshift-lws-operator-fd8ccff4c-px74h\" (UID: \"836a1e74-61a6-4f47-8133-2b6fa944de55\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:23.149587 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:23.149504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"
Sep 12 00:48:23.421759 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:23.421737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h"]
Sep 12 00:48:23.424350 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:23.424329    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod836a1e74_61a6_4f47_8133_2b6fa944de55.slice/crio-639b6f1933722759ff9e7e7ee17f37adb246704511de762de28c67675f43f6b9 WatchSource:0}: Error finding container 639b6f1933722759ff9e7e7ee17f37adb246704511de762de28c67675f43f6b9: Status 404 returned error can't find the container with id 639b6f1933722759ff9e7e7ee17f37adb246704511de762de28c67675f43f6b9
Sep 12 00:48:24.054424 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:24.054387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h" event={"ID":"836a1e74-61a6-4f47-8133-2b6fa944de55","Type":"ContainerStarted","Data":"639b6f1933722759ff9e7e7ee17f37adb246704511de762de28c67675f43f6b9"}
Sep 12 00:48:25.060883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:25.060849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h" event={"ID":"836a1e74-61a6-4f47-8133-2b6fa944de55","Type":"ContainerStarted","Data":"6ddb32140276e3492490084509ac039cb5fd4ae0942b57c6db452973c8ae1f5f"}
Sep 12 00:48:25.078290 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:25.078226    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-px74h" podStartSLOduration=1.58152409 podStartE2EDuration="3.078211869s" totalImagesPullingTime="1.496687779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:25.076056634 +0000 UTC m=+327.988735571" watchObservedRunningTime="2026-09-12 00:48:25.078211869 +0000 UTC m=+327.990890806"
Sep 12 00:48:27.372872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.372836    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"]
Sep 12 00:48:27.376517 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.376502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.379009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.378972    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:48:27.379748 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.379727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:48:27.379870 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.379733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cp79k\""
Sep 12 00:48:27.386027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.386006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"]
Sep 12 00:48:27.435740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.435712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.435866 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.435784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvnjr\" (UniqueName: \"kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.435866 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.435813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.536401 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.536372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvnjr\" (UniqueName: \"kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.536513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.536418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.536513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.536460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.536835 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.536816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.536883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.536867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.545981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.545951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvnjr\" (UniqueName: \"kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.686683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.686658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:27.964334 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:27.964309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"]
Sep 12 00:48:27.966020 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:27.965996    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457a0d70_fee6_492d_b8d9_ff3496d1c1c2.slice/crio-45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb WatchSource:0}: Error finding container 45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb: Status 404 returned error can't find the container with id 45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb
Sep 12 00:48:28.075897 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:28.075868    2576 generic.go:356] "Generic (PLEG): container finished" podID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerID="ff59aba2527a96a5af83afb800ef1ff30dbf4d198564b69a50749c9009f2bf84" exitCode=0
Sep 12 00:48:28.076023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:28.075952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns" event={"ID":"457a0d70-fee6-492d-b8d9-ff3496d1c1c2","Type":"ContainerDied","Data":"ff59aba2527a96a5af83afb800ef1ff30dbf4d198564b69a50749c9009f2bf84"}
Sep 12 00:48:28.076023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:28.076005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns" event={"ID":"457a0d70-fee6-492d-b8d9-ff3496d1c1c2","Type":"ContainerStarted","Data":"45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb"}
Sep 12 00:48:29.082725 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:29.082691    2576 generic.go:356] "Generic (PLEG): container finished" podID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerID="63b57ab0407e0b86da22db456f2876180b307f0447e4d327dc043467f5e415ee" exitCode=0
Sep 12 00:48:29.083103 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:29.082768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns" event={"ID":"457a0d70-fee6-492d-b8d9-ff3496d1c1c2","Type":"ContainerDied","Data":"63b57ab0407e0b86da22db456f2876180b307f0447e4d327dc043467f5e415ee"}
Sep 12 00:48:30.089566 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:30.089534    2576 generic.go:356] "Generic (PLEG): container finished" podID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerID="e9911dcf1889968436a49920b370c32bfec2dc87c8012bf5c854875d7ad38d21" exitCode=0
Sep 12 00:48:30.089941 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:30.089614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns" event={"ID":"457a0d70-fee6-492d-b8d9-ff3496d1c1c2","Type":"ContainerDied","Data":"e9911dcf1889968436a49920b370c32bfec2dc87c8012bf5c854875d7ad38d21"}
Sep 12 00:48:31.238365 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.238331    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:31.368052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.367971    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvnjr\" (UniqueName: \"kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr\") pod \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") "
Sep 12 00:48:31.368052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.368029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util\") pod \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") "
Sep 12 00:48:31.368052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.368051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle\") pod \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\" (UID: \"457a0d70-fee6-492d-b8d9-ff3496d1c1c2\") "
Sep 12 00:48:31.368822 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.368765    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle" (OuterVolumeSpecName: "bundle") pod "457a0d70-fee6-492d-b8d9-ff3496d1c1c2" (UID: "457a0d70-fee6-492d-b8d9-ff3496d1c1c2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:31.370242 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.370215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr" (OuterVolumeSpecName: "kube-api-access-tvnjr") pod "457a0d70-fee6-492d-b8d9-ff3496d1c1c2" (UID: "457a0d70-fee6-492d-b8d9-ff3496d1c1c2"). InnerVolumeSpecName "kube-api-access-tvnjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:31.373267 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.373229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util" (OuterVolumeSpecName: "util") pod "457a0d70-fee6-492d-b8d9-ff3496d1c1c2" (UID: "457a0d70-fee6-492d-b8d9-ff3496d1c1c2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:31.468841 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.468805    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvnjr\" (UniqueName: \"kubernetes.io/projected/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-kube-api-access-tvnjr\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:31.468841 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.468835    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:31.468841 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:31.468844    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/457a0d70-fee6-492d-b8d9-ff3496d1c1c2-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:32.101162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:32.101127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns" event={"ID":"457a0d70-fee6-492d-b8d9-ff3496d1c1c2","Type":"ContainerDied","Data":"45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb"}
Sep 12 00:48:32.101162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:32.101170    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlhns"
Sep 12 00:48:32.101384 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:32.101193    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45f21f7a061a8da229a2c53b285587002dab9f7d003501a57dd86d5bb2c72aeb"
Sep 12 00:48:42.181760 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.181731    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"]
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182056    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="pull"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182066    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="pull"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182079    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="extract"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182084    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="extract"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182103    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="util"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182108    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="util"
Sep 12 00:48:42.182208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.182161    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="457a0d70-fee6-492d-b8d9-ff3496d1c1c2" containerName="extract"
Sep 12 00:48:42.185332 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.185313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.187847 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.187827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 12 00:48:42.188721 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.188706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dhlkx\""
Sep 12 00:48:42.188798 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.188784    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 12 00:48:42.189434 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.189416    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 12 00:48:42.197416 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.197397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"]
Sep 12 00:48:42.243820 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.243791    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"]
Sep 12 00:48:42.246854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.246832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.251090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.251069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cp79k\""
Sep 12 00:48:42.253833 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.253818    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:48:42.255011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.254991    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:48:42.256822 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.256799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3eb3776e-ead4-4848-b3c1-733c83d97b8c-manager-config\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.256912 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.256850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-metrics-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.256912 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.256902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.256998 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.256935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d262d\" (UniqueName: \"kubernetes.io/projected/3eb3776e-ead4-4848-b3c1-733c83d97b8c-kube-api-access-d262d\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.268133 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.268109    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"]
Sep 12 00:48:42.358337 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3eb3776e-ead4-4848-b3c1-733c83d97b8c-manager-config\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.358531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.358531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9vx8\" (UniqueName: \"kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.358531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-metrics-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.358531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.358752 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.358752 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.358572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d262d\" (UniqueName: \"kubernetes.io/projected/3eb3776e-ead4-4848-b3c1-733c83d97b8c-kube-api-access-d262d\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.359058 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.359034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3eb3776e-ead4-4848-b3c1-733c83d97b8c-manager-config\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.360962 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.360932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-metrics-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.361070 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.361053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eb3776e-ead4-4848-b3c1-733c83d97b8c-cert\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.377468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.377445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d262d\" (UniqueName: \"kubernetes.io/projected/3eb3776e-ead4-4848-b3c1-733c83d97b8c-kube-api-access-d262d\") pod \"lws-controller-manager-6ccd6666c9-w2knm\" (UID: \"3eb3776e-ead4-4848-b3c1-733c83d97b8c\") " pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.459520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.459453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.459520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.459487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9vx8\" (UniqueName: \"kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.459520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.459508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.459808 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.459789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.459848 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.459817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.479242 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.479212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9vx8\" (UniqueName: \"kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.494943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.494914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:42.543612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.543568    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"]
Sep 12 00:48:42.548053 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.548031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.552391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.551556    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 12 00:48:42.552391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.551647    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 12 00:48:42.552391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.551866    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 12 00:48:42.552391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.551910    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lr2d4\""
Sep 12 00:48:42.552391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.552313    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 12 00:48:42.558188 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.557987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:42.582198 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.582128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"]
Sep 12 00:48:42.661202 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.661169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-manifests\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.661202 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.661203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-tmp\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.661468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.661238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqh7\" (UniqueName: \"kubernetes.io/projected/3ca1bf9c-de02-48cd-8efe-73c348c878ae-kube-api-access-lqqh7\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.661468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.661354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.661468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.661379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.762886 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.762745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.763060 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.762911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-manifests\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.763060 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.762935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-tmp\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.763060 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.762992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqh7\" (UniqueName: \"kubernetes.io/projected/3ca1bf9c-de02-48cd-8efe-73c348c878ae-kube-api-access-lqqh7\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.763210 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.763071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.763408 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.763378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-manifests\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.765286 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.765243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ca1bf9c-de02-48cd-8efe-73c348c878ae-tmp\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.765612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.765590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.765689 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.765620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ca1bf9c-de02-48cd-8efe-73c348c878ae-webhook-cert\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.776549 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.776526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqh7\" (UniqueName: \"kubernetes.io/projected/3ca1bf9c-de02-48cd-8efe-73c348c878ae-kube-api-access-lqqh7\") pod \"opendatahub-operator-controller-manager-694bbb96f5-pmr49\" (UID: \"3ca1bf9c-de02-48cd-8efe-73c348c878ae\") " pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:42.791908 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.791885    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"]
Sep 12 00:48:42.794030 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:42.794005    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb3776e_ead4_4848_b3c1_733c83d97b8c.slice/crio-d4a58394e6b5289a0f18238e04ce739c63c15bca92dcca060dba1c9967c812de WatchSource:0}: Error finding container d4a58394e6b5289a0f18238e04ce739c63c15bca92dcca060dba1c9967c812de: Status 404 returned error can't find the container with id d4a58394e6b5289a0f18238e04ce739c63c15bca92dcca060dba1c9967c812de
Sep 12 00:48:42.843555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.843527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"]
Sep 12 00:48:42.845261 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:42.845239    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6fff5c_5906_4063_a659_44a822cfa447.slice/crio-13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c WatchSource:0}: Error finding container 13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c: Status 404 returned error can't find the container with id 13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c
Sep 12 00:48:42.866739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:42.866719    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:43.155225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:43.155168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"]
Sep 12 00:48:43.157382 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:43.157310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm" event={"ID":"3eb3776e-ead4-4848-b3c1-733c83d97b8c","Type":"ContainerStarted","Data":"d4a58394e6b5289a0f18238e04ce739c63c15bca92dcca060dba1c9967c812de"}
Sep 12 00:48:43.159001 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:48:43.158975    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca1bf9c_de02_48cd_8efe_73c348c878ae.slice/crio-337a1bb6ec4011e07f79ca90e8da02855067645a835f96e924ecfd5fe03725ac WatchSource:0}: Error finding container 337a1bb6ec4011e07f79ca90e8da02855067645a835f96e924ecfd5fe03725ac: Status 404 returned error can't find the container with id 337a1bb6ec4011e07f79ca90e8da02855067645a835f96e924ecfd5fe03725ac
Sep 12 00:48:43.159399 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:43.159370    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c6fff5c-5906-4063-a659-44a822cfa447" containerID="ad9c4215983f46e21a16e6516c830688bf87085a8e2f721c29cbca49d055cfae" exitCode=0
Sep 12 00:48:43.159523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:43.159412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf" event={"ID":"4c6fff5c-5906-4063-a659-44a822cfa447","Type":"ContainerDied","Data":"ad9c4215983f46e21a16e6516c830688bf87085a8e2f721c29cbca49d055cfae"}
Sep 12 00:48:43.159523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:43.159446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf" event={"ID":"4c6fff5c-5906-4063-a659-44a822cfa447","Type":"ContainerStarted","Data":"13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c"}
Sep 12 00:48:44.167511 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:44.167458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49" event={"ID":"3ca1bf9c-de02-48cd-8efe-73c348c878ae","Type":"ContainerStarted","Data":"337a1bb6ec4011e07f79ca90e8da02855067645a835f96e924ecfd5fe03725ac"}
Sep 12 00:48:44.170004 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:44.169973    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c6fff5c-5906-4063-a659-44a822cfa447" containerID="1fc797ac1fba820078ddea961cff57f42f495817a0de4a9ef0a88625698c8143" exitCode=0
Sep 12 00:48:44.170149 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:44.170042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf" event={"ID":"4c6fff5c-5906-4063-a659-44a822cfa447","Type":"ContainerDied","Data":"1fc797ac1fba820078ddea961cff57f42f495817a0de4a9ef0a88625698c8143"}
Sep 12 00:48:45.177547 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:45.177515    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c6fff5c-5906-4063-a659-44a822cfa447" containerID="1b531e06e76ec81997b221dfe812ca8c83c14650cd6b7a98fb2c5bff11e998ad" exitCode=0
Sep 12 00:48:45.177900 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:45.177596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf" event={"ID":"4c6fff5c-5906-4063-a659-44a822cfa447","Type":"ContainerDied","Data":"1b531e06e76ec81997b221dfe812ca8c83c14650cd6b7a98fb2c5bff11e998ad"}
Sep 12 00:48:46.318610 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.318583    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:46.403634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.403605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle\") pod \"4c6fff5c-5906-4063-a659-44a822cfa447\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") "
Sep 12 00:48:46.403818 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.403669    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9vx8\" (UniqueName: \"kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8\") pod \"4c6fff5c-5906-4063-a659-44a822cfa447\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") "
Sep 12 00:48:46.403818 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.403735    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util\") pod \"4c6fff5c-5906-4063-a659-44a822cfa447\" (UID: \"4c6fff5c-5906-4063-a659-44a822cfa447\") "
Sep 12 00:48:46.404564 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.404536    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle" (OuterVolumeSpecName: "bundle") pod "4c6fff5c-5906-4063-a659-44a822cfa447" (UID: "4c6fff5c-5906-4063-a659-44a822cfa447"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:46.406139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.406113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8" (OuterVolumeSpecName: "kube-api-access-s9vx8") pod "4c6fff5c-5906-4063-a659-44a822cfa447" (UID: "4c6fff5c-5906-4063-a659-44a822cfa447"). InnerVolumeSpecName "kube-api-access-s9vx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:48:46.409783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.409744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util" (OuterVolumeSpecName: "util") pod "4c6fff5c-5906-4063-a659-44a822cfa447" (UID: "4c6fff5c-5906-4063-a659-44a822cfa447"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:48:46.505359 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.505265    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:46.505359 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.505311    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c6fff5c-5906-4063-a659-44a822cfa447-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:46.505359 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:46.505322    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9vx8\" (UniqueName: \"kubernetes.io/projected/4c6fff5c-5906-4063-a659-44a822cfa447-kube-api-access-s9vx8\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:48:47.188327 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:47.188233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49" event={"ID":"3ca1bf9c-de02-48cd-8efe-73c348c878ae","Type":"ContainerStarted","Data":"83b23ea10c03109c7c829e47d7cb64127489cdd3bc59b64038c41fbe85c95f1a"}
Sep 12 00:48:47.190301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:47.190265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf"
Sep 12 00:48:47.190419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:47.190267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b07xtcf" event={"ID":"4c6fff5c-5906-4063-a659-44a822cfa447","Type":"ContainerDied","Data":"13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c"}
Sep 12 00:48:47.190419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:47.190406    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13753f8dfc2eddf8653bc670634c09ebf97598740ed655f25339e3d8beedad2c"
Sep 12 00:48:47.598872 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:48:47.598844    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca1bf9c_de02_48cd_8efe_73c348c878ae.slice/crio-83b23ea10c03109c7c829e47d7cb64127489cdd3bc59b64038c41fbe85c95f1a.scope\": RecentStats: unable to find data in memory cache]"
Sep 12 00:48:48.196610 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:48.196569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm" event={"ID":"3eb3776e-ead4-4848-b3c1-733c83d97b8c","Type":"ContainerStarted","Data":"1f186da8e811d0e6dc615f18801a398bd21a5b5b78cc23669f7386f9583af96b"}
Sep 12 00:48:48.196791 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:48.196676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:48:48.198265 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:48.198241    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ca1bf9c-de02-48cd-8efe-73c348c878ae" containerID="83b23ea10c03109c7c829e47d7cb64127489cdd3bc59b64038c41fbe85c95f1a" exitCode=0
Sep 12 00:48:48.198462 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:48.198332    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49" event={"ID":"3ca1bf9c-de02-48cd-8efe-73c348c878ae","Type":"ContainerDied","Data":"83b23ea10c03109c7c829e47d7cb64127489cdd3bc59b64038c41fbe85c95f1a"}
Sep 12 00:48:48.215860 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:48.215814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm" podStartSLOduration=1.828194152 podStartE2EDuration="6.215799765s" totalImagesPullingTime="4.387605613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:48.214679808 +0000 UTC m=+351.127358770" watchObservedRunningTime="2026-09-12 00:48:48.215799765 +0000 UTC m=+351.128478702"
Sep 12 00:48:49.204856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:49.204820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49" event={"ID":"3ca1bf9c-de02-48cd-8efe-73c348c878ae","Type":"ContainerStarted","Data":"bdc374d44469187f9000b269f825a61cf1d70005ad8b0526c33f6ad64606d789"}
Sep 12 00:48:49.205306 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:49.205042    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:48:49.232678 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:49.232625    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49" podStartSLOduration=2.5636515490000003 podStartE2EDuration="7.23260936s" totalImagesPullingTime="3.398249333s" totalInitContainerRuntime="1.270708478s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:48:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:48:49.229241519 +0000 UTC m=+352.141920457" watchObservedRunningTime="2026-09-12 00:48:49.23260936 +0000 UTC m=+352.145288298"
Sep 12 00:48:59.206854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:48:59.206818    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ccd6666c9-w2knm"
Sep 12 00:49:00.211170 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:00.211138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-694bbb96f5-pmr49"
Sep 12 00:49:09.298632 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.298594    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"]
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.298956    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="pull"
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.298966    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="pull"
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.298989    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="util"
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.298994    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="util"
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.299000    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="extract"
Sep 12 00:49:09.299009 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.299006    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="extract"
Sep 12 00:49:09.299242 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.299083    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6fff5c-5906-4063-a659-44a822cfa447" containerName="extract"
Sep 12 00:49:09.308496 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.308471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.310916 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.310894    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 12 00:49:09.311099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.311081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p5n7s\""
Sep 12 00:49:09.318235 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.318217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"]
Sep 12 00:49:09.395919 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.395885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.395919 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.395919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.395939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.395962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.395988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knxg\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-kube-api-access-2knxg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.396027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.396066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.396092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.396348 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.396139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497461 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497461 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knxg\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-kube-api-access-2knxg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497461 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497602 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497602 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497602 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497756 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.497853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.497833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.498146 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.498125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.498526 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.498504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.499458 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.499432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.499757 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.499740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.510389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.510365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.510467 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.510426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knxg\" (UniqueName: \"kubernetes.io/projected/fb08478b-c8b0-4b33-8ec7-472cd6a59dbe-kube-api-access-2knxg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq\" (UID: \"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.620942 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.620867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:09.904196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:09.904171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"]
Sep 12 00:49:09.907042 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:49:09.907010    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb08478b_c8b0_4b33_8ec7_472cd6a59dbe.slice/crio-a76176d322b55795515d75aeef7a9f3081f8929dd2203b2d76d6103beb13c93d WatchSource:0}: Error finding container a76176d322b55795515d75aeef7a9f3081f8929dd2203b2d76d6103beb13c93d: Status 404 returned error can't find the container with id a76176d322b55795515d75aeef7a9f3081f8929dd2203b2d76d6103beb13c93d
Sep 12 00:49:10.309249 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:10.309170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq" event={"ID":"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe","Type":"ContainerStarted","Data":"a76176d322b55795515d75aeef7a9f3081f8929dd2203b2d76d6103beb13c93d"}
Sep 12 00:49:12.788381 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.788342    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-82bz4"]
Sep 12 00:49:12.793263 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.793241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:12.796027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.796009    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tc8l7\""
Sep 12 00:49:12.796603 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.796589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 12 00:49:12.802160 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.802136    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-82bz4"]
Sep 12 00:49:12.832571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.832548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4fjw\" (UniqueName: \"kubernetes.io/projected/5a8578c2-ce1d-439c-974e-a0e8d4af677d-kube-api-access-w4fjw\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:12.832684 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.832605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:12.933624 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.933595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:12.933784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.933661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4fjw\" (UniqueName: \"kubernetes.io/projected/5a8578c2-ce1d-439c-974e-a0e8d4af677d-kube-api-access-w4fjw\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:12.933784 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:49:12.933761    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 12 00:49:12.933901 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:49:12.933836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert podName:5a8578c2-ce1d-439c-974e-a0e8d4af677d nodeName:}" failed. No retries permitted until 2026-09-12 00:49:13.433814364 +0000 UTC m=+376.346493296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert") pod "odh-model-controller-7998c67dc4-82bz4" (UID: "5a8578c2-ce1d-439c-974e-a0e8d4af677d") : secret "odh-model-controller-webhook-cert" not found
Sep 12 00:49:12.946208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:12.946179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4fjw\" (UniqueName: \"kubernetes.io/projected/5a8578c2-ce1d-439c-974e-a0e8d4af677d-kube-api-access-w4fjw\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:13.437095 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.437060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:13.440066 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.440031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a8578c2-ce1d-439c-974e-a0e8d4af677d-cert\") pod \"odh-model-controller-7998c67dc4-82bz4\" (UID: \"5a8578c2-ce1d-439c-974e-a0e8d4af677d\") " pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:13.478066 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.478036    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zsf74"]
Sep 12 00:49:13.481449 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.481432    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.484800 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.484782    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 12 00:49:13.493780 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.493758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zsf74"]
Sep 12 00:49:13.538475 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.538443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhpwq\" (UniqueName: \"kubernetes.io/projected/bcf4d0a8-cc1a-4542-b2db-263c681a0745-kube-api-access-qhpwq\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.538594 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.538503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.639531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.639499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhpwq\" (UniqueName: \"kubernetes.io/projected/bcf4d0a8-cc1a-4542-b2db-263c681a0745-kube-api-access-qhpwq\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.639669 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.639594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.640267 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:49:13.639759    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 12 00:49:13.640267 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:49:13.639914    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs podName:bcf4d0a8-cc1a-4542-b2db-263c681a0745 nodeName:}" failed. No retries permitted until 2026-09-12 00:49:14.139874862 +0000 UTC m=+377.052553777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs") pod "model-serving-api-54d89bd5fc-zsf74" (UID: "bcf4d0a8-cc1a-4542-b2db-263c681a0745") : secret "model-serving-api-tls" not found
Sep 12 00:49:13.655179 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.655131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhpwq\" (UniqueName: \"kubernetes.io/projected/bcf4d0a8-cc1a-4542-b2db-263c681a0745-kube-api-access-qhpwq\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:13.704579 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.704488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:13.988182 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:13.988158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-82bz4"]
Sep 12 00:49:13.990214 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:49:13.990189    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8578c2_ce1d_439c_974e_a0e8d4af677d.slice/crio-9417ce7178e86850d093e47b97c8fa6131de8489782b618ddc8ba5b8fb948cfe WatchSource:0}: Error finding container 9417ce7178e86850d093e47b97c8fa6131de8489782b618ddc8ba5b8fb948cfe: Status 404 returned error can't find the container with id 9417ce7178e86850d093e47b97c8fa6131de8489782b618ddc8ba5b8fb948cfe
Sep 12 00:49:14.145344 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:14.145300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:14.147817 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:14.147790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf4d0a8-cc1a-4542-b2db-263c681a0745-tls-certs\") pod \"model-serving-api-54d89bd5fc-zsf74\" (UID: \"bcf4d0a8-cc1a-4542-b2db-263c681a0745\") " pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:14.329801 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:14.329721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4" event={"ID":"5a8578c2-ce1d-439c-974e-a0e8d4af677d","Type":"ContainerStarted","Data":"9417ce7178e86850d093e47b97c8fa6131de8489782b618ddc8ba5b8fb948cfe"}
Sep 12 00:49:14.392666 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:14.392639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:14.672303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:14.672232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zsf74"]
Sep 12 00:49:15.339708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:15.339666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74" event={"ID":"bcf4d0a8-cc1a-4542-b2db-263c681a0745","Type":"ContainerStarted","Data":"ff4236d11b1ff3d721ee54b012399f3c5a58b7b5388cf8c9117801a0f9956014"}
Sep 12 00:49:18.358601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.358502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74" event={"ID":"bcf4d0a8-cc1a-4542-b2db-263c681a0745","Type":"ContainerStarted","Data":"0085cdb66af1e6df754710e57aa725282688c71e18bceaa0dbd1d67a1dabd581"}
Sep 12 00:49:18.358601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.358569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:18.360067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.360043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4" event={"ID":"5a8578c2-ce1d-439c-974e-a0e8d4af677d","Type":"ContainerStarted","Data":"07bed6dbce855220d6167a76cf70cac7ca2bed05894d514cb1ecc29909501e8f"}
Sep 12 00:49:18.360195 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.360169    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:18.376699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.376651    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74" podStartSLOduration=2.099442489 podStartE2EDuration="5.376636741s" totalImagesPullingTime="3.277194252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:18.374515316 +0000 UTC m=+381.287194283" watchObservedRunningTime="2026-09-12 00:49:18.376636741 +0000 UTC m=+381.289315678"
Sep 12 00:49:18.393595 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:18.393541    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4" podStartSLOduration=2.666856942 podStartE2EDuration="6.393524027s" totalImagesPullingTime="3.726667085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:18.391877483 +0000 UTC m=+381.304556423" watchObservedRunningTime="2026-09-12 00:49:18.393524027 +0000 UTC m=+381.306202967"
Sep 12 00:49:21.026987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.026947    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:49:21.027317 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.027023    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:49:21.027317 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.027059    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:49:21.379668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.379573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq" event={"ID":"fb08478b-c8b0-4b33-8ec7-472cd6a59dbe","Type":"ContainerStarted","Data":"4c78a6c2e4f59d7529ad2b27c3244fbf5e0d3ebe0632b64eea41451173bd254c"}
Sep 12 00:49:21.406641 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.406593    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq" podStartSLOduration=1.289253602 podStartE2EDuration="12.406576453s" totalImagesPullingTime="11.117322851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:21.405888519 +0000 UTC m=+384.318567467" watchObservedRunningTime="2026-09-12 00:49:21.406576453 +0000 UTC m=+384.319255477"
Sep 12 00:49:21.621377 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:21.621342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:22.625990 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.625961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:22.677995 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.677960    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"]
Sep 12 00:49:22.681636 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.681612    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.684957 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.684935    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gpnjh\""
Sep 12 00:49:22.685832 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.685811    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 12 00:49:22.718568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.718539    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"]
Sep 12 00:49:22.732815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.732771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b95b9711-95af-40d4-be92-df8cc1359ce6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.732981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.732835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzzc9\" (UniqueName: \"kubernetes.io/projected/b95b9711-95af-40d4-be92-df8cc1359ce6-kube-api-access-dzzc9\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.833910 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.833882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b95b9711-95af-40d4-be92-df8cc1359ce6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.834112 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.833935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzzc9\" (UniqueName: \"kubernetes.io/projected/b95b9711-95af-40d4-be92-df8cc1359ce6-kube-api-access-dzzc9\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.837583 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.837553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b95b9711-95af-40d4-be92-df8cc1359ce6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.852519 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.852496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzzc9\" (UniqueName: \"kubernetes.io/projected/b95b9711-95af-40d4-be92-df8cc1359ce6-kube-api-access-dzzc9\") pod \"llmisvc-controller-manager-777c6bd7d5-s7s9p\" (UID: \"b95b9711-95af-40d4-be92-df8cc1359ce6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:22.992462 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:22.992426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:23.276389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:23.276366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"]
Sep 12 00:49:23.277706 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:49:23.277681    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb95b9711_95af_40d4_be92_df8cc1359ce6.slice/crio-b99b9e0eaa676b9210a1fb73a26f44015b4a88288d32749b2577f557c77c2026 WatchSource:0}: Error finding container b99b9e0eaa676b9210a1fb73a26f44015b4a88288d32749b2577f557c77c2026: Status 404 returned error can't find the container with id b99b9e0eaa676b9210a1fb73a26f44015b4a88288d32749b2577f557c77c2026
Sep 12 00:49:23.397611 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:23.397579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p" event={"ID":"b95b9711-95af-40d4-be92-df8cc1359ce6","Type":"ContainerStarted","Data":"b99b9e0eaa676b9210a1fb73a26f44015b4a88288d32749b2577f557c77c2026"}
Sep 12 00:49:23.397799 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:23.397776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:23.398644 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:23.398630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq"
Sep 12 00:49:26.415714 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:26.415679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p" event={"ID":"b95b9711-95af-40d4-be92-df8cc1359ce6","Type":"ContainerStarted","Data":"a743c67ecfc764f326e691e0de9c26a63bbb639940bcaf3eb4b89d588e31ff2a"}
Sep 12 00:49:26.416100 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:26.415790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:49:26.433652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:26.433601    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p" podStartSLOduration=1.8539374020000001 podStartE2EDuration="4.433583849s" totalImagesPullingTime="2.579646447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:49:26.4333472 +0000 UTC m=+389.346026140" watchObservedRunningTime="2026-09-12 00:49:26.433583849 +0000 UTC m=+389.346262788"
Sep 12 00:49:29.369437 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:29.369407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-82bz4"
Sep 12 00:49:29.371224 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:29.371207    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zsf74"
Sep 12 00:49:57.422474 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:49:57.422445    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7s9p"
Sep 12 00:50:18.004565 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.004521    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"]
Sep 12 00:50:18.021646 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.021616    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"]
Sep 12 00:50:18.021815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.021727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.024252 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.024230    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 00:50:18.025058 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.025034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cp79k\""
Sep 12 00:50:18.025173 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.025118    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 00:50:18.097492 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.097456    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"]
Sep 12 00:50:18.101175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.101159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.110088 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.110063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"]
Sep 12 00:50:18.131862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.131837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.131965 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.131882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.131965 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.131901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxs6s\" (UniqueName: \"kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.215137 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.215098    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"]
Sep 12 00:50:18.218918 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.218900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.228208 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.228183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"]
Sep 12 00:50:18.233425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.233551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxs6s\" (UniqueName: \"kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.233551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.233551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.233551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzg2g\" (UniqueName: \"kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.233778 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.233878 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.233928 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.233861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.242200 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.242174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxs6s\" (UniqueName: \"kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.301805 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.301743    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"]
Sep 12 00:50:18.305531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.305516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.315174 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.315151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"]
Sep 12 00:50:18.331409 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.331385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzg2g\" (UniqueName: \"kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.334692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6rfm\" (UniqueName: \"kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.334976 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.334976 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.334798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.344142 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.344115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzg2g\" (UniqueName: \"kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.411061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.411021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:18.435824 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.435784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.435960 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.435836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.435960 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.435893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.436072 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.436001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.436072 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.436030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhwc\" (UniqueName: \"kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.436072 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.436063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6rfm\" (UniqueName: \"kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.436326 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.436271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.436409 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.436388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.444918 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.444896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6rfm\" (UniqueName: \"kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.529652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.529618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:18.537087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.537065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhwc\" (UniqueName: \"kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.537167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.537108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.537167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.537144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.537464 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.537445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.537574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.537551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.546172 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.546151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhwc\" (UniqueName: \"kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.609687 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.609656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"]
Sep 12 00:50:18.610455 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:18.610433    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29affaaa_6b66_4647_86ef_f34cc7bf653e.slice/crio-9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b WatchSource:0}: Error finding container 9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b: Status 404 returned error can't find the container with id 9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b
Sep 12 00:50:18.616374 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.616350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:18.677882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.677824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp" event={"ID":"29affaaa-6b66-4647-86ef-f34cc7bf653e","Type":"ContainerStarted","Data":"9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b"}
Sep 12 00:50:18.696509 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.696397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"]
Sep 12 00:50:18.697822 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:18.697791    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13781e05_c7b6_4ccd_82d2_4301c49560d7.slice/crio-badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2 WatchSource:0}: Error finding container badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2: Status 404 returned error can't find the container with id badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2
Sep 12 00:50:18.800529 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.800499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"]
Sep 12 00:50:18.801645 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:18.801622    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49bbfb22_4e85_426c_bb5c_f7ecebf47a53.slice/crio-c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc WatchSource:0}: Error finding container c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc: Status 404 returned error can't find the container with id c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc
Sep 12 00:50:18.896328 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:18.896301    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"]
Sep 12 00:50:18.951227 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:18.951195    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc712d9_c586_42be_a6ae_fc8bf84fc319.slice/crio-12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d WatchSource:0}: Error finding container 12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d: Status 404 returned error can't find the container with id 12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d
Sep 12 00:50:19.684899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.684867    2576 generic.go:356] "Generic (PLEG): container finished" podID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerID="994fc4cad00f8a541f0d499ad73e0f56e897fb183bf2e4ab67adcaeb57df1afe" exitCode=0
Sep 12 00:50:19.685331 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.684953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk" event={"ID":"49bbfb22-4e85-426c-bb5c-f7ecebf47a53","Type":"ContainerDied","Data":"994fc4cad00f8a541f0d499ad73e0f56e897fb183bf2e4ab67adcaeb57df1afe"}
Sep 12 00:50:19.685331 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.685005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk" event={"ID":"49bbfb22-4e85-426c-bb5c-f7ecebf47a53","Type":"ContainerStarted","Data":"c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc"}
Sep 12 00:50:19.686746 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.686728    2576 generic.go:356] "Generic (PLEG): container finished" podID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerID="7ab450a14afcfc88d385fbf709bd0a79d6f3ac58e5b387a88da8983493ac40b0" exitCode=0
Sep 12 00:50:19.686875 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.686858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp" event={"ID":"13781e05-c7b6-4ccd-82d2-4301c49560d7","Type":"ContainerDied","Data":"7ab450a14afcfc88d385fbf709bd0a79d6f3ac58e5b387a88da8983493ac40b0"}
Sep 12 00:50:19.686946 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.686901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp" event={"ID":"13781e05-c7b6-4ccd-82d2-4301c49560d7","Type":"ContainerStarted","Data":"badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2"}
Sep 12 00:50:19.688554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.688493    2576 generic.go:356] "Generic (PLEG): container finished" podID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerID="21afa4c395bd174b96d955cda32c0065c43dde5c69f43308bfb77355f6656cab" exitCode=0
Sep 12 00:50:19.688554 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.688533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp" event={"ID":"29affaaa-6b66-4647-86ef-f34cc7bf653e","Type":"ContainerDied","Data":"21afa4c395bd174b96d955cda32c0065c43dde5c69f43308bfb77355f6656cab"}
Sep 12 00:50:19.690390 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.690372    2576 generic.go:356] "Generic (PLEG): container finished" podID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerID="dc7f70496c123692071fa097651e346e6d5f0811b079b17e7580ed52854993d0" exitCode=0
Sep 12 00:50:19.690491 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.690397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n" event={"ID":"5dc712d9-c586-42be-a6ae-fc8bf84fc319","Type":"ContainerDied","Data":"dc7f70496c123692071fa097651e346e6d5f0811b079b17e7580ed52854993d0"}
Sep 12 00:50:19.690491 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:19.690424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n" event={"ID":"5dc712d9-c586-42be-a6ae-fc8bf84fc319","Type":"ContainerStarted","Data":"12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d"}
Sep 12 00:50:20.697616 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:20.697590    2576 generic.go:356] "Generic (PLEG): container finished" podID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerID="b42d62921a50fc4756e7e456bf9741e2fec00a2b2a54f77a2663c46b979e85be" exitCode=0
Sep 12 00:50:20.698013 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:20.697681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n" event={"ID":"5dc712d9-c586-42be-a6ae-fc8bf84fc319","Type":"ContainerDied","Data":"b42d62921a50fc4756e7e456bf9741e2fec00a2b2a54f77a2663c46b979e85be"}
Sep 12 00:50:20.699682 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:20.699660    2576 generic.go:356] "Generic (PLEG): container finished" podID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerID="d931efcc6806c34696107d95c3e191ecf3446f6ac1cec784b10034b7cef412dc" exitCode=0
Sep 12 00:50:20.699781 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:20.699717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk" event={"ID":"49bbfb22-4e85-426c-bb5c-f7ecebf47a53","Type":"ContainerDied","Data":"d931efcc6806c34696107d95c3e191ecf3446f6ac1cec784b10034b7cef412dc"}
Sep 12 00:50:21.707540 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.707505    2576 generic.go:356] "Generic (PLEG): container finished" podID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerID="d2e273555c7abd713259c3003da000151b19889b13da8eb32a38416d3a7c9d55" exitCode=0
Sep 12 00:50:21.707941 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.707591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk" event={"ID":"49bbfb22-4e85-426c-bb5c-f7ecebf47a53","Type":"ContainerDied","Data":"d2e273555c7abd713259c3003da000151b19889b13da8eb32a38416d3a7c9d55"}
Sep 12 00:50:21.709430 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.709410    2576 generic.go:356] "Generic (PLEG): container finished" podID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerID="b8a3fdb6eeafae9952401968f6161013b689cca53616d0b31ddbade5e08d41e7" exitCode=0
Sep 12 00:50:21.709519 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.709493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp" event={"ID":"13781e05-c7b6-4ccd-82d2-4301c49560d7","Type":"ContainerDied","Data":"b8a3fdb6eeafae9952401968f6161013b689cca53616d0b31ddbade5e08d41e7"}
Sep 12 00:50:21.711562 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.711543    2576 generic.go:356] "Generic (PLEG): container finished" podID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerID="722fc16f64530b0ece421a2d3e86f09ab31f0549acdf2d170bf09fe2fd99642e" exitCode=0
Sep 12 00:50:21.711665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.711606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp" event={"ID":"29affaaa-6b66-4647-86ef-f34cc7bf653e","Type":"ContainerDied","Data":"722fc16f64530b0ece421a2d3e86f09ab31f0549acdf2d170bf09fe2fd99642e"}
Sep 12 00:50:21.713933 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.713914    2576 generic.go:356] "Generic (PLEG): container finished" podID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerID="b1b5b80881bf143349183a8bc8e744aa9aaad28271e85e22009d4ef31cb50a81" exitCode=0
Sep 12 00:50:21.714015 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:21.713950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n" event={"ID":"5dc712d9-c586-42be-a6ae-fc8bf84fc319","Type":"ContainerDied","Data":"b1b5b80881bf143349183a8bc8e744aa9aaad28271e85e22009d4ef31cb50a81"}
Sep 12 00:50:22.721783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.721752    2576 generic.go:356] "Generic (PLEG): container finished" podID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerID="ba9a93a98d48e9ee2e3049734e57a42bd6227cd7812ac2536040df2e3c57c83e" exitCode=0
Sep 12 00:50:22.722187 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.721842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp" event={"ID":"13781e05-c7b6-4ccd-82d2-4301c49560d7","Type":"ContainerDied","Data":"ba9a93a98d48e9ee2e3049734e57a42bd6227cd7812ac2536040df2e3c57c83e"}
Sep 12 00:50:22.724000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.723976    2576 generic.go:356] "Generic (PLEG): container finished" podID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerID="b5d904ccce526a1568e539e97c5ee0aa6c7beae205221be8103c8b000cde6bb5" exitCode=0
Sep 12 00:50:22.724106 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.724031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp" event={"ID":"29affaaa-6b66-4647-86ef-f34cc7bf653e","Type":"ContainerDied","Data":"b5d904ccce526a1568e539e97c5ee0aa6c7beae205221be8103c8b000cde6bb5"}
Sep 12 00:50:22.863451 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.863424    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:22.892825 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.892802    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:22.978266 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhwc\" (UniqueName: \"kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc\") pod \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") "
Sep 12 00:50:22.978266 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978246    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle\") pod \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") "
Sep 12 00:50:22.978504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle\") pod \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") "
Sep 12 00:50:22.978504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6rfm\" (UniqueName: \"kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm\") pod \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") "
Sep 12 00:50:22.978504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util\") pod \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\" (UID: \"49bbfb22-4e85-426c-bb5c-f7ecebf47a53\") "
Sep 12 00:50:22.978504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978409    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util\") pod \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\" (UID: \"5dc712d9-c586-42be-a6ae-fc8bf84fc319\") "
Sep 12 00:50:22.978877 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978825    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle" (OuterVolumeSpecName: "bundle") pod "5dc712d9-c586-42be-a6ae-fc8bf84fc319" (UID: "5dc712d9-c586-42be-a6ae-fc8bf84fc319"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:22.978877 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.978854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle" (OuterVolumeSpecName: "bundle") pod "49bbfb22-4e85-426c-bb5c-f7ecebf47a53" (UID: "49bbfb22-4e85-426c-bb5c-f7ecebf47a53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:22.980931 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.980902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm" (OuterVolumeSpecName: "kube-api-access-k6rfm") pod "49bbfb22-4e85-426c-bb5c-f7ecebf47a53" (UID: "49bbfb22-4e85-426c-bb5c-f7ecebf47a53"). InnerVolumeSpecName "kube-api-access-k6rfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:50:22.981058 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.980958    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc" (OuterVolumeSpecName: "kube-api-access-rfhwc") pod "5dc712d9-c586-42be-a6ae-fc8bf84fc319" (UID: "5dc712d9-c586-42be-a6ae-fc8bf84fc319"). InnerVolumeSpecName "kube-api-access-rfhwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:50:22.984214 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.984188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util" (OuterVolumeSpecName: "util") pod "5dc712d9-c586-42be-a6ae-fc8bf84fc319" (UID: "5dc712d9-c586-42be-a6ae-fc8bf84fc319"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:22.984736 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:22.984713    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util" (OuterVolumeSpecName: "util") pod "49bbfb22-4e85-426c-bb5c-f7ecebf47a53" (UID: "49bbfb22-4e85-426c-bb5c-f7ecebf47a53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:23.079357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079315    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6rfm\" (UniqueName: \"kubernetes.io/projected/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-kube-api-access-k6rfm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.079357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079353    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.079357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079365    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.079357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079373    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhwc\" (UniqueName: \"kubernetes.io/projected/5dc712d9-c586-42be-a6ae-fc8bf84fc319-kube-api-access-rfhwc\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.079582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079382    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49bbfb22-4e85-426c-bb5c-f7ecebf47a53-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.079582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.079390    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5dc712d9-c586-42be-a6ae-fc8bf84fc319-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:23.731850 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.731819    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n"
Sep 12 00:50:23.732295 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.731813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65pg6n" event={"ID":"5dc712d9-c586-42be-a6ae-fc8bf84fc319","Type":"ContainerDied","Data":"12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d"}
Sep 12 00:50:23.732295 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.731947    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12bf82a64b572c251b5fcda1fb62342e59e89f6f3201a7d0ed73cb7d5bd55b8d"
Sep 12 00:50:23.734021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.733988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk" event={"ID":"49bbfb22-4e85-426c-bb5c-f7ecebf47a53","Type":"ContainerDied","Data":"c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc"}
Sep 12 00:50:23.734135 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.734047    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c26f0f4a54933fd045d051c0e3d33ba053124159130b6bfa8f496456d740aabc"
Sep 12 00:50:23.734135 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.733997    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7t85pk"
Sep 12 00:50:23.892006 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.891975    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:23.893902 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.893887    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:23.986608 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzg2g\" (UniqueName: \"kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g\") pod \"13781e05-c7b6-4ccd-82d2-4301c49560d7\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") "
Sep 12 00:50:23.986790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle\") pod \"29affaaa-6b66-4647-86ef-f34cc7bf653e\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") "
Sep 12 00:50:23.986790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util\") pod \"13781e05-c7b6-4ccd-82d2-4301c49560d7\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") "
Sep 12 00:50:23.986901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle\") pod \"13781e05-c7b6-4ccd-82d2-4301c49560d7\" (UID: \"13781e05-c7b6-4ccd-82d2-4301c49560d7\") "
Sep 12 00:50:23.986901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util\") pod \"29affaaa-6b66-4647-86ef-f34cc7bf653e\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") "
Sep 12 00:50:23.987000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.986906    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxs6s\" (UniqueName: \"kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s\") pod \"29affaaa-6b66-4647-86ef-f34cc7bf653e\" (UID: \"29affaaa-6b66-4647-86ef-f34cc7bf653e\") "
Sep 12 00:50:23.987346 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.987305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle" (OuterVolumeSpecName: "bundle") pod "29affaaa-6b66-4647-86ef-f34cc7bf653e" (UID: "29affaaa-6b66-4647-86ef-f34cc7bf653e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:23.987779 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.987650    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle" (OuterVolumeSpecName: "bundle") pod "13781e05-c7b6-4ccd-82d2-4301c49560d7" (UID: "13781e05-c7b6-4ccd-82d2-4301c49560d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:23.989013 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.988986    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g" (OuterVolumeSpecName: "kube-api-access-wzg2g") pod "13781e05-c7b6-4ccd-82d2-4301c49560d7" (UID: "13781e05-c7b6-4ccd-82d2-4301c49560d7"). InnerVolumeSpecName "kube-api-access-wzg2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:50:23.989187 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.989162    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s" (OuterVolumeSpecName: "kube-api-access-pxs6s") pod "29affaaa-6b66-4647-86ef-f34cc7bf653e" (UID: "29affaaa-6b66-4647-86ef-f34cc7bf653e"). InnerVolumeSpecName "kube-api-access-pxs6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:50:23.992564 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.992524    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util" (OuterVolumeSpecName: "util") pod "13781e05-c7b6-4ccd-82d2-4301c49560d7" (UID: "13781e05-c7b6-4ccd-82d2-4301c49560d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:23.993073 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:23.993051    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util" (OuterVolumeSpecName: "util") pod "29affaaa-6b66-4647-86ef-f34cc7bf653e" (UID: "29affaaa-6b66-4647-86ef-f34cc7bf653e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:50:24.088657 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088624    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.088657 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088650    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxs6s\" (UniqueName: \"kubernetes.io/projected/29affaaa-6b66-4647-86ef-f34cc7bf653e-kube-api-access-pxs6s\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.088657 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088661    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzg2g\" (UniqueName: \"kubernetes.io/projected/13781e05-c7b6-4ccd-82d2-4301c49560d7-kube-api-access-wzg2g\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.088851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088670    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29affaaa-6b66-4647-86ef-f34cc7bf653e-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.088851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088679    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-util\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.088851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.088687    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13781e05-c7b6-4ccd-82d2-4301c49560d7-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:24.741558 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.741530    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp"
Sep 12 00:50:24.742026 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.741566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a95jzp" event={"ID":"13781e05-c7b6-4ccd-82d2-4301c49560d7","Type":"ContainerDied","Data":"badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2"}
Sep 12 00:50:24.742026 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.741636    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="badf0e1c192018bf1e929c49059b3db2a55df85a27afb29085846262139c65e2"
Sep 12 00:50:24.743737 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.743718    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp"
Sep 12 00:50:24.743844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.743739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckk7tp" event={"ID":"29affaaa-6b66-4647-86ef-f34cc7bf653e","Type":"ContainerDied","Data":"9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b"}
Sep 12 00:50:24.743844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:24.743774    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e8dc1320a0eca183bc99fc8b573041ca966ee0ba875b94b59cddb368cd82d4b"
Sep 12 00:50:33.916609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916581    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f4b47cfd-dtstj"]
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916956    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916969    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916982    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916988    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.916995    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="pull"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917000    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="pull"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917014    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917019    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917028    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="extract"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917033    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="extract"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917038    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="extract"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917044    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="extract"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917058    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="util"
Sep 12 00:50:33.917057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917064    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="util"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917070    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917075    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917081    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917086    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917093    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917097    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917104    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917109    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="pull"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917120    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917127    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917182    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29affaaa-6b66-4647-86ef-f34cc7bf653e" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917190    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dc712d9-c586-42be-a6ae-fc8bf84fc319" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917195    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="49bbfb22-4e85-426c-bb5c-f7ecebf47a53" containerName="extract"
Sep 12 00:50:33.917488 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.917200    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="13781e05-c7b6-4ccd-82d2-4301c49560d7" containerName="extract"
Sep 12 00:50:33.921739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.921723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:33.934477 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:33.934455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f4b47cfd-dtstj"]
Sep 12 00:50:34.080061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-service-ca\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-oauth-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-trusted-ca-bundle\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-oauth-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd2ll\" (UniqueName: \"kubernetes.io/projected/aaae82eb-e450-4f68-acbc-acb88f006ba2-kube-api-access-pd2ll\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.080456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.080328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-oauth-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-trusted-ca-bundle\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-oauth-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd2ll\" (UniqueName: \"kubernetes.io/projected/aaae82eb-e450-4f68-acbc-acb88f006ba2-kube-api-access-pd2ll\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-service-ca\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.181930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.183576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-oauth-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.184356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-trusted-ca-bundle\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.185441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.186339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.186340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaae82eb-e450-4f68-acbc-acb88f006ba2-service-ca\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.189084 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.189058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-serving-cert\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.190341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.190322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaae82eb-e450-4f68-acbc-acb88f006ba2-console-oauth-config\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.195925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.195905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd2ll\" (UniqueName: \"kubernetes.io/projected/aaae82eb-e450-4f68-acbc-acb88f006ba2-kube-api-access-pd2ll\") pod \"console-57f4b47cfd-dtstj\" (UID: \"aaae82eb-e450-4f68-acbc-acb88f006ba2\") " pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.231495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.231469    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:34.447894 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.447803    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"]
Sep 12 00:50:34.452535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.452511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:34.457434 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.457412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bjnbp\""
Sep 12 00:50:34.457780 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.457761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 12 00:50:34.457924 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.457846    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 12 00:50:34.457924 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.457914    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 12 00:50:34.464552 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.464532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"]
Sep 12 00:50:34.519857 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.519836    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f4b47cfd-dtstj"]
Sep 12 00:50:34.521910 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:34.521886    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaae82eb_e450_4f68_acbc_acb88f006ba2.slice/crio-39f675087f5e8acf4f0194510297a6f757f8a9fc2203f5a0abf0928f67055b0a WatchSource:0}: Error finding container 39f675087f5e8acf4f0194510297a6f757f8a9fc2203f5a0abf0928f67055b0a: Status 404 returned error can't find the container with id 39f675087f5e8acf4f0194510297a6f757f8a9fc2203f5a0abf0928f67055b0a
Sep 12 00:50:34.585679 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.585648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gg8d\" (UniqueName: \"kubernetes.io/projected/b15809bf-3772-45e0-8f54-23a3b57cb554-kube-api-access-9gg8d\") pod \"dns-operator-controller-manager-7b84cd7c9c-22w5x\" (UID: \"b15809bf-3772-45e0-8f54-23a3b57cb554\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:34.687193 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.687150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gg8d\" (UniqueName: \"kubernetes.io/projected/b15809bf-3772-45e0-8f54-23a3b57cb554-kube-api-access-9gg8d\") pod \"dns-operator-controller-manager-7b84cd7c9c-22w5x\" (UID: \"b15809bf-3772-45e0-8f54-23a3b57cb554\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:34.707692 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.707623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gg8d\" (UniqueName: \"kubernetes.io/projected/b15809bf-3772-45e0-8f54-23a3b57cb554-kube-api-access-9gg8d\") pod \"dns-operator-controller-manager-7b84cd7c9c-22w5x\" (UID: \"b15809bf-3772-45e0-8f54-23a3b57cb554\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:34.763921 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.763888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:34.805827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.805783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4b47cfd-dtstj" event={"ID":"aaae82eb-e450-4f68-acbc-acb88f006ba2","Type":"ContainerStarted","Data":"d97ce8f87fd66548c9c349aa6fca39f239727c1c34450effa0b28e0661f0adb9"}
Sep 12 00:50:34.805973 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.805859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f4b47cfd-dtstj" event={"ID":"aaae82eb-e450-4f68-acbc-acb88f006ba2","Type":"ContainerStarted","Data":"39f675087f5e8acf4f0194510297a6f757f8a9fc2203f5a0abf0928f67055b0a"}
Sep 12 00:50:34.828200 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:34.828131    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f4b47cfd-dtstj" podStartSLOduration=1.828110495 podStartE2EDuration="1.828110495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:50:34.825390513 +0000 UTC m=+457.738069476" watchObservedRunningTime="2026-09-12 00:50:34.828110495 +0000 UTC m=+457.740789435"
Sep 12 00:50:35.053121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:35.053097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"]
Sep 12 00:50:35.054912 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:35.054878    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15809bf_3772_45e0_8f54_23a3b57cb554.slice/crio-eb21198c7f7720e3760debce3de48f0d46f2f9aee8c254a806ab86bfb5f4453b WatchSource:0}: Error finding container eb21198c7f7720e3760debce3de48f0d46f2f9aee8c254a806ab86bfb5f4453b: Status 404 returned error can't find the container with id eb21198c7f7720e3760debce3de48f0d46f2f9aee8c254a806ab86bfb5f4453b
Sep 12 00:50:35.817140 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:35.817100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x" event={"ID":"b15809bf-3772-45e0-8f54-23a3b57cb554","Type":"ContainerStarted","Data":"eb21198c7f7720e3760debce3de48f0d46f2f9aee8c254a806ab86bfb5f4453b"}
Sep 12 00:50:36.959110 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:36.959076    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"]
Sep 12 00:50:36.969624 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:36.969591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:36.979806 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:36.978666    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nnk4n\""
Sep 12 00:50:36.984925 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:36.984900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"]
Sep 12 00:50:37.111518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.111475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4cwm\" (UniqueName: \"kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm\") pod \"limitador-operator-controller-manager-74495c69f8-5d5wn\" (UID: \"38b8eaa6-aec2-42c5-8dce-12582e2403e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:37.212220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.212152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4cwm\" (UniqueName: \"kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm\") pod \"limitador-operator-controller-manager-74495c69f8-5d5wn\" (UID: \"38b8eaa6-aec2-42c5-8dce-12582e2403e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:37.228881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.228843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4cwm\" (UniqueName: \"kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm\") pod \"limitador-operator-controller-manager-74495c69f8-5d5wn\" (UID: \"38b8eaa6-aec2-42c5-8dce-12582e2403e0\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:37.285036 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.284976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:37.803834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.803744    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"]
Sep 12 00:50:37.810505 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:50:37.810474    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b8eaa6_aec2_42c5_8dce_12582e2403e0.slice/crio-1a5b464d28bb6f498f1711ae001d49f74d2a29cdc022e9bb50b7782d2b634e02 WatchSource:0}: Error finding container 1a5b464d28bb6f498f1711ae001d49f74d2a29cdc022e9bb50b7782d2b634e02: Status 404 returned error can't find the container with id 1a5b464d28bb6f498f1711ae001d49f74d2a29cdc022e9bb50b7782d2b634e02
Sep 12 00:50:37.829835 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.829803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn" event={"ID":"38b8eaa6-aec2-42c5-8dce-12582e2403e0","Type":"ContainerStarted","Data":"1a5b464d28bb6f498f1711ae001d49f74d2a29cdc022e9bb50b7782d2b634e02"}
Sep 12 00:50:37.831454 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.831431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x" event={"ID":"b15809bf-3772-45e0-8f54-23a3b57cb554","Type":"ContainerStarted","Data":"ce081b9ee40d748ff8d9c23917bfb367143fe2b50df64131f104d33781183bb0"}
Sep 12 00:50:37.831556 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.831533    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:37.852849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:37.852804    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x" podStartSLOduration=1.312089126 podStartE2EDuration="3.852790803s" totalImagesPullingTime="2.540701677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:50:37.850126338 +0000 UTC m=+460.762805325" watchObservedRunningTime="2026-09-12 00:50:37.852790803 +0000 UTC m=+460.765469739"
Sep 12 00:50:39.845705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:39.845674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn" event={"ID":"38b8eaa6-aec2-42c5-8dce-12582e2403e0","Type":"ContainerStarted","Data":"3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac"}
Sep 12 00:50:39.846083 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:39.845750    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:39.891422 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:39.891325    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn" podStartSLOduration=2.08024768 podStartE2EDuration="3.891308753s" totalImagesPullingTime="1.811061073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:50:39.889459154 +0000 UTC m=+462.802138115" watchObservedRunningTime="2026-09-12 00:50:39.891308753 +0000 UTC m=+462.803987687"
Sep 12 00:50:44.232322 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:44.232263    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:44.232909 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:44.232341    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:44.237331 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:44.237308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:44.878526 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:44.878498    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f4b47cfd-dtstj"
Sep 12 00:50:44.944985 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:44.944952    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:50:48.840229 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:48.840192    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-22w5x"
Sep 12 00:50:50.855039 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:50.854999    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:59.502250 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.502213    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"]
Sep 12 00:50:59.502698 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.502463    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" containerName="manager" containerID="cri-o://3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac" gracePeriod=2
Sep 12 00:50:59.522194 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.522168    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"]
Sep 12 00:50:59.536126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.536087    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"]
Sep 12 00:50:59.536856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.536833    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" containerName="manager"
Sep 12 00:50:59.536941 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.536860    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" containerName="manager"
Sep 12 00:50:59.536982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.536943    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" containerName="manager"
Sep 12 00:50:59.540049 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.540032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:50:59.548948 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:50:59.548904    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"38b8eaa6-aec2-42c5-8dce-12582e2403e0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-5d5wn\": pods \"limitador-operator-controller-manager-74495c69f8-5d5wn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:59.559352 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.559327    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"]
Sep 12 00:50:59.588072 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:50:59.588034    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-5d5wn\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:59.611544 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.611514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnccw\" (UniqueName: \"kubernetes.io/projected/4c26e328-b03a-44b7-b5a1-e3c88941baa1-kube-api-access-qnccw\") pod \"limitador-operator-controller-manager-74495c69f8-dhkbb\" (UID: \"4c26e328-b03a-44b7-b5a1-e3c88941baa1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:50:59.713098 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.713063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnccw\" (UniqueName: \"kubernetes.io/projected/4c26e328-b03a-44b7-b5a1-e3c88941baa1-kube-api-access-qnccw\") pod \"limitador-operator-controller-manager-74495c69f8-dhkbb\" (UID: \"4c26e328-b03a-44b7-b5a1-e3c88941baa1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:50:59.734174 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.734146    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnccw\" (UniqueName: \"kubernetes.io/projected/4c26e328-b03a-44b7-b5a1-e3c88941baa1-kube-api-access-qnccw\") pod \"limitador-operator-controller-manager-74495c69f8-dhkbb\" (UID: \"4c26e328-b03a-44b7-b5a1-e3c88941baa1\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:50:59.758489 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.758436    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:59.813652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.813620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4cwm\" (UniqueName: \"kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm\") pod \"38b8eaa6-aec2-42c5-8dce-12582e2403e0\" (UID: \"38b8eaa6-aec2-42c5-8dce-12582e2403e0\") "
Sep 12 00:50:59.815988 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.815969    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm" (OuterVolumeSpecName: "kube-api-access-q4cwm") pod "38b8eaa6-aec2-42c5-8dce-12582e2403e0" (UID: "38b8eaa6-aec2-42c5-8dce-12582e2403e0"). InnerVolumeSpecName "kube-api-access-q4cwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:50:59.879854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.879825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:50:59.915012 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.914985    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4cwm\" (UniqueName: \"kubernetes.io/projected/38b8eaa6-aec2-42c5-8dce-12582e2403e0-kube-api-access-q4cwm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:50:59.965706 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.965677    2576 generic.go:356] "Generic (PLEG): container finished" podID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" containerID="3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac" exitCode=0
Sep 12 00:50:59.965850 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.965726    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5d5wn"
Sep 12 00:50:59.965850 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.965781    2576 scope.go:117] "RemoveContainer" containerID="3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac"
Sep 12 00:50:59.975109 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.975092    2576 scope.go:117] "RemoveContainer" containerID="3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac"
Sep 12 00:50:59.975464 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:50:59.975445    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac\": container with ID starting with 3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac not found: ID does not exist" containerID="3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac"
Sep 12 00:50:59.975555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:50:59.975476    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac"} err="failed to get container status \"3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac\": rpc error: code = NotFound desc = could not find container \"3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac\": container with ID starting with 3b5c401c56baedd6068510dfdb002dcf0873a9088b456ff6a81fd2f02b2a61ac not found: ID does not exist"
Sep 12 00:51:00.166797 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:00.166773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"]
Sep 12 00:51:00.168785 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:51:00.168757    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c26e328_b03a_44b7_b5a1_e3c88941baa1.slice/crio-ebe4686b397f869365af87ed759d65e60dbe4e0d23f8b927b99ef430c891bf8c WatchSource:0}: Error finding container ebe4686b397f869365af87ed759d65e60dbe4e0d23f8b927b99ef430c891bf8c: Status 404 returned error can't find the container with id ebe4686b397f869365af87ed759d65e60dbe4e0d23f8b927b99ef430c891bf8c
Sep 12 00:51:00.974492 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:00.974455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb" event={"ID":"4c26e328-b03a-44b7-b5a1-e3c88941baa1","Type":"ContainerStarted","Data":"34bfbbe6b90434cbbe0432c82a5945baff6680bd7fdc0978057ab664347d607b"}
Sep 12 00:51:00.974872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:00.974510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb" event={"ID":"4c26e328-b03a-44b7-b5a1-e3c88941baa1","Type":"ContainerStarted","Data":"ebe4686b397f869365af87ed759d65e60dbe4e0d23f8b927b99ef430c891bf8c"}
Sep 12 00:51:00.974872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:00.974592    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:51:01.000509 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:01.000461    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb" podStartSLOduration=2.000445781 podStartE2EDuration="2.000445781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:00.997677341 +0000 UTC m=+483.910356291" watchObservedRunningTime="2026-09-12 00:51:01.000445781 +0000 UTC m=+483.913124793"
Sep 12 00:51:01.581299 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:01.581249    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b8eaa6-aec2-42c5-8dce-12582e2403e0" path="/var/lib/kubelet/pods/38b8eaa6-aec2-42c5-8dce-12582e2403e0/volumes"
Sep 12 00:51:09.966996 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:09.966933    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-867d4448cc-8qqs4" podUID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" containerName="console" containerID="cri-o://e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2" gracePeriod=15
Sep 12 00:51:10.223555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.223493    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:51:10.306516 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306641    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306669    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306874 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306732    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306874 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306759    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krvsx\" (UniqueName: \"kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.306874 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config\") pod \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\" (UID: \"f1cf8dc1-787d-4ed3-bcca-1d2cae216018\") "
Sep 12 00:51:10.307090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.306969    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:10.307090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307052    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:10.307220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:10.307340 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307307    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config" (OuterVolumeSpecName: "console-config") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:51:10.307643 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307516    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.307643 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307531    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.307643 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307539    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-oauth-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.307643 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.307547    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-trusted-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.308911 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.308888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:51:10.309003 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.308944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:51:10.309119 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.309094    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx" (OuterVolumeSpecName: "kube-api-access-krvsx") pod "f1cf8dc1-787d-4ed3-bcca-1d2cae216018" (UID: "f1cf8dc1-787d-4ed3-bcca-1d2cae216018"). InnerVolumeSpecName "kube-api-access-krvsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:10.408691 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.408656    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-serving-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.408691 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.408683    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krvsx\" (UniqueName: \"kubernetes.io/projected/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-kube-api-access-krvsx\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:10.408691 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:10.408694    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1cf8dc1-787d-4ed3-bcca-1d2cae216018-console-oauth-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:11.033246 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.033210    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" containerID="e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2" exitCode=0
Sep 12 00:51:11.033700 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.033259    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d4448cc-8qqs4"
Sep 12 00:51:11.033700 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.033315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4448cc-8qqs4" event={"ID":"f1cf8dc1-787d-4ed3-bcca-1d2cae216018","Type":"ContainerDied","Data":"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"}
Sep 12 00:51:11.033700 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.033368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d4448cc-8qqs4" event={"ID":"f1cf8dc1-787d-4ed3-bcca-1d2cae216018","Type":"ContainerDied","Data":"7f0f279c223749b84c282ba03df6e71f4a031a6d3ce9c9303f8d672a949b446c"}
Sep 12 00:51:11.033700 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.033388    2576 scope.go:117] "RemoveContainer" containerID="e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"
Sep 12 00:51:11.043475 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.043457    2576 scope.go:117] "RemoveContainer" containerID="e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"
Sep 12 00:51:11.043740 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:51:11.043722    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2\": container with ID starting with e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2 not found: ID does not exist" containerID="e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"
Sep 12 00:51:11.043803 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.043752    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2"} err="failed to get container status \"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2\": rpc error: code = NotFound desc = could not find container \"e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2\": container with ID starting with e08d10a4843021ad33ce37f07daefbae419db8b7def980adf620d86574561dd2 not found: ID does not exist"
Sep 12 00:51:11.056662 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.056625    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:51:11.059027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.059001    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-867d4448cc-8qqs4"]
Sep 12 00:51:11.581988 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.581950    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" path="/var/lib/kubelet/pods/f1cf8dc1-787d-4ed3-bcca-1d2cae216018/volumes"
Sep 12 00:51:11.983148 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:11.983117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dhkbb"
Sep 12 00:51:44.053782 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.053743    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:51:44.054300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.054241    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" containerName="console"
Sep 12 00:51:44.054300 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.054257    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" containerName="console"
Sep 12 00:51:44.054400 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.054366    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1cf8dc1-787d-4ed3-bcca-1d2cae216018" containerName="console"
Sep 12 00:51:44.056632 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.056616    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.058856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.058835    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 12 00:51:44.058999 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.058982    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-phdxx\""
Sep 12 00:51:44.069718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.069695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:51:44.083885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.083860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-config-file\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.084092 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.084065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngbjb\" (UniqueName: \"kubernetes.io/projected/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-kube-api-access-ngbjb\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.088033 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.088007    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:51:44.184696 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.184670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-config-file\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.184810 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.184721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngbjb\" (UniqueName: \"kubernetes.io/projected/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-kube-api-access-ngbjb\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.185265 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.185246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-config-file\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.192672 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.192653    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngbjb\" (UniqueName: \"kubernetes.io/projected/d11a8496-f25b-47a0-83e5-a5c741dfc1f2-kube-api-access-ngbjb\") pod \"limitador-limitador-84994f7ffc-7d5xk\" (UID: \"d11a8496-f25b-47a0-83e5-a5c741dfc1f2\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.367142 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.367059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:44.564181 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.563989    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:44.567151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.567129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:44.569667 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.569645    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dh8xs\""
Sep 12 00:51:44.575982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.575947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:44.588571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.588526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgfql\" (UniqueName: \"kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql\") pod \"authorino-7bcfd8f9cd-qx5qg\" (UID: \"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:44.640268 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.640238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:51:44.641475 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:51:44.641448    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11a8496_f25b_47a0_83e5_a5c741dfc1f2.slice/crio-a0da709afdab097a161b5501999caa141bd2b34dae79e10594a61a1ea5795a24 WatchSource:0}: Error finding container a0da709afdab097a161b5501999caa141bd2b34dae79e10594a61a1ea5795a24: Status 404 returned error can't find the container with id a0da709afdab097a161b5501999caa141bd2b34dae79e10594a61a1ea5795a24
Sep 12 00:51:44.690201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.690168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgfql\" (UniqueName: \"kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql\") pod \"authorino-7bcfd8f9cd-qx5qg\" (UID: \"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:44.700444 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.700417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgfql\" (UniqueName: \"kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql\") pod \"authorino-7bcfd8f9cd-qx5qg\" (UID: \"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6\") " pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:44.878056 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:44.878030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:45.149978 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:45.149949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:45.151461 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:51:45.151436    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c50d6d3_f73e_4a4a_b68d_89018b67d7e6.slice/crio-6dd4807268347db5d29cc596936dc1a04bdc15840d9caf71a9af6bb673157d76 WatchSource:0}: Error finding container 6dd4807268347db5d29cc596936dc1a04bdc15840d9caf71a9af6bb673157d76: Status 404 returned error can't find the container with id 6dd4807268347db5d29cc596936dc1a04bdc15840d9caf71a9af6bb673157d76
Sep 12 00:51:45.224883 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:45.224804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" event={"ID":"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6","Type":"ContainerStarted","Data":"6dd4807268347db5d29cc596936dc1a04bdc15840d9caf71a9af6bb673157d76"}
Sep 12 00:51:45.226353 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:45.226308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk" event={"ID":"d11a8496-f25b-47a0-83e5-a5c741dfc1f2","Type":"ContainerStarted","Data":"a0da709afdab097a161b5501999caa141bd2b34dae79e10594a61a1ea5795a24"}
Sep 12 00:51:46.236044 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:46.235936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk" event={"ID":"d11a8496-f25b-47a0-83e5-a5c741dfc1f2","Type":"ContainerStarted","Data":"a95f667d84be67ac4c4b0adcab7ab155d30f67c9da2869b40eafeb8f83c53eb1"}
Sep 12 00:51:46.236044 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:46.236010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:51:46.255390 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:46.255343    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk" podStartSLOduration=1.353020202 podStartE2EDuration="2.255327876s" totalImagesPullingTime="902.307674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:46.251863549 +0000 UTC m=+529.164542507" watchObservedRunningTime="2026-09-12 00:51:46.255327876 +0000 UTC m=+529.168006813"
Sep 12 00:51:47.246715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:47.246681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" event={"ID":"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6","Type":"ContainerStarted","Data":"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"}
Sep 12 00:51:47.260724 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:47.260623    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" podStartSLOduration=1.393745432 podStartE2EDuration="3.260603005s" totalImagesPullingTime="1.866857573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:51:47.26018889 +0000 UTC m=+530.172867828" watchObservedRunningTime="2026-09-12 00:51:47.260603005 +0000 UTC m=+530.173281943"
Sep 12 00:51:48.452578 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:48.452543    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:49.259156 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:49.259116    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" podUID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" containerName="authorino" containerID="cri-o://6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142" gracePeriod=30
Sep 12 00:51:49.504155 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:49.504110    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:49.542845 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:49.542773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgfql\" (UniqueName: \"kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql\") pod \"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6\" (UID: \"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6\") "
Sep 12 00:51:49.544899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:49.544873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql" (OuterVolumeSpecName: "kube-api-access-vgfql") pod "0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" (UID: "0c50d6d3-f73e-4a4a-b68d-89018b67d7e6"). InnerVolumeSpecName "kube-api-access-vgfql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:51:49.644413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:49.644388    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgfql\" (UniqueName: \"kubernetes.io/projected/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6-kube-api-access-vgfql\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:51:50.266180 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.266137    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" containerID="6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142" exitCode=0
Sep 12 00:51:50.266180 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.266181    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg"
Sep 12 00:51:50.266411 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.266216    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" event={"ID":"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6","Type":"ContainerDied","Data":"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"}
Sep 12 00:51:50.266411 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.266263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-qx5qg" event={"ID":"0c50d6d3-f73e-4a4a-b68d-89018b67d7e6","Type":"ContainerDied","Data":"6dd4807268347db5d29cc596936dc1a04bdc15840d9caf71a9af6bb673157d76"}
Sep 12 00:51:50.266411 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.266296    2576 scope.go:117] "RemoveContainer" containerID="6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"
Sep 12 00:51:50.275294 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.275260    2576 scope.go:117] "RemoveContainer" containerID="6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"
Sep 12 00:51:50.275592 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:51:50.275570    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142\": container with ID starting with 6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142 not found: ID does not exist" containerID="6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"
Sep 12 00:51:50.275667 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.275603    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142"} err="failed to get container status \"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142\": rpc error: code = NotFound desc = could not find container \"6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142\": container with ID starting with 6266162c333d8090f2c6812136da6dabb328e26da9a3cc95584dffb55f2a3142 not found: ID does not exist"
Sep 12 00:51:50.281366 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.281347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:50.285380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:50.285359    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-qx5qg"]
Sep 12 00:51:51.581710 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:51.581681    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" path="/var/lib/kubelet/pods/0c50d6d3-f73e-4a4a-b68d-89018b67d7e6/volumes"
Sep 12 00:51:57.248360 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:51:57.248328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"
Sep 12 00:52:12.048818 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.048782    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-m9lzj"]
Sep 12 00:52:12.049345 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.049327    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" containerName="authorino"
Sep 12 00:52:12.049345 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.049347    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" containerName="authorino"
Sep 12 00:52:12.049432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.049414    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c50d6d3-f73e-4a4a-b68d-89018b67d7e6" containerName="authorino"
Sep 12 00:52:12.052187 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.052167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.054435 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.054418    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dh8xs\""
Sep 12 00:52:12.059997 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.059973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-m9lzj"]
Sep 12 00:52:12.147000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.146954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bddz\" (UniqueName: \"kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz\") pod \"authorino-557f876f69-m9lzj\" (UID: \"216ff2f0-75de-4795-8a31-81e46ffd6c63\") " pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.192290 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.192238    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-m9lzj"]
Sep 12 00:52:12.192561 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:52:12.192541    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2bddz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-m9lzj" podUID="216ff2f0-75de-4795-8a31-81e46ffd6c63"
Sep 12 00:52:12.221419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.221387    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-x962m"]
Sep 12 00:52:12.223981 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.223964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.226377 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.226358    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 12 00:52:12.232959 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.232940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-x962m"]
Sep 12 00:52:12.248139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.248118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bddz\" (UniqueName: \"kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz\") pod \"authorino-557f876f69-m9lzj\" (UID: \"216ff2f0-75de-4795-8a31-81e46ffd6c63\") " pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.256792 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.256714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bddz\" (UniqueName: \"kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz\") pod \"authorino-557f876f69-m9lzj\" (UID: \"216ff2f0-75de-4795-8a31-81e46ffd6c63\") " pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.300805 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.300725    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-x962m"]
Sep 12 00:52:12.301043 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:52:12.301023    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qndmd tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-x962m" podUID="b6c58430-a528-4e29-a7a9-06f27beca381"
Sep 12 00:52:12.332071 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.332026    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:52:12.335403 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.335377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.346902 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.346875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:52:12.348850 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.348824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.348975 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.348867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qndmd\" (UniqueName: \"kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.396223 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.396183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.396436 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.396183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.402256 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.402235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.405595 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.405580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:12.449867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.449830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.450024 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.449880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.450024 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.449900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qndmd\" (UniqueName: \"kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.450024 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.449970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzch\" (UniqueName: \"kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.452561 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.452538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.458133 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.458110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qndmd\" (UniqueName: \"kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd\") pod \"authorino-6d4dfc649f-x962m\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") " pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:12.550903 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.550817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bddz\" (UniqueName: \"kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz\") pod \"216ff2f0-75de-4795-8a31-81e46ffd6c63\" (UID: \"216ff2f0-75de-4795-8a31-81e46ffd6c63\") "
Sep 12 00:52:12.550903 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.550881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert\") pod \"b6c58430-a528-4e29-a7a9-06f27beca381\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") "
Sep 12 00:52:12.551145 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.550960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qndmd\" (UniqueName: \"kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd\") pod \"b6c58430-a528-4e29-a7a9-06f27beca381\" (UID: \"b6c58430-a528-4e29-a7a9-06f27beca381\") "
Sep 12 00:52:12.551145 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.551079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.551145 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.551135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzch\" (UniqueName: \"kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.553225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.553193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b6c58430-a528-4e29-a7a9-06f27beca381" (UID: "b6c58430-a528-4e29-a7a9-06f27beca381"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:52:12.553355 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.553237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd" (OuterVolumeSpecName: "kube-api-access-qndmd") pod "b6c58430-a528-4e29-a7a9-06f27beca381" (UID: "b6c58430-a528-4e29-a7a9-06f27beca381"). InnerVolumeSpecName "kube-api-access-qndmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:52:12.553355 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.553255    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz" (OuterVolumeSpecName: "kube-api-access-2bddz") pod "216ff2f0-75de-4795-8a31-81e46ffd6c63" (UID: "216ff2f0-75de-4795-8a31-81e46ffd6c63"). InnerVolumeSpecName "kube-api-access-2bddz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:52:12.553592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.553574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.560935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.560913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzch\" (UniqueName: \"kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch\") pod \"authorino-57b8cdf4cd-ls6vh\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") " pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.651826 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.651791    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bddz\" (UniqueName: \"kubernetes.io/projected/216ff2f0-75de-4795-8a31-81e46ffd6c63-kube-api-access-2bddz\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:52:12.651826 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.651817    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6c58430-a528-4e29-a7a9-06f27beca381-tls-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:52:12.651826 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.651829    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qndmd\" (UniqueName: \"kubernetes.io/projected/b6c58430-a528-4e29-a7a9-06f27beca381-kube-api-access-qndmd\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:52:12.652130 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.652082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:52:12.924413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:12.924384    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:52:12.925505 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:52:12.925481    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7d8c006_d9ad_4fc6_8650_3f764b4969c2.slice/crio-f68eab685c3225e38d0c090a9fdc748d14ba99f45f503a7b41a98dd6f5bc3471 WatchSource:0}: Error finding container f68eab685c3225e38d0c090a9fdc748d14ba99f45f503a7b41a98dd6f5bc3471: Status 404 returned error can't find the container with id f68eab685c3225e38d0c090a9fdc748d14ba99f45f503a7b41a98dd6f5bc3471
Sep 12 00:52:13.403350 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.403314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" event={"ID":"e7d8c006-d9ad-4fc6-8650-3f764b4969c2","Type":"ContainerStarted","Data":"f68eab685c3225e38d0c090a9fdc748d14ba99f45f503a7b41a98dd6f5bc3471"}
Sep 12 00:52:13.403762 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.403396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-m9lzj"
Sep 12 00:52:13.403762 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.403396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-x962m"
Sep 12 00:52:13.438856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.438832    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-x962m"]
Sep 12 00:52:13.443722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.443700    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-x962m"]
Sep 12 00:52:13.465563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.465539    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-m9lzj"]
Sep 12 00:52:13.470954 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.470923    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-m9lzj"]
Sep 12 00:52:13.582543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.582515    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="216ff2f0-75de-4795-8a31-81e46ffd6c63" path="/var/lib/kubelet/pods/216ff2f0-75de-4795-8a31-81e46ffd6c63/volumes"
Sep 12 00:52:13.582792 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:13.582780    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c58430-a528-4e29-a7a9-06f27beca381" path="/var/lib/kubelet/pods/b6c58430-a528-4e29-a7a9-06f27beca381/volumes"
Sep 12 00:52:14.411329 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:14.411298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" event={"ID":"e7d8c006-d9ad-4fc6-8650-3f764b4969c2","Type":"ContainerStarted","Data":"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"}
Sep 12 00:52:14.428755 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:14.428711    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" podStartSLOduration=1.935152413 podStartE2EDuration="2.428697278s" totalImagesPullingTime="493.544865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:52:14.425974994 +0000 UTC m=+557.338653940" watchObservedRunningTime="2026-09-12 00:52:14.428697278 +0000 UTC m=+557.341376250"
Sep 12 00:52:57.993150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:52:57.993108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:53:21.183427 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:21.183346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:53:43.893707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:43.893671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:53:48.219180 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.219141    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"]
Sep 12 00:53:48.223808 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.223781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.226556 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.226529    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 12 00:53:48.227808 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.227783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 12 00:53:48.227947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.227831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6nb8d\""
Sep 12 00:53:48.227947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.227786    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 12 00:53:48.231651 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.231629    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"]
Sep 12 00:53:48.304612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87rd\" (UniqueName: \"kubernetes.io/projected/84ab849a-147e-4167-9e39-cc75264859e0-kube-api-access-k87rd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.304821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.304821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304676    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84ab849a-147e-4167-9e39-cc75264859e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.304821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.304821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.304821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.304804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.405948 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.405910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.405948 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.405948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84ab849a-147e-4167-9e39-cc75264859e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.405982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87rd\" (UniqueName: \"kubernetes.io/projected/84ab849a-147e-4167-9e39-cc75264859e0-kube-api-access-k87rd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406446 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406533 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.406589 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.406572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.408466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.408450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84ab849a-147e-4167-9e39-cc75264859e0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.408732 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.408717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84ab849a-147e-4167-9e39-cc75264859e0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.418396 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.418372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87rd\" (UniqueName: \"kubernetes.io/projected/84ab849a-147e-4167-9e39-cc75264859e0-kube-api-access-k87rd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4\" (UID: \"84ab849a-147e-4167-9e39-cc75264859e0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.536827 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.536734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:48.813270 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.813241    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"]
Sep 12 00:53:48.814394 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:53:48.814369    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ab849a_147e_4167_9e39_cc75264859e0.slice/crio-8e4e9462f2bf51466a2616a390b1d77d0f3987dfa5098d9fe87b10ee31355c13 WatchSource:0}: Error finding container 8e4e9462f2bf51466a2616a390b1d77d0f3987dfa5098d9fe87b10ee31355c13: Status 404 returned error can't find the container with id 8e4e9462f2bf51466a2616a390b1d77d0f3987dfa5098d9fe87b10ee31355c13
Sep 12 00:53:48.815658 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.815640    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 00:53:48.944129 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:48.944096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4" event={"ID":"84ab849a-147e-4167-9e39-cc75264859e0","Type":"ContainerStarted","Data":"8e4e9462f2bf51466a2616a390b1d77d0f3987dfa5098d9fe87b10ee31355c13"}
Sep 12 00:53:49.062063 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:49.061980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:53:50.962029 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:50.961993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4" event={"ID":"84ab849a-147e-4167-9e39-cc75264859e0","Type":"ContainerStarted","Data":"a821e1f96690850e2e2838058d08b357794c95c7516280b19275877cf5259767"}
Sep 12 00:53:50.980608 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:50.980556    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4" podStartSLOduration=1.8791595559999998 podStartE2EDuration="2.980540273s" totalImagesPullingTime="1.101380717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:53:50.979839211 +0000 UTC m=+653.892518161" watchObservedRunningTime="2026-09-12 00:53:50.980540273 +0000 UTC m=+653.893219245"
Sep 12 00:53:58.537786 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:58.537751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:58.538296 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:58.537817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:58.551051 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:58.551024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:53:59.018939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:53:59.018910    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4"
Sep 12 00:54:04.770020 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:04.769987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:54:14.450065 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:14.450032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:54:23.530204 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.530163    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"]
Sep 12 00:54:23.534557 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.534536    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.537012 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.536989    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 12 00:54:23.543807 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.543787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"]
Sep 12 00:54:23.634404 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.634584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.634584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.634584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.634584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbbss\" (UniqueName: \"kubernetes.io/projected/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-kube-api-access-zbbss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.634584 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.634576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbbss\" (UniqueName: \"kubernetes.io/projected/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-kube-api-access-zbbss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735555 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735829 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735890 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.735948 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.735930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.737853 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.737835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.738105 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.738083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.744106 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.744084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbbss\" (UniqueName: \"kubernetes.io/projected/d949b6a1-7a9b-4beb-b92d-cc1c08d778c9-kube-api-access-zbbss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-56dq2\" (UID: \"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:23.846663 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:23.846602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:24.121348 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:24.121322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"]
Sep 12 00:54:24.122646 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:54:24.122618    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd949b6a1_7a9b_4beb_b92d_cc1c08d778c9.slice/crio-fc83eff642f46b150d920027b32a9c3b457b7f1f88502a30711bfcfa35d971b4 WatchSource:0}: Error finding container fc83eff642f46b150d920027b32a9c3b457b7f1f88502a30711bfcfa35d971b4: Status 404 returned error can't find the container with id fc83eff642f46b150d920027b32a9c3b457b7f1f88502a30711bfcfa35d971b4
Sep 12 00:54:24.166466 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:24.166437    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2" event={"ID":"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9","Type":"ContainerStarted","Data":"fc83eff642f46b150d920027b32a9c3b457b7f1f88502a30711bfcfa35d971b4"}
Sep 12 00:54:25.175461 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:25.175422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2" event={"ID":"d949b6a1-7a9b-4beb-b92d-cc1c08d778c9","Type":"ContainerStarted","Data":"08a097c8955a9773623c6afd52f2d29cb2996bd5e1c2192717af5ef36817575d"}
Sep 12 00:54:25.195190 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:25.195145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2" podStartSLOduration=2.014533162 podStartE2EDuration="2.195129095s" totalImagesPullingTime="180.595933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:54:25.193670377 +0000 UTC m=+688.106349324" watchObservedRunningTime="2026-09-12 00:54:25.195129095 +0000 UTC m=+688.107808029"
Sep 12 00:54:25.360982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:25.360949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:54:33.847377 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:33.847340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:33.847788 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:33.847434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:33.859960 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:33.859940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:34.240683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:34.240655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-56dq2"
Sep 12 00:54:38.357605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:54:38.357560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:55:46.440115 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.440079    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d7f4c6787-pnf8q"]
Sep 12 00:55:46.443609 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.443587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.451256 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.450949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d7f4c6787-pnf8q"]
Sep 12 00:55:46.508730 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.508696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vzp\" (UniqueName: \"kubernetes.io/projected/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-kube-api-access-r4vzp\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.508881 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.508824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-tls-cert\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.610142 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.610107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vzp\" (UniqueName: \"kubernetes.io/projected/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-kube-api-access-r4vzp\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.610337 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.610213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-tls-cert\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.612838 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.612813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-tls-cert\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.617987 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.617968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vzp\" (UniqueName: \"kubernetes.io/projected/06f69dcf-2f01-4074-8b75-d5f4a72cc2ae-kube-api-access-r4vzp\") pod \"authorino-5d7f4c6787-pnf8q\" (UID: \"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae\") " pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:46.753882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:46.753814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d7f4c6787-pnf8q"
Sep 12 00:55:47.030161 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:47.030134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d7f4c6787-pnf8q"]
Sep 12 00:55:47.030969 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:55:47.030946    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06f69dcf_2f01_4074_8b75_d5f4a72cc2ae.slice/crio-b87b131b33524a7106f8ed67a96aa2aa8cafe5a689dd1ce5603659e3753ec140 WatchSource:0}: Error finding container b87b131b33524a7106f8ed67a96aa2aa8cafe5a689dd1ce5603659e3753ec140: Status 404 returned error can't find the container with id b87b131b33524a7106f8ed67a96aa2aa8cafe5a689dd1ce5603659e3753ec140
Sep 12 00:55:47.651398 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:47.651367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d7f4c6787-pnf8q" event={"ID":"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae","Type":"ContainerStarted","Data":"b87b131b33524a7106f8ed67a96aa2aa8cafe5a689dd1ce5603659e3753ec140"}
Sep 12 00:55:48.661634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:48.661600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d7f4c6787-pnf8q" event={"ID":"06f69dcf-2f01-4074-8b75-d5f4a72cc2ae","Type":"ContainerStarted","Data":"80b6dd83ffdfd954a6dc838895f2f77168eb746eecf4fe613faba44cb0d4b0a5"}
Sep 12 00:55:48.682977 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:48.682924    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d7f4c6787-pnf8q" podStartSLOduration=1.889458697 podStartE2EDuration="2.682906865s" totalImagesPullingTime="793.448168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:55:48.680220581 +0000 UTC m=+771.592899528" watchObservedRunningTime="2026-09-12 00:55:48.682906865 +0000 UTC m=+771.595585831"
Sep 12 00:55:48.717870 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:48.717834    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:55:48.718088 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:48.718061    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" podUID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" containerName="authorino" containerID="cri-o://531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12" gracePeriod=30
Sep 12 00:55:48.978931 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:48.978904    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:55:49.033135 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.033106    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkzch\" (UniqueName: \"kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch\") pod \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") "
Sep 12 00:55:49.033337 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.033266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert\") pod \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\" (UID: \"e7d8c006-d9ad-4fc6-8650-3f764b4969c2\") "
Sep 12 00:55:49.035416 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.035387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch" (OuterVolumeSpecName: "kube-api-access-kkzch") pod "e7d8c006-d9ad-4fc6-8650-3f764b4969c2" (UID: "e7d8c006-d9ad-4fc6-8650-3f764b4969c2"). InnerVolumeSpecName "kube-api-access-kkzch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:55:49.044830 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.044801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e7d8c006-d9ad-4fc6-8650-3f764b4969c2" (UID: "e7d8c006-d9ad-4fc6-8650-3f764b4969c2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 00:55:49.134504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.134465    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-tls-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:55:49.134504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.134501    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkzch\" (UniqueName: \"kubernetes.io/projected/e7d8c006-d9ad-4fc6-8650-3f764b4969c2-kube-api-access-kkzch\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:55:49.670023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.669982    2576 generic.go:356] "Generic (PLEG): container finished" podID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" containerID="531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12" exitCode=0
Sep 12 00:55:49.670023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.670023    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh"
Sep 12 00:55:49.670582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.670085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" event={"ID":"e7d8c006-d9ad-4fc6-8650-3f764b4969c2","Type":"ContainerDied","Data":"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"}
Sep 12 00:55:49.670582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.670136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b8cdf4cd-ls6vh" event={"ID":"e7d8c006-d9ad-4fc6-8650-3f764b4969c2","Type":"ContainerDied","Data":"f68eab685c3225e38d0c090a9fdc748d14ba99f45f503a7b41a98dd6f5bc3471"}
Sep 12 00:55:49.670582 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.670160    2576 scope.go:117] "RemoveContainer" containerID="531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"
Sep 12 00:55:49.680751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.680734    2576 scope.go:117] "RemoveContainer" containerID="531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"
Sep 12 00:55:49.681062 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:55:49.681040    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12\": container with ID starting with 531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12 not found: ID does not exist" containerID="531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"
Sep 12 00:55:49.681128 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.681076    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12"} err="failed to get container status \"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12\": rpc error: code = NotFound desc = could not find container \"531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12\": container with ID starting with 531335139cf9c746440b3c66881937362d46220846e92d21846b4efb7429cc12 not found: ID does not exist"
Sep 12 00:55:49.699571 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.699543    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:55:49.703848 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:49.703818    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57b8cdf4cd-ls6vh"]
Sep 12 00:55:51.583453 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:55:51.583425    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" path="/var/lib/kubelet/pods/e7d8c006-d9ad-4fc6-8650-3f764b4969c2/volumes"
Sep 12 00:56:06.492703 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.492667    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 00:56:06.493125 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.493112    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" containerName="authorino"
Sep 12 00:56:06.493125 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.493126    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" containerName="authorino"
Sep 12 00:56:06.493212 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.493203    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d8c006-d9ad-4fc6-8650-3f764b4969c2" containerName="authorino"
Sep 12 00:56:06.497587 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.497567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.501425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.501405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-10ba6f-openshift-default-dockercfg-m9q2w\""
Sep 12 00:56:06.521772 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.521745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 00:56:06.595740 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.595885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.595885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.595885 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.596021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb4nw\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.596021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.596021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.596021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.595996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.596021 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.596017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697012 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.696975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697012 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb4nw\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.697993 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.697971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.698087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.698009    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.698391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.698366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.700364 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.700319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.701005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.700982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.708926 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.708895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.709052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.709026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb4nw\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw\") pod \"e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") " pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:06.808199 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:06.808124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:07.092594 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.092566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 00:56:07.093743 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:07.093719    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f157f16_0b9c_44f9_8d95_f650424d22bb.slice/crio-e15faf9ad38ddfeb0c662aafacf98e870f8c8fac0daf477a06607d0e5cbb9821 WatchSource:0}: Error finding container e15faf9ad38ddfeb0c662aafacf98e870f8c8fac0daf477a06607d0e5cbb9821: Status 404 returned error can't find the container with id e15faf9ad38ddfeb0c662aafacf98e870f8c8fac0daf477a06607d0e5cbb9821
Sep 12 00:56:07.096096 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.096063    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:07.096209 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.096146    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:07.096209 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.096193    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:07.784311 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.784247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerStarted","Data":"bc19cae8768af9c24dbddfd68a8959a9e9174683be5c27d69ecd95ce5e1904c3"}
Sep 12 00:56:07.784811 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.784344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerStarted","Data":"e15faf9ad38ddfeb0c662aafacf98e870f8c8fac0daf477a06607d0e5cbb9821"}
Sep 12 00:56:07.808293 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.808246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:07.811901 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:07.811850    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podStartSLOduration=1.8118364 podStartE2EDuration="1.8118364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:07.808328697 +0000 UTC m=+790.721007647" watchObservedRunningTime="2026-09-12 00:56:07.8118364 +0000 UTC m=+790.724515337"
Sep 12 00:56:08.814601 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:08.814573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:09.796577 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:09.796544    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:09.797356 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:09.797334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:09.939447 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:09.939414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:56:13.255983 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.255949    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 00:56:13.261132 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.261109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.263772 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.263753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-5cee89\""
Sep 12 00:56:13.263919 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.263859    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-5cee89-dockercfg-xq5dd\""
Sep 12 00:56:13.278949 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.278926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 00:56:13.365191 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.365155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.365414 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.365217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbnnn\" (UniqueName: \"kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.466243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.466210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.466468 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.466256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbnnn\" (UniqueName: \"kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.466908 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.466886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.477613 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.477575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbnnn\" (UniqueName: \"kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn\") pod \"payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.576572 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.576504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:13.855720 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:13.855694    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 00:56:13.858639 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:13.858609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2aa489_ba88_4601_b34e_52d0965d10c5.slice/crio-957e17dd46790ac60d693d9b769562621a367c8ee7a9ea69b7690192d8d2376c WatchSource:0}: Error finding container 957e17dd46790ac60d693d9b769562621a367c8ee7a9ea69b7690192d8d2376c: Status 404 returned error can't find the container with id 957e17dd46790ac60d693d9b769562621a367c8ee7a9ea69b7690192d8d2376c
Sep 12 00:56:14.828852 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:14.828819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" event={"ID":"9e2aa489-ba88-4601-b34e-52d0965d10c5","Type":"ContainerStarted","Data":"957e17dd46790ac60d693d9b769562621a367c8ee7a9ea69b7690192d8d2376c"}
Sep 12 00:56:15.063085 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.063030    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:56:15.067659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.067632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.070457 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.070229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-64f698-openshift-default-dockercfg-g8lgj\""
Sep 12 00:56:15.083668 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.083596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:56:15.182685 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.182647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.182895 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.182705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgm6\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.182895 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.182799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.182895 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.182853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.183108 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.182933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.183108 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.183057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.183210 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.183087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.183251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.183216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.183324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.183305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284690 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgm6\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284820 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284820 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284820 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.284986 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.284961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.285263 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.285167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.285422 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.285375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.285539 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.285490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.285717 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.285705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.285773 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.285753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.287421 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.287400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.287666 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.287649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.292854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.292830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgm6\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.293247 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.293232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token\") pod \"e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") " pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.382834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.382792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:15.663387 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:15.663359    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9360adb3_0911_4f6c_b0d4_bc3d7b563e00.slice/crio-cb8306b4efb30eedd5e1aef5f05459770a4d30e648c4b8986c6303f24483d4ec WatchSource:0}: Error finding container cb8306b4efb30eedd5e1aef5f05459770a4d30e648c4b8986c6303f24483d4ec: Status 404 returned error can't find the container with id cb8306b4efb30eedd5e1aef5f05459770a4d30e648c4b8986c6303f24483d4ec
Sep 12 00:56:15.663927 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.663903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:56:15.665783 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.665749    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:15.665876 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.665831    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:15.665944 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.665908    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:15.839563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.839526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerStarted","Data":"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"}
Sep 12 00:56:15.840357 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.839598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerStarted","Data":"cb8306b4efb30eedd5e1aef5f05459770a4d30e648c4b8986c6303f24483d4ec"}
Sep 12 00:56:15.843530 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.843387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" event={"ID":"9e2aa489-ba88-4601-b34e-52d0965d10c5","Type":"ContainerStarted","Data":"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"}
Sep 12 00:56:15.843530 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.843460    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:15.864632 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.864158    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podStartSLOduration=0.864137823 podStartE2EDuration="864.137823ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:15.863571664 +0000 UTC m=+798.776250627" watchObservedRunningTime="2026-09-12 00:56:15.864137823 +0000 UTC m=+798.776816761"
Sep 12 00:56:15.883563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:15.883505    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" podStartSLOduration=1.475718902 podStartE2EDuration="2.883488221s" totalImagesPullingTime="1.407769319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:15.88233464 +0000 UTC m=+798.795013600" watchObservedRunningTime="2026-09-12 00:56:15.883488221 +0000 UTC m=+798.796167151"
Sep 12 00:56:16.383984 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.383949    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:16.388869 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.388844    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:16.504460 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.504430    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:16.507894 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.507874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.510763 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.510741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b2dc0e67-openshift-default-dockercfg-lbx7h\""
Sep 12 00:56:16.524070 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.524050    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:16.598139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvlqk\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.598597 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.598556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.699667 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.699667 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.699906 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.699906 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.699906 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.699994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvlqk\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700367 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700423 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700423 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.700523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.700465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.702292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.702255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.702420 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.702405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.708187 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.708160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvlqk\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.708327 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.708227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token\") pod \"e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") " pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.818474 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.818434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:16.849550 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.849519    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:16.850659 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:16.850641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:17.110764 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.110659    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:17.115596 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.115563    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:17.115683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.115639    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:17.115683 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.115665    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:17.858930 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.858886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerStarted","Data":"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"}
Sep 12 00:56:17.859420 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.858957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerStarted","Data":"6137bed01b06a3b1f80353cbcfcf2d538910458d246ac4b73c8e0e762d14cdde"}
Sep 12 00:56:17.887574 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:17.887524    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" podStartSLOduration=1.8875082600000002 podStartE2EDuration="1.88750826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:17.885694423 +0000 UTC m=+800.798373380" watchObservedRunningTime="2026-09-12 00:56:17.88750826 +0000 UTC m=+800.800187267"
Sep 12 00:56:18.818779 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:18.818700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:18.825186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:18.825151    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:18.864868 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:18.864839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:18.865857 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:18.865840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:24.829947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:24.829911    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:24.833989 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:24.833968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:24.836644 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:24.836618    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b2dc0e67\""
Sep 12 00:56:24.836739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:24.836718    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b2dc0e67-dockercfg-qvjd9\""
Sep 12 00:56:24.843397 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:24.843361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:25.005916 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.005880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqqm\" (UniqueName: \"kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.006104 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.005944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.048703 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.048670    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 00:56:25.052454 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.052430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.055318 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.055258    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-bf547a-openshift-default-dockercfg-4rd7x\""
Sep 12 00:56:25.070056 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.070031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 00:56:25.107324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.107208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqqm\" (UniqueName: \"kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.107509 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.107370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.108185 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.108156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.119027 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.118996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqqm\" (UniqueName: \"kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm\") pod \"payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") " pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.147538 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.147506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.208907 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.208873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8td\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209068 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.208919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209068 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209068 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209173 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209241 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209377 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.209413 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.209401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310254 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310480 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310480 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310480 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310480 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8td\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310705 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.310904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.310698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.311089 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.311030    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.311237 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.311129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.311237 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.311120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.311400 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.311374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.313376 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.313350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.313494 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.313430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.338876 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.338852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.349766 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.349744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8td\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td\") pod \"e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") " pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.363691 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.363621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:25.483155 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:25.483106    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d366f0c_fec5_4312_b577_977c4d652450.slice/crio-5025800b84ffaf17d0273cc6a71097eade77b2688aaf95885d9f0431f46d01a0 WatchSource:0}: Error finding container 5025800b84ffaf17d0273cc6a71097eade77b2688aaf95885d9f0431f46d01a0: Status 404 returned error can't find the container with id 5025800b84ffaf17d0273cc6a71097eade77b2688aaf95885d9f0431f46d01a0
Sep 12 00:56:25.484401 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.484220    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:25.688618 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.688588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 00:56:25.690443 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:25.690416    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c32b82_7f3c_498d_ac48_3e3dedb484e6.slice/crio-060fd34d509610645c3558e8a74856faa03bc8563b86cef6d20c5bca0e17b763 WatchSource:0}: Error finding container 060fd34d509610645c3558e8a74856faa03bc8563b86cef6d20c5bca0e17b763: Status 404 returned error can't find the container with id 060fd34d509610645c3558e8a74856faa03bc8563b86cef6d20c5bca0e17b763
Sep 12 00:56:25.692983 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.692947    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:25.693078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.693016    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:25.693078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.693051    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:25.922251 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.922201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerStarted","Data":"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"}
Sep 12 00:56:25.922710 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.922299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerStarted","Data":"060fd34d509610645c3558e8a74856faa03bc8563b86cef6d20c5bca0e17b763"}
Sep 12 00:56:25.924246 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.924218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" event={"ID":"1d366f0c-fec5-4312-b577-977c4d652450","Type":"ContainerStarted","Data":"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"}
Sep 12 00:56:25.924363 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.924291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" event={"ID":"1d366f0c-fec5-4312-b577-977c4d652450","Type":"ContainerStarted","Data":"5025800b84ffaf17d0273cc6a71097eade77b2688aaf95885d9f0431f46d01a0"}
Sep 12 00:56:25.924363 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.924323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:25.946568 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.946459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podStartSLOduration=0.946438189 podStartE2EDuration="946.438189ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:25.942125121 +0000 UTC m=+808.854804082" watchObservedRunningTime="2026-09-12 00:56:25.946438189 +0000 UTC m=+808.859117118"
Sep 12 00:56:25.967405 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:25.967346    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" podStartSLOduration=1.9673262390000001 podStartE2EDuration="1.967326239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:25.962594979 +0000 UTC m=+808.875273933" watchObservedRunningTime="2026-09-12 00:56:25.967326239 +0000 UTC m=+808.880005180"
Sep 12 00:56:26.364739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:26.364655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:26.371826 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:26.371798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:26.851492 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:26.851461    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 00:56:26.933438 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:26.933408    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:26.934647 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:26.934620    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:29.954936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.954905    2576 generic.go:356] "Generic (PLEG): container finished" podID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerID="bc19cae8768af9c24dbddfd68a8959a9e9174683be5c27d69ecd95ce5e1904c3" exitCode=0
Sep 12 00:56:29.955374 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.954977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerDied","Data":"bc19cae8768af9c24dbddfd68a8959a9e9174683be5c27d69ecd95ce5e1904c3"}
Sep 12 00:56:29.955481 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.955467    2576 scope.go:117] "RemoveContainer" containerID="bc19cae8768af9c24dbddfd68a8959a9e9174683be5c27d69ecd95ce5e1904c3"
Sep 12 00:56:29.956759 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.956732    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:29.956815 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.956801    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:29.956856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:29.956831    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:30.963569 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:30.963539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerStarted","Data":"2ec6b1ad9e8544bac5118e5873b7fa0301aee69dc6914bf7d29b0134fa448835"}
Sep 12 00:56:31.808401 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:31.808347    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:31.808765 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:31.808736    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:56:31.808847 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:31.808798    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 12 00:56:32.599664 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.599579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:56:32.718044 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.718012    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 00:56:32.721798 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.721776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.724676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.724654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-bf547a-dockercfg-nztbx\""
Sep 12 00:56:32.725669 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.725648    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-bf547a\""
Sep 12 00:56:32.730493 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.730472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 00:56:32.805866 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.805829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h58z\" (UniqueName: \"kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.806260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.806237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.811665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.811637    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:56:32.811870 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.811841    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 12 00:56:32.907483 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.907455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.907712 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.907697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h58z\" (UniqueName: \"kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.908157 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.908135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:32.916711 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:32.916687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h58z\" (UniqueName: \"kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z\") pod \"payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:33.035739 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.035701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:33.371249 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.371223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 00:56:33.808604 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.808571    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:56:33.808982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.808627    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 12 00:56:33.992631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.992583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" event={"ID":"774d9077-da27-44c4-8bbe-32c4062ca40e","Type":"ContainerStarted","Data":"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"}
Sep 12 00:56:33.992851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.992672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" event={"ID":"774d9077-da27-44c4-8bbe-32c4062ca40e","Type":"ContainerStarted","Data":"317078307e73b72b0ef6972ed492f434212d1c04f80e00dbc371337cb02d201d"}
Sep 12 00:56:33.993708 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:33.993681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:34.011936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.011877    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" podStartSLOduration=2.011861713 podStartE2EDuration="2.011861713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:34.009944658 +0000 UTC m=+816.922623621" watchObservedRunningTime="2026-09-12 00:56:34.011861713 +0000 UTC m=+816.924540650"
Sep 12 00:56:34.593738 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.593706    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"]
Sep 12 00:56:34.598865 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.598839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:34.601572 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.601550    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 00:56:34.601971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.601866    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 00:56:34.605551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.605532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"]
Sep 12 00:56:34.627114 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.627079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr\" (UID: \"4743e37e-dd6a-46c3-8b04-de1cfd309373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:34.727950 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.727914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr\" (UID: \"4743e37e-dd6a-46c3-8b04-de1cfd309373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:34.728993 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.728969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr\" (UID: \"4743e37e-dd6a-46c3-8b04-de1cfd309373\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:34.809210 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.809153    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:56:34.809841 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.809808    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 12 00:56:34.924749 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:34.924718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:35.250308 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:35.246395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"]
Sep 12 00:56:35.808738 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:35.808688    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 12 00:56:35.808945 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:35.808766    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 12 00:56:36.121364 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:36.120679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr" event={"ID":"4743e37e-dd6a-46c3-8b04-de1cfd309373","Type":"ContainerStarted","Data":"63e3395efc71c94632bd4e5783648c1be74fcba0474fa5676348e677e30f80fa"}
Sep 12 00:56:36.870711 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:36.870608    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:36.871654 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:36.871541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:36.887604 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:36.887521    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 00:56:36.945795 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:36.945767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:40.291509 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:40.291466    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:56:41.166347 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:41.166306    2576 generic.go:356] "Generic (PLEG): container finished" podID="4743e37e-dd6a-46c3-8b04-de1cfd309373" containerID="76032045539f6d69459929692f040485594dddba539aedf2bf14966681109a48" exitCode=0
Sep 12 00:56:41.166532 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:41.166384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr" event={"ID":"4743e37e-dd6a-46c3-8b04-de1cfd309373","Type":"ContainerDied","Data":"76032045539f6d69459929692f040485594dddba539aedf2bf14966681109a48"}
Sep 12 00:56:42.366605 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:42.366573    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:42.467507 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:42.467406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca\") pod \"4743e37e-dd6a-46c3-8b04-de1cfd309373\" (UID: \"4743e37e-dd6a-46c3-8b04-de1cfd309373\") "
Sep 12 00:56:42.467699 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:42.467649    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4743e37e-dd6a-46c3-8b04-de1cfd309373" (UID: "4743e37e-dd6a-46c3-8b04-de1cfd309373"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:56:42.568973 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:42.568925    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4743e37e-dd6a-46c3-8b04-de1cfd309373-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:43.201303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:43.193479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr" event={"ID":"4743e37e-dd6a-46c3-8b04-de1cfd309373","Type":"ContainerDied","Data":"63e3395efc71c94632bd4e5783648c1be74fcba0474fa5676348e677e30f80fa"}
Sep 12 00:56:43.201303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:43.193542    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63e3395efc71c94632bd4e5783648c1be74fcba0474fa5676348e677e30f80fa"
Sep 12 00:56:43.201303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:43.193610    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"
Sep 12 00:56:45.210956 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.210924    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1f3694d-9238-47d8-90b5-852cae833f04" containerID="beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641" exitCode=0
Sep 12 00:56:45.211469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.210993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerDied","Data":"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"}
Sep 12 00:56:45.211537 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.211509    2576 scope.go:117] "RemoveContainer" containerID="beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"
Sep 12 00:56:45.212833 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.212811    2576 generic.go:356] "Generic (PLEG): container finished" podID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerID="2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf" exitCode=0
Sep 12 00:56:45.212920 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.212833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.212920 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.212859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerDied","Data":"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"}
Sep 12 00:56:45.212920 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.212904    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.213024 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.212939    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.213236 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.213223    2576 scope.go:117] "RemoveContainer" containerID="2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"
Sep 12 00:56:45.214379 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.214354    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.214460 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.214413    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.214460 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.214445    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:45.496166 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.496079    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:45.496651 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.496607    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" podUID="1d366f0c-fec5-4312-b577-977c4d652450" containerName="payload-processing" containerID="cri-o://5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524" gracePeriod=30
Sep 12 00:56:45.727709 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.727677    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"]
Sep 12 00:56:45.737945 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.737916    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b2dc0e67-kf6xr"]
Sep 12 00:56:45.851003 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.850973    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:45.911340 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.911080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:45.928592 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.928559    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume\") pod \"1d366f0c-fec5-4312-b577-977c4d652450\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") "
Sep 12 00:56:45.928727 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.928623    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnqqm\" (UniqueName: \"kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm\") pod \"1d366f0c-fec5-4312-b577-977c4d652450\" (UID: \"1d366f0c-fec5-4312-b577-977c4d652450\") "
Sep 12 00:56:45.929270 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.929246    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d366f0c-fec5-4312-b577-977c4d652450" (UID: "1d366f0c-fec5-4312-b577-977c4d652450"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:56:45.929500 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.929460    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d366f0c-fec5-4312-b577-977c4d652450-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:45.931774 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:45.931750    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm" (OuterVolumeSpecName: "kube-api-access-rnqqm") pod "1d366f0c-fec5-4312-b577-977c4d652450" (UID: "1d366f0c-fec5-4312-b577-977c4d652450"). InnerVolumeSpecName "kube-api-access-rnqqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:56:46.030348 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.030319    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnqqm\" (UniqueName: \"kubernetes.io/projected/1d366f0c-fec5-4312-b577-977c4d652450-kube-api-access-rnqqm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:46.122763 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.122673    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 00:56:46.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.220892    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d366f0c-fec5-4312-b577-977c4d652450" containerID="5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524" exitCode=0
Sep 12 00:56:46.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.220945    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"
Sep 12 00:56:46.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.220984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" event={"ID":"1d366f0c-fec5-4312-b577-977c4d652450","Type":"ContainerDied","Data":"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"}
Sep 12 00:56:46.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.221049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g" event={"ID":"1d366f0c-fec5-4312-b577-977c4d652450","Type":"ContainerDied","Data":"5025800b84ffaf17d0273cc6a71097eade77b2688aaf95885d9f0431f46d01a0"}
Sep 12 00:56:46.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.221079    2576 scope.go:117] "RemoveContainer" containerID="5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"
Sep 12 00:56:46.224947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.224725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerStarted","Data":"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"}
Sep 12 00:56:46.227795 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.227774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerStarted","Data":"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"}
Sep 12 00:56:46.227922 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.227897    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy" containerID="cri-o://b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433" gracePeriod=30
Sep 12 00:56:46.234745 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.234723    2576 scope.go:117] "RemoveContainer" containerID="5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"
Sep 12 00:56:46.235034 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:56:46.235016    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524\": container with ID starting with 5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524 not found: ID does not exist" containerID="5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"
Sep 12 00:56:46.235082 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.235044    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524"} err="failed to get container status \"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524\": rpc error: code = NotFound desc = could not find container \"5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524\": container with ID starting with 5becaf1b6768de4e1044c0ed036a7b2d4ef87f973bb2bad55a1f90986920e524 not found: ID does not exist"
Sep 12 00:56:46.322968 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.322935    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:46.338326 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.338298    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b2dc0e67-6c87687fd9-jz25g"]
Sep 12 00:56:46.383993 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.383894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:46.385235 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.385195    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:46.385434 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.385264    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:46.850404 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.850378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:46.866384 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866352    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:56:46.866852 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866840    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d366f0c-fec5-4312-b577-977c4d652450" containerName="payload-processing"
Sep 12 00:56:46.866898 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866854    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d366f0c-fec5-4312-b577-977c4d652450" containerName="payload-processing"
Sep 12 00:56:46.866898 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866876    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4743e37e-dd6a-46c3-8b04-de1cfd309373" containerName="revoke-keys"
Sep 12 00:56:46.866898 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866881    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4743e37e-dd6a-46c3-8b04-de1cfd309373" containerName="revoke-keys"
Sep 12 00:56:46.866991 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866955    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4743e37e-dd6a-46c3-8b04-de1cfd309373" containerName="revoke-keys"
Sep 12 00:56:46.866991 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.866965    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d366f0c-fec5-4312-b577-977c4d652450" containerName="payload-processing"
Sep 12 00:56:46.869676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.869655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.875606 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.875585    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f22962b3-gw-openshift-default-dockercfg-44w8f\""
Sep 12 00:56:46.897075 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.897043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:56:46.940244 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940469 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9f5f\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940811 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:46.940811 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:46.940504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9f5f\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.041741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.042013 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.041813    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.042341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.042319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.042616 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.042575    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.042729 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.042708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.042820 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.042800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.045224 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.044348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.045224 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.044534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.053694 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.053673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.056904 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.056879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9f5f\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f\") pod \"e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj\" (UID: \"8416f533-5947-467a-910a-90a353394716\") " pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.200552 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.200510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:47.387316 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.385710    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:47.387316 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.385773    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:47.539983 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.539954    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:56:47.540554 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:47.540526    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8416f533_5947_467a_910a_90a353394716.slice/crio-a37e6fee1106ad0c37165efba1ec30e7de7b9b17ec3287f251cef9b365e8959f WatchSource:0}: Error finding container a37e6fee1106ad0c37165efba1ec30e7de7b9b17ec3287f251cef9b365e8959f: Status 404 returned error can't find the container with id a37e6fee1106ad0c37165efba1ec30e7de7b9b17ec3287f251cef9b365e8959f
Sep 12 00:56:47.542902 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.542864    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:47.543003 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.542931    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:47.543003 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.542957    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:47.611301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.608399    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d366f0c-fec5-4312-b577-977c4d652450" path="/var/lib/kubelet/pods/1d366f0c-fec5-4312-b577-977c4d652450/volumes"
Sep 12 00:56:47.611301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:47.608944    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4743e37e-dd6a-46c3-8b04-de1cfd309373" path="/var/lib/kubelet/pods/4743e37e-dd6a-46c3-8b04-de1cfd309373/volumes"
Sep 12 00:56:48.246857 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.246760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerStarted","Data":"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"}
Sep 12 00:56:48.246857 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.246850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerStarted","Data":"a37e6fee1106ad0c37165efba1ec30e7de7b9b17ec3287f251cef9b365e8959f"}
Sep 12 00:56:48.275589 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.275522    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podStartSLOduration=2.275501418 podStartE2EDuration="2.275501418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:48.270201552 +0000 UTC m=+831.182880507" watchObservedRunningTime="2026-09-12 00:56:48.275501418 +0000 UTC m=+831.188180358"
Sep 12 00:56:48.384053 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.384005    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:48.384250 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.384089    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:48.865292 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:48.865249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:49.201665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.201630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:49.212245 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.212214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:49.254196 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.254161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:49.255389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.255364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:56:49.387718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.387236    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:49.387718 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:49.387333    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:50.370421 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:50.370387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:56:50.383238 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:50.383199    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:50.383433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:50.383298    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:51.390695 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.390650    2576 patch_prober.go:28] interesting pod/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 12 00:56:51.391131 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.390735    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 12 00:56:51.537997 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.537969    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:51.610962 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.610934    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.610962 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.610965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.610994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvlqk\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611476 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611614 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:51.611614 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:51.611738 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611797 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611743    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.611965 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.611778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.612099 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket\") pod \"f1f3694d-9238-47d8-90b5-852cae833f04\" (UID: \"f1f3694d-9238-47d8-90b5-852cae833f04\") "
Sep 12 00:56:51.612433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:51.612433 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612166    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:56:51.612589 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:51.612797 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612775    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f3694d-9238-47d8-90b5-852cae833f04-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.612862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612803    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.612862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612818    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.612862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612832    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.612862 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.612846    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.613749 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.613727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:56:51.614052 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.614028    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:56:51.614371 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.614351    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:56:51.614484 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.614468    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk" (OuterVolumeSpecName: "kube-api-access-pvlqk") pod "f1f3694d-9238-47d8-90b5-852cae833f04" (UID: "f1f3694d-9238-47d8-90b5-852cae833f04"). InnerVolumeSpecName "kube-api-access-pvlqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:56:51.714421 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.714383    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.714421 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.714417    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f3694d-9238-47d8-90b5-852cae833f04-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.714421 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.714425    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f3694d-9238-47d8-90b5-852cae833f04-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:51.714655 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:51.714435    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvlqk\" (UniqueName: \"kubernetes.io/projected/f1f3694d-9238-47d8-90b5-852cae833f04-kube-api-access-pvlqk\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:56:52.275197 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.275164    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1f3694d-9238-47d8-90b5-852cae833f04" containerID="b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433" exitCode=0
Sep 12 00:56:52.275442 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.275232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerDied","Data":"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"}
Sep 12 00:56:52.275442 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.275250    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"
Sep 12 00:56:52.275442 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.275303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47" event={"ID":"f1f3694d-9238-47d8-90b5-852cae833f04","Type":"ContainerDied","Data":"6137bed01b06a3b1f80353cbcfcf2d538910458d246ac4b73c8e0e762d14cdde"}
Sep 12 00:56:52.275442 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.275332    2576 scope.go:117] "RemoveContainer" containerID="b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"
Sep 12 00:56:52.277438 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.277413    2576 generic.go:356] "Generic (PLEG): container finished" podID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerID="4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65" exitCode=0
Sep 12 00:56:52.277579 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.277479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerDied","Data":"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"}
Sep 12 00:56:52.277856 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.277841    2576 scope.go:117] "RemoveContainer" containerID="4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"
Sep 12 00:56:52.279115 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.279083    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:52.279226 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.279178    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:52.279326 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.279224    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:56:52.286899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.286878    2576 scope.go:117] "RemoveContainer" containerID="beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"
Sep 12 00:56:52.297162 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.297145    2576 scope.go:117] "RemoveContainer" containerID="b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"
Sep 12 00:56:52.297684 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:56:52.297607    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433\": container with ID starting with b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433 not found: ID does not exist" containerID="b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"
Sep 12 00:56:52.298715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.297644    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433"} err="failed to get container status \"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433\": rpc error: code = NotFound desc = could not find container \"b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433\": container with ID starting with b8deb1e03e5dc84ab32b4cda523987fa1057a004d034cf5eee18a5e2e0d71433 not found: ID does not exist"
Sep 12 00:56:52.298715 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.298631    2576 scope.go:117] "RemoveContainer" containerID="beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"
Sep 12 00:56:52.298970 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:56:52.298951    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641\": container with ID starting with beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641 not found: ID does not exist" containerID="beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"
Sep 12 00:56:52.299035 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.298978    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641"} err="failed to get container status \"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641\": rpc error: code = NotFound desc = could not find container \"beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641\": container with ID starting with beb0e7cec278ce3a7e252ed3b5315b5eaae2d02cded27d81d8558dd41922d641 not found: ID does not exist"
Sep 12 00:56:52.323504 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.322827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:52.332295 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.332240    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b2dc0e67-openshift-default-7c979d9dcd-jqh47"]
Sep 12 00:56:52.388458 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.388424    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:52.389679 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:52.389657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:56:53.286826 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:53.286789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerStarted","Data":"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"}
Sep 12 00:56:53.364874 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:53.364838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:53.365971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:53.365921    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:53.366158 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:53.365986    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:53.583023 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:53.582939    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" path="/var/lib/kubelet/pods/f1f3694d-9238-47d8-90b5-852cae833f04/volumes"
Sep 12 00:56:54.116082 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116043    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:56:54.116563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116543    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.116563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.116563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116570    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.116764 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116576    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.116764 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116657    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.116764 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.116666    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f3694d-9238-47d8-90b5-852cae833f04" containerName="istio-proxy"
Sep 12 00:56:54.120625 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.120609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.123769 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.123748    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-f22962b3\""
Sep 12 00:56:54.123882 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.123832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-f22962b3-dockercfg-769jw\""
Sep 12 00:56:54.133068 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.133046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:56:54.242911 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.242876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.242911 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.242914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5498\" (UniqueName: \"kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.343996 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.343958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.343996 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.343998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5498\" (UniqueName: \"kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.344732 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.344711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.354461 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.354433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5498\" (UniqueName: \"kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498\") pod \"payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") " pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.364418 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.364395    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:54.364543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.364448    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:54.432502 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.432476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:54.736013 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:54.735980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:56:54.736633 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:56:54.736607    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c08a90a_121d_43a7_bf38_31fd5b886083.slice/crio-3b3aa992115efcbbd6bdf47aef61c079b411b6190a336bf64ea7b72a33f4a5c5 WatchSource:0}: Error finding container 3b3aa992115efcbbd6bdf47aef61c079b411b6190a336bf64ea7b72a33f4a5c5: Status 404 returned error can't find the container with id 3b3aa992115efcbbd6bdf47aef61c079b411b6190a336bf64ea7b72a33f4a5c5
Sep 12 00:56:55.308523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.308488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" event={"ID":"0c08a90a-121d-43a7-bf38-31fd5b886083","Type":"ContainerStarted","Data":"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"}
Sep 12 00:56:55.308707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.308542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" event={"ID":"0c08a90a-121d-43a7-bf38-31fd5b886083","Type":"ContainerStarted","Data":"3b3aa992115efcbbd6bdf47aef61c079b411b6190a336bf64ea7b72a33f4a5c5"}
Sep 12 00:56:55.308707 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.308572    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:56:55.326859 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.326789    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" podStartSLOduration=1.326773794 podStartE2EDuration="1.326773794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:56:55.32590388 +0000 UTC m=+838.238582849" watchObservedRunningTime="2026-09-12 00:56:55.326773794 +0000 UTC m=+838.239452730"
Sep 12 00:56:55.364255 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.364226    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:55.364611 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:55.364305    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:56.364133 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:56.364098    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:56.364324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:56.364148    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:56.933703 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:56.933667    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:57.364971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:57.364896    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:57.364971 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:57.364952    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:58.364342 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:58.364308    2576 patch_prober.go:28] interesting pod/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 12 00:56:58.364522 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:58.364365    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 12 00:56:59.368186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.368157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:59.369319 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.369301    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 00:56:59.822218 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.822184    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 00:56:59.827157 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.827132    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.830011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.829986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"kube-root-ca.crt\""
Sep 12 00:56:59.830345 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.830326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"simulator-w0-10ba6f-kserve-self-signed-certs\""
Sep 12 00:56:59.830442 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.830385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"default-dockercfg-fk6m9\""
Sep 12 00:56:59.830713 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.830699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"openshift-service-ca.crt\""
Sep 12 00:56:59.837043 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.837025    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 00:56:59.914005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.913976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.914151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.914035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.914151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.914074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.914151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.914098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qd5h\" (UniqueName: \"kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.914151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.914119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:56:59.914151 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:56:59.914135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015573 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qd5h\" (UniqueName: \"kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.015734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.015701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.016078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.016047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.016217 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.016108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.016217 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.016135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.017854 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.017834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.018356 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.018337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.024181 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.024159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qd5h\" (UniqueName: \"kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h\") pod \"simulator-w0-10ba6f-kserve-666657d697-mxw6g\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") " pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.137848 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.137755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:00.412518 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:00.412491    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 00:57:00.413171 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:57:00.413088    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode256228a_53cf_4a2c_a5bb_c305bc197d47.slice/crio-cc750506b89ebbaf31d08b74d3c53947159986d40ac0aff96b8349250a979bbf WatchSource:0}: Error finding container cc750506b89ebbaf31d08b74d3c53947159986d40ac0aff96b8349250a979bbf: Status 404 returned error can't find the container with id cc750506b89ebbaf31d08b74d3c53947159986d40ac0aff96b8349250a979bbf
Sep 12 00:57:01.353508 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:01.353474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" event={"ID":"e256228a-53cf-4a2c-a5bb-c305bc197d47","Type":"ContainerStarted","Data":"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"}
Sep 12 00:57:01.353676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:01.353519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" event={"ID":"e256228a-53cf-4a2c-a5bb-c305bc197d47","Type":"ContainerStarted","Data":"cc750506b89ebbaf31d08b74d3c53947159986d40ac0aff96b8349250a979bbf"}
Sep 12 00:57:01.371810 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:01.371735    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" podStartSLOduration=2.371712269 podStartE2EDuration="2.371712269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:57:01.369557203 +0000 UTC m=+844.282236151" watchObservedRunningTime="2026-09-12 00:57:01.371712269 +0000 UTC m=+844.284391206"
Sep 12 00:57:06.318209 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:06.318177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:57:10.138780 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:10.138737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:10.138780 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:10.138781    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:10.151724 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:10.151697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:10.364227 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:10.364186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:57:10.440312 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:10.440247    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 00:57:11.431343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.431305    2576 generic.go:356] "Generic (PLEG): container finished" podID="8416f533-5947-467a-910a-90a353394716" containerID="9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095" exitCode=0
Sep 12 00:57:11.431835 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.431379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerDied","Data":"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"}
Sep 12 00:57:11.432061 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.432039    2576 scope.go:117] "RemoveContainer" containerID="9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"
Sep 12 00:57:11.433415 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.433379    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:11.433531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.433458    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:11.434076 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:11.434037    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:12.439958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:12.439926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerStarted","Data":"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"}
Sep 12 00:57:13.201922 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:13.201886    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:13.202135 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:13.202109    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:57:13.202193 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:13.202162    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 12 00:57:14.202090 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:14.202048    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:57:14.202491 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:14.202115    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 12 00:57:15.201476 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:15.201442    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:57:15.201754 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:15.201502    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 12 00:57:16.202093 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:16.202049    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:57:16.202523 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:16.202128    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 12 00:57:17.201900 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:17.201856    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 12 00:57:17.202119 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:17.201915    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 12 00:57:18.205941 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:18.205914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:18.206332 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:18.206196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:18.206840 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:18.206819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:19.856087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.856052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"]
Sep 12 00:57:19.858593 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.858579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:19.861037 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.861016    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 00:57:19.861175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.861161    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 00:57:19.867787 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.867766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"]
Sep 12 00:57:19.961331 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:19.961271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s\" (UID: \"984c7c19-1d2f-40b5-99f9-eb02b279c6a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:20.062744 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:20.062710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s\" (UID: \"984c7c19-1d2f-40b5-99f9-eb02b279c6a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:20.063405 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:20.063387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s\" (UID: \"984c7c19-1d2f-40b5-99f9-eb02b279c6a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:20.171207 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:20.171180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:20.445066 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:20.444994    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"]
Sep 12 00:57:20.502266 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:20.502239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s" event={"ID":"984c7c19-1d2f-40b5-99f9-eb02b279c6a1","Type":"ContainerStarted","Data":"98c1d7e4920ba831df8af3fbc5f9780221e7140bf565f2573d3a4e8b163b85f3"}
Sep 12 00:57:21.518978 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:21.518944    2576 generic.go:356] "Generic (PLEG): container finished" podID="984c7c19-1d2f-40b5-99f9-eb02b279c6a1" containerID="dcbb1c901c02b0aea9f8f7dc8c8f9c47ac4acc0968bf4702969b5fe15391e50c" exitCode=0
Sep 12 00:57:21.519456 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:21.519032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s" event={"ID":"984c7c19-1d2f-40b5-99f9-eb02b279c6a1","Type":"ContainerDied","Data":"dcbb1c901c02b0aea9f8f7dc8c8f9c47ac4acc0968bf4702969b5fe15391e50c"}
Sep 12 00:57:22.679087 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:22.679042    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:22.794963 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:22.794862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca\") pod \"984c7c19-1d2f-40b5-99f9-eb02b279c6a1\" (UID: \"984c7c19-1d2f-40b5-99f9-eb02b279c6a1\") "
Sep 12 00:57:22.795317 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:22.795257    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "984c7c19-1d2f-40b5-99f9-eb02b279c6a1" (UID: "984c7c19-1d2f-40b5-99f9-eb02b279c6a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:57:22.896260 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:22.896221    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/984c7c19-1d2f-40b5-99f9-eb02b279c6a1-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:23.533530 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:23.533500    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"
Sep 12 00:57:23.533704 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:23.533496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s" event={"ID":"984c7c19-1d2f-40b5-99f9-eb02b279c6a1","Type":"ContainerDied","Data":"98c1d7e4920ba831df8af3fbc5f9780221e7140bf565f2573d3a4e8b163b85f3"}
Sep 12 00:57:23.533704 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:23.533636    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98c1d7e4920ba831df8af3fbc5f9780221e7140bf565f2573d3a4e8b163b85f3"
Sep 12 00:57:31.556066 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.556029    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:57:31.556481 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.556363    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" podUID="0c08a90a-121d-43a7-bf38-31fd5b886083" containerName="payload-processing" containerID="cri-o://608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426" gracePeriod=30
Sep 12 00:57:31.727337 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.727300    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"]
Sep 12 00:57:31.730252 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.730221    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-f22962b3-jt22s"]
Sep 12 00:57:31.820531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.820452    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:57:31.866994 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.866962    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:57:31.867205 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.867173    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" containerID="cri-o://4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2" gracePeriod=30
Sep 12 00:57:31.990966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.990933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume\") pod \"0c08a90a-121d-43a7-bf38-31fd5b886083\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") "
Sep 12 00:57:31.991144 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.991058    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5498\" (UniqueName: \"kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498\") pod \"0c08a90a-121d-43a7-bf38-31fd5b886083\" (UID: \"0c08a90a-121d-43a7-bf38-31fd5b886083\") "
Sep 12 00:57:31.991341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.991319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c08a90a-121d-43a7-bf38-31fd5b886083" (UID: "0c08a90a-121d-43a7-bf38-31fd5b886083"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:57:31.991531 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.991505    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c08a90a-121d-43a7-bf38-31fd5b886083-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:31.993326 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:31.993304    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498" (OuterVolumeSpecName: "kube-api-access-p5498") pod "0c08a90a-121d-43a7-bf38-31fd5b886083" (UID: "0c08a90a-121d-43a7-bf38-31fd5b886083"). InnerVolumeSpecName "kube-api-access-p5498". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:57:32.092908 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.092822    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5498\" (UniqueName: \"kubernetes.io/projected/0c08a90a-121d-43a7-bf38-31fd5b886083-kube-api-access-p5498\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:32.606731 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.606692    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c08a90a-121d-43a7-bf38-31fd5b886083" containerID="608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426" exitCode=0
Sep 12 00:57:32.607408 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.607330    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"
Sep 12 00:57:32.607623 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.607328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" event={"ID":"0c08a90a-121d-43a7-bf38-31fd5b886083","Type":"ContainerDied","Data":"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"}
Sep 12 00:57:32.607790 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.607773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg" event={"ID":"0c08a90a-121d-43a7-bf38-31fd5b886083","Type":"ContainerDied","Data":"3b3aa992115efcbbd6bdf47aef61c079b411b6190a336bf64ea7b72a33f4a5c5"}
Sep 12 00:57:32.607949 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.607837    2576 scope.go:117] "RemoveContainer" containerID="608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"
Sep 12 00:57:32.612720 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.612695    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:57:32.613513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613491    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c08a90a-121d-43a7-bf38-31fd5b886083" containerName="payload-processing"
Sep 12 00:57:32.613513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613514    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c08a90a-121d-43a7-bf38-31fd5b886083" containerName="payload-processing"
Sep 12 00:57:32.613649 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613540    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984c7c19-1d2f-40b5-99f9-eb02b279c6a1" containerName="revoke-keys"
Sep 12 00:57:32.613649 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613551    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="984c7c19-1d2f-40b5-99f9-eb02b279c6a1" containerName="revoke-keys"
Sep 12 00:57:32.613736 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613681    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c08a90a-121d-43a7-bf38-31fd5b886083" containerName="payload-processing"
Sep 12 00:57:32.613736 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.613694    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="984c7c19-1d2f-40b5-99f9-eb02b279c6a1" containerName="revoke-keys"
Sep 12 00:57:32.619960 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.619939    2576 scope.go:117] "RemoveContainer" containerID="608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"
Sep 12 00:57:32.620320 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:57:32.620264    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426\": container with ID starting with 608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426 not found: ID does not exist" containerID="608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"
Sep 12 00:57:32.620392 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.620314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426"} err="failed to get container status \"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426\": rpc error: code = NotFound desc = could not find container \"608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426\": container with ID starting with 608f4add71c031febd4cfa999d8821157ffb91ad3e7d11168735888cd7a2a426 not found: ID does not exist"
Sep 12 00:57:32.620999 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.620984    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.623539 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.623519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6e7edcc4-openshift-default-dockercfg-fkpdw\""
Sep 12 00:57:32.627439 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.627405    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:57:32.638929 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.638897    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:57:32.644962 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.644938    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-f22962b3-5d4d5bc786-d82dg"]
Sep 12 00:57:32.806026 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.805991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqptz\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806220 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806393 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806393 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806393 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806548 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806548 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.806548 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.806525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908024 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.907996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqptz\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908186 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908436 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908436 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908704 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908782 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.908844 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.908823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.909034 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.909012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.910743 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.910722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.910743 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.910741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.916563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.916538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.916648 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.916623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqptz\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz\") pod \"e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") " pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:32.933565 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:32.933544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:33.209229 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.209155    2576 patch_prober.go:28] interesting pod/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 00:57:33.209229 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.209213    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 00:57:33.217784 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.217756    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:57:33.218534 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:57:33.218505    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7471b2b1_0a88_4ed9_9783_71ed5ceaea65.slice/crio-5e5221956a45927d7a72655d85f6b31079e36d3bfe5b3b6e2e15eaa71f4e2020 WatchSource:0}: Error finding container 5e5221956a45927d7a72655d85f6b31079e36d3bfe5b3b6e2e15eaa71f4e2020: Status 404 returned error can't find the container with id 5e5221956a45927d7a72655d85f6b31079e36d3bfe5b3b6e2e15eaa71f4e2020
Sep 12 00:57:33.220767 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.220737    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:33.220858 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.220808    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:33.220940 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.220864    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:33.582919 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.582839    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c08a90a-121d-43a7-bf38-31fd5b886083" path="/var/lib/kubelet/pods/0c08a90a-121d-43a7-bf38-31fd5b886083/volumes"
Sep 12 00:57:33.583201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.583180    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="984c7c19-1d2f-40b5-99f9-eb02b279c6a1" path="/var/lib/kubelet/pods/984c7c19-1d2f-40b5-99f9-eb02b279c6a1/volumes"
Sep 12 00:57:33.615892 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.615859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerStarted","Data":"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"}
Sep 12 00:57:33.616258 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.615912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerStarted","Data":"5e5221956a45927d7a72655d85f6b31079e36d3bfe5b3b6e2e15eaa71f4e2020"}
Sep 12 00:57:33.640612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.640564    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podStartSLOduration=1.640548441 podStartE2EDuration="1.640548441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:57:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:57:33.638036092 +0000 UTC m=+876.550715033" watchObservedRunningTime="2026-09-12 00:57:33.640548441 +0000 UTC m=+876.553227377"
Sep 12 00:57:33.933878 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:33.933848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:34.939652 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:34.939618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:35.628983 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:35.628952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:35.630003 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:35.629979    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:37.111631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.111606    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:37.153057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153057 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153060    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9f5f\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153246    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153314 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153318    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153344    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data" (OuterVolumeSpecName: "istio-data") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:57:37.153590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo\") pod \"8416f533-5947-467a-910a-90a353394716\" (UID: \"8416f533-5947-467a-910a-90a353394716\") "
Sep 12 00:57:37.153590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153529    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:57:37.153590 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:57:37.153839 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153649    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:57:37.153839 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153805    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:57:37.154005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153882    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.154005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153905    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.154005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153919    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.154005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.153931    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.156295 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.156243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f" (OuterVolumeSpecName: "kube-api-access-s9f5f") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "kube-api-access-s9f5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:57:37.156422 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.156337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token" (OuterVolumeSpecName: "istio-token") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:57:37.156422 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.156352    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:57:37.156543 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.156440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8416f533-5947-467a-910a-90a353394716" (UID: "8416f533-5947-467a-910a-90a353394716"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:57:37.254641 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.254606    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8416f533-5947-467a-910a-90a353394716-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.254641 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.254635    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.254641 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.254644    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8416f533-5947-467a-910a-90a353394716-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.254891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.254653    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9f5f\" (UniqueName: \"kubernetes.io/projected/8416f533-5947-467a-910a-90a353394716-kube-api-access-s9f5f\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.254891 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.254668    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8416f533-5947-467a-910a-90a353394716-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:57:37.643175 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.643137    2576 generic.go:356] "Generic (PLEG): container finished" podID="8416f533-5947-467a-910a-90a353394716" containerID="4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2" exitCode=0
Sep 12 00:57:37.643343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.643247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"
Sep 12 00:57:37.643343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.643270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerDied","Data":"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"}
Sep 12 00:57:37.643440 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.643347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj" event={"ID":"8416f533-5947-467a-910a-90a353394716","Type":"ContainerDied","Data":"a37e6fee1106ad0c37165efba1ec30e7de7b9b17ec3287f251cef9b365e8959f"}
Sep 12 00:57:37.643440 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.643370    2576 scope.go:117] "RemoveContainer" containerID="4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"
Sep 12 00:57:37.655367 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.655343    2576 scope.go:117] "RemoveContainer" containerID="9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"
Sep 12 00:57:37.664945 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.664926    2576 scope.go:117] "RemoveContainer" containerID="4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"
Sep 12 00:57:37.665259 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:57:37.665230    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2\": container with ID starting with 4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2 not found: ID does not exist" containerID="4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"
Sep 12 00:57:37.665339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.665261    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2"} err="failed to get container status \"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2\": rpc error: code = NotFound desc = could not find container \"4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2\": container with ID starting with 4af19be9635723ce7343d8d7981505aa18ca907987db26bacab40858c35277c2 not found: ID does not exist"
Sep 12 00:57:37.665339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.665307    2576 scope.go:117] "RemoveContainer" containerID="9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"
Sep 12 00:57:37.665624 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:57:37.665597    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095\": container with ID starting with 9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095 not found: ID does not exist" containerID="9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"
Sep 12 00:57:37.665684 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.665632    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095"} err="failed to get container status \"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095\": rpc error: code = NotFound desc = could not find container \"9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095\": container with ID starting with 9d8611a8fe1da1549b34e61f8f57d1da6cca8d730800517e62e3f9a5504ba095 not found: ID does not exist"
Sep 12 00:57:37.676375 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.676355    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:57:37.683126 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.683105    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f22962b3-gw-openshift-default-784cc4c5d8-bcbdj"]
Sep 12 00:57:37.839318 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:37.839199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:57:39.583447 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:39.583411    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8416f533-5947-467a-910a-90a353394716" path="/var/lib/kubelet/pods/8416f533-5947-467a-910a-90a353394716/volumes"
Sep 12 00:57:56.161038 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:56.161003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:57:58.786096 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.786058    2576 generic.go:356] "Generic (PLEG): container finished" podID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerID="ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c" exitCode=0
Sep 12 00:57:58.786525 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.786134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerDied","Data":"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"}
Sep 12 00:57:58.786621 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.786604    2576 scope.go:117] "RemoveContainer" containerID="ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"
Sep 12 00:57:58.787821 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.787789    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:58.787935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.787856    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:58.787935 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:58.787891    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:57:59.800011 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:59.799974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerStarted","Data":"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"}
Sep 12 00:57:59.934060 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:59.934032    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:57:59.934256 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:59.934235    2576 patch_prober.go:28] interesting pod/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:57:59.934327 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:57:59.934301    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 12 00:58:00.765551 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.765514    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"]
Sep 12 00:58:00.766005 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.765992    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:00.766055 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.766006    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:00.766103 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.766094    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:00.766139 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.766104    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:00.768303 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.768264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:00.771065 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.771042    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 00:58:00.771313 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.771295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 00:58:00.781774 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.781752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"]
Sep 12 00:58:00.893068 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.893021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq\" (UID: \"e740b940-7e48-4558-a2eb-14e2d7bf87fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:00.934179 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.934139    2576 patch_prober.go:28] interesting pod/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:58:00.934396 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.934204    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 12 00:58:00.994383 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.994340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq\" (UID: \"e740b940-7e48-4558-a2eb-14e2d7bf87fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:00.995636 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:00.995613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq\" (UID: \"e740b940-7e48-4558-a2eb-14e2d7bf87fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:01.085134 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.085031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:01.365613 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.365584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"]
Sep 12 00:58:01.366238 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:58:01.366214    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode740b940_7e48_4558_a2eb_14e2d7bf87fd.slice/crio-87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3 WatchSource:0}: Error finding container 87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3: Status 404 returned error can't find the container with id 87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3
Sep 12 00:58:01.831647 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.831610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq" event={"ID":"e740b940-7e48-4558-a2eb-14e2d7bf87fd","Type":"ContainerStarted","Data":"da70bfe9f933cfca80b8ba0dac871e78611344d83313a14e2fec5b649a704691"}
Sep 12 00:58:01.831809 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.831664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq" event={"ID":"e740b940-7e48-4558-a2eb-14e2d7bf87fd","Type":"ContainerStarted","Data":"87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3"}
Sep 12 00:58:01.853643 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.853598    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq" podStartSLOduration=1.853583043 podStartE2EDuration="1.853583043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:58:01.851064511 +0000 UTC m=+904.763743448" watchObservedRunningTime="2026-09-12 00:58:01.853583043 +0000 UTC m=+904.766261980"
Sep 12 00:58:01.933963 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.933930    2576 patch_prober.go:28] interesting pod/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:58:01.934381 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:01.933995    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 12 00:58:02.840506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:02.840471    2576 generic.go:356] "Generic (PLEG): container finished" podID="e740b940-7e48-4558-a2eb-14e2d7bf87fd" containerID="da70bfe9f933cfca80b8ba0dac871e78611344d83313a14e2fec5b649a704691" exitCode=0
Sep 12 00:58:02.840665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:02.840525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq" event={"ID":"e740b940-7e48-4558-a2eb-14e2d7bf87fd","Type":"ContainerDied","Data":"da70bfe9f933cfca80b8ba0dac871e78611344d83313a14e2fec5b649a704691"}
Sep 12 00:58:02.934676 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:02.934647    2576 patch_prober.go:28] interesting pod/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:58:02.935031 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:02.934702    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 12 00:58:03.934020 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:03.933988    2576 patch_prober.go:28] interesting pod/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 12 00:58:03.934172 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:03.934045    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 12 00:58:04.026686 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.026664    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:04.131135 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.131034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca\") pod \"e740b940-7e48-4558-a2eb-14e2d7bf87fd\" (UID: \"e740b940-7e48-4558-a2eb-14e2d7bf87fd\") "
Sep 12 00:58:04.131445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.131421    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e740b940-7e48-4558-a2eb-14e2d7bf87fd" (UID: "e740b940-7e48-4558-a2eb-14e2d7bf87fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:58:04.232270 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.232239    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e740b940-7e48-4558-a2eb-14e2d7bf87fd-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:04.857355 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.857319    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"
Sep 12 00:58:04.857576 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.857321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq" event={"ID":"e740b940-7e48-4558-a2eb-14e2d7bf87fd","Type":"ContainerDied","Data":"87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3"}
Sep 12 00:58:04.857576 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.857523    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87934eaf2f0fd56771ef1d02db0b3bba42dbdf8a8201fe9ce556803073ec3ec3"
Sep 12 00:58:04.967712 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.967679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:58:04.968091 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.968068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:58:04.969514 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:04.969498    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:58:07.254096 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:07.254057    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"]
Sep 12 00:58:07.258163 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:07.258136    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6e7edcc4-vp4fq"]
Sep 12 00:58:07.582722 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:07.582644    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e740b940-7e48-4558-a2eb-14e2d7bf87fd" path="/var/lib/kubelet/pods/e740b940-7e48-4558-a2eb-14e2d7bf87fd/volumes"
Sep 12 00:58:08.458736 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:08.458701    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:58:08.459137 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:08.458932    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy" containerID="cri-o://909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46" gracePeriod=30
Sep 12 00:58:09.193184 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.193152    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:09.193900 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.193882    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e740b940-7e48-4558-a2eb-14e2d7bf87fd" containerName="revoke-keys"
Sep 12 00:58:09.193958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.193906    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e740b940-7e48-4558-a2eb-14e2d7bf87fd" containerName="revoke-keys"
Sep 12 00:58:09.193958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.193943    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:09.193958 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.193951    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8416f533-5947-467a-910a-90a353394716" containerName="istio-proxy"
Sep 12 00:58:09.194074 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.194060    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e740b940-7e48-4558-a2eb-14e2d7bf87fd" containerName="revoke-keys"
Sep 12 00:58:09.196779 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.196752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.199834 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.199813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7c4848b5-openshift-default-dockercfg-ct4k2\""
Sep 12 00:58:09.212835 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.212812    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:09.288078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.287884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.287950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288078 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lfvk\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.288486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.288323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389173 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lfvk\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389591 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389591 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389591 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.389591 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.389946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390086 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.390002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390086 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.390011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390157 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.390132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.390520 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.390491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.391874 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.391853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.392157 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.392139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.397984 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.397964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.398121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.398105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lfvk\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk\") pod \"e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") " pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.508022 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.507932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:09.790887 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.790855    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:09.792050 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:58:09.792029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce7889e_7b9f_4600_913c_7fa43daa27ef.slice/crio-743d1fdadf26063e0099a557acac849273b21021a0f555a8f692717edbaae2b3 WatchSource:0}: Error finding container 743d1fdadf26063e0099a557acac849273b21021a0f555a8f692717edbaae2b3: Status 404 returned error can't find the container with id 743d1fdadf26063e0099a557acac849273b21021a0f555a8f692717edbaae2b3
Sep 12 00:58:09.794757 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.794723    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:09.794838 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.794788    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:09.794838 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.794815    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:09.891974 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.891941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerStarted","Data":"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"}
Sep 12 00:58:09.892157 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.891996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerStarted","Data":"743d1fdadf26063e0099a557acac849273b21021a0f555a8f692717edbaae2b3"}
Sep 12 00:58:09.916102 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:09.916027    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podStartSLOduration=0.916003557 podStartE2EDuration="916.003557ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:58:09.913003804 +0000 UTC m=+912.825682741" watchObservedRunningTime="2026-09-12 00:58:09.916003557 +0000 UTC m=+912.828682512"
Sep 12 00:58:10.508348 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:10.508318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:10.513623 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:10.513599    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:10.898939 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:10.898851    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:10.899804 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:10.899780    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:13.730864 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.730806    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:58:13.835872 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.835834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.835882    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.835903    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.835967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.835995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836075    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqptz\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert\") pod \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\" (UID: \"7471b2b1-0a88-4ed9-9783-71ed5ceaea65\") "
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:13.836380 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836262    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data" (OuterVolumeSpecName: "istio-data") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:13.836751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836632    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.836751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836652    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.836751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836666    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.836751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836681    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.836751 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.836693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:58:13.838369 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.838342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token" (OuterVolumeSpecName: "istio-token") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:58:13.838486 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.838467    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:13.838536 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.838479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:58:13.838653 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.838636    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz" (OuterVolumeSpecName: "kube-api-access-bqptz") pod "7471b2b1-0a88-4ed9-9783-71ed5ceaea65" (UID: "7471b2b1-0a88-4ed9-9783-71ed5ceaea65"). InnerVolumeSpecName "kube-api-access-bqptz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:58:13.919128 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.919095    2576 generic.go:356] "Generic (PLEG): container finished" podID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerID="909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46" exitCode=0
Sep 12 00:58:13.919333 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.919128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerDied","Data":"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"}
Sep 12 00:58:13.919333 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.919150    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"
Sep 12 00:58:13.919333 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.919188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx" event={"ID":"7471b2b1-0a88-4ed9-9783-71ed5ceaea65","Type":"ContainerDied","Data":"5e5221956a45927d7a72655d85f6b31079e36d3bfe5b3b6e2e15eaa71f4e2020"}
Sep 12 00:58:13.919333 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.919218    2576 scope.go:117] "RemoveContainer" containerID="909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"
Sep 12 00:58:13.929857 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.929842    2576 scope.go:117] "RemoveContainer" containerID="ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"
Sep 12 00:58:13.937579 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.937557    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqptz\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-kube-api-access-bqptz\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.937670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.937581    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.937670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.937592    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.937670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.937600    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.937670 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.937609    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7471b2b1-0a88-4ed9-9783-71ed5ceaea65-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:13.938965 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.938913    2576 scope.go:117] "RemoveContainer" containerID="909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"
Sep 12 00:58:13.939350 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:58:13.939304    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46\": container with ID starting with 909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46 not found: ID does not exist" containerID="909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"
Sep 12 00:58:13.939439 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.939358    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46"} err="failed to get container status \"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46\": rpc error: code = NotFound desc = could not find container \"909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46\": container with ID starting with 909bbb6ba22bf64f5792ddbba9f11293b5dccc3790ae53f1d81617194ee66b46 not found: ID does not exist"
Sep 12 00:58:13.939439 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.939377    2576 scope.go:117] "RemoveContainer" containerID="ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"
Sep 12 00:58:13.939641 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:58:13.939625    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c\": container with ID starting with ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c not found: ID does not exist" containerID="ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"
Sep 12 00:58:13.939684 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.939644    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c"} err="failed to get container status \"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c\": rpc error: code = NotFound desc = could not find container \"ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c\": container with ID starting with ca2c8a686675389eda6f16913e301b64796463e63ffc1e057ac624ed241ee53c not found: ID does not exist"
Sep 12 00:58:13.942026 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.942008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:58:13.952495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:13.947941    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6e7edcc4-openshift-default-7db989958b-pfxvx"]
Sep 12 00:58:15.582957 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:15.582923    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" path="/var/lib/kubelet/pods/7471b2b1-0a88-4ed9-9783-71ed5ceaea65/volumes"
Sep 12 00:58:18.269977 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:18.269939    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:58:30.039967 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.039930    2576 generic.go:356] "Generic (PLEG): container finished" podID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerID="17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891" exitCode=0
Sep 12 00:58:30.040419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.040000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerDied","Data":"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"}
Sep 12 00:58:30.040419 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.040411    2576 scope.go:117] "RemoveContainer" containerID="17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"
Sep 12 00:58:30.041558 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.041531    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:30.041616 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.041603    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:30.041649 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:30.041636    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 00:58:31.049058 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:31.049024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerStarted","Data":"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"}
Sep 12 00:58:31.508559 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:31.508524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:31.508777 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:31.508753    2576 patch_prober.go:28] interesting pod/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:58:31.508831 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:31.508808    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 12 00:58:32.508678 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:32.508637    2576 patch_prober.go:28] interesting pod/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:58:32.509077 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:32.508696    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 12 00:58:33.508438 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:33.508399    2576 patch_prober.go:28] interesting pod/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:58:33.508631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:33.508481    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 12 00:58:34.508697 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:34.508661    2576 patch_prober.go:28] interesting pod/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:58:34.509100 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:34.508721    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 12 00:58:35.249388 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249353    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 00:58:35.249849 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249835    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.249899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.249899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249860    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.249899 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249865    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.249993 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249955    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.249993 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.249967    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7471b2b1-0a88-4ed9-9783-71ed5ceaea65" containerName="istio-proxy"
Sep 12 00:58:35.252179 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.252165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.255385 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.255363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5cee89\"/\"default-dockercfg-9mpsb\""
Sep 12 00:58:35.255513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.255384    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5cee89\"/\"kube-root-ca.crt\""
Sep 12 00:58:35.255513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.255366    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5cee89\"/\"openshift-service-ca.crt\""
Sep 12 00:58:35.255513 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.255363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5cee89\"/\"test-model-5cee89-kserve-self-signed-certs\""
Sep 12 00:58:35.262178 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.262157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 00:58:35.351038 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq7cx\" (UniqueName: \"kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.351213 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.351213 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.351213 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.351213 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.351407 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.351263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451799 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq7cx\" (UniqueName: \"kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.451982 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.451981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.452339 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.452263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.452432 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.452364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.452507 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.452423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.454312 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.454262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.454447 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.454431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.459741 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.459718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq7cx\" (UniqueName: \"kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx\") pod \"test-model-5cee89-kserve-84bbcdbd75-p7vjt\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") " pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.509004 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.508920    2576 patch_prober.go:28] interesting pod/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 12 00:58:35.509004 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.508976    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 12 00:58:35.562909 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.562873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:35.870150 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:35.870115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 00:58:35.871099 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:58:35.871072    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58bfb66e_5d70_4a86_8c80_6dfb90f92307.slice/crio-d9ab8de9b9ff8ad89fda49a569df35570a7aeedb54c29dea5a4ed599a4878411 WatchSource:0}: Error finding container d9ab8de9b9ff8ad89fda49a569df35570a7aeedb54c29dea5a4ed599a4878411: Status 404 returned error can't find the container with id d9ab8de9b9ff8ad89fda49a569df35570a7aeedb54c29dea5a4ed599a4878411
Sep 12 00:58:36.087121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.087030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" event={"ID":"58bfb66e-5d70-4a86-8c80-6dfb90f92307","Type":"ContainerStarted","Data":"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"}
Sep 12 00:58:36.087121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.087079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" event={"ID":"58bfb66e-5d70-4a86-8c80-6dfb90f92307","Type":"ContainerStarted","Data":"d9ab8de9b9ff8ad89fda49a569df35570a7aeedb54c29dea5a4ed599a4878411"}
Sep 12 00:58:36.109760 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.109705    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" podStartSLOduration=1.109690536 podStartE2EDuration="1.109690536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:58:36.108201329 +0000 UTC m=+939.020880278" watchObservedRunningTime="2026-09-12 00:58:36.109690536 +0000 UTC m=+939.022369472"
Sep 12 00:58:36.153067 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.153029    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"]
Sep 12 00:58:36.155842 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.155822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:36.158242 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.158220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 00:58:36.158445 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.158429    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 00:58:36.165235 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.165214    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"]
Sep 12 00:58:36.261594 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.261551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45\" (UID: \"1cc931c1-cfa9-469a-81b7-c9257ab80bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:36.362963 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.362870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45\" (UID: \"1cc931c1-cfa9-469a-81b7-c9257ab80bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:36.363612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.363587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45\" (UID: \"1cc931c1-cfa9-469a-81b7-c9257ab80bb0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:36.468040 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.468012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:36.513130 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.513096    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:36.513557 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.513537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:36.514146 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.514124    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:36.743117 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:36.743090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"]
Sep 12 00:58:36.744600 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:58:36.744576    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc931c1_cfa9_469a_81b7_c9257ab80bb0.slice/crio-315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8 WatchSource:0}: Error finding container 315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8: Status 404 returned error can't find the container with id 315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8
Sep 12 00:58:37.095428 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:37.095398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45" event={"ID":"1cc931c1-cfa9-469a-81b7-c9257ab80bb0","Type":"ContainerStarted","Data":"7ec88a84af11d302c8f0d608e263c9345e35e7a9a5b62560f95c908ce143bb0d"}
Sep 12 00:58:37.095559 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:37.095456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45" event={"ID":"1cc931c1-cfa9-469a-81b7-c9257ab80bb0","Type":"ContainerStarted","Data":"315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8"}
Sep 12 00:58:37.111809 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:37.111764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45" podStartSLOduration=1.111748921 podStartE2EDuration="1.111748921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:58:37.110415149 +0000 UTC m=+940.023094085" watchObservedRunningTime="2026-09-12 00:58:37.111748921 +0000 UTC m=+940.024427858"
Sep 12 00:58:38.103482 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:38.103452    2576 generic.go:356] "Generic (PLEG): container finished" podID="1cc931c1-cfa9-469a-81b7-c9257ab80bb0" containerID="7ec88a84af11d302c8f0d608e263c9345e35e7a9a5b62560f95c908ce143bb0d" exitCode=0
Sep 12 00:58:38.103865 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:38.103544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45" event={"ID":"1cc931c1-cfa9-469a-81b7-c9257ab80bb0","Type":"ContainerDied","Data":"7ec88a84af11d302c8f0d608e263c9345e35e7a9a5b62560f95c908ce143bb0d"}
Sep 12 00:58:39.251333 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:39.251303    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:39.401230 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:39.401145    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca\") pod \"1cc931c1-cfa9-469a-81b7-c9257ab80bb0\" (UID: \"1cc931c1-cfa9-469a-81b7-c9257ab80bb0\") "
Sep 12 00:58:39.401502 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:39.401478    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1cc931c1-cfa9-469a-81b7-c9257ab80bb0" (UID: "1cc931c1-cfa9-469a-81b7-c9257ab80bb0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:58:39.502510 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:39.502473    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cc931c1-cfa9-469a-81b7-c9257ab80bb0-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:40.117458 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:40.117419    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"
Sep 12 00:58:40.117631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:40.117453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45" event={"ID":"1cc931c1-cfa9-469a-81b7-c9257ab80bb0","Type":"ContainerDied","Data":"315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8"}
Sep 12 00:58:40.117631 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:40.117502    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="315f7a2b374e3f029830c7d1499c1c7c2d5d3b368645b34993972141fde9edf8"
Sep 12 00:58:40.674006 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:40.673969    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:58:43.508438 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:43.508404    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"]
Sep 12 00:58:43.513082 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:43.513055    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7c4848b5-lrl45"]
Sep 12 00:58:43.582149 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:43.582119    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc931c1-cfa9-469a-81b7-c9257ab80bb0" path="/var/lib/kubelet/pods/1cc931c1-cfa9-469a-81b7-c9257ab80bb0/volumes"
Sep 12 00:58:43.641247 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:43.641213    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:43.641463 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:43.641431    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy" containerID="cri-o://7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd" gracePeriod=30
Sep 12 00:58:45.563147 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:45.563113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:45.563557 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:45.563163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:45.583064 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:45.583035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:46.169404 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:46.169374    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 00:58:48.898943 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:48.898921    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:49.001795 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.001760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.001966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.001821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.001966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.001848    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.001966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.001935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lfvk\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002111 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.001991    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002173 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002139    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002225 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002219    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:49.002320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002235    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:49.002320 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs\") pod \"dce7889e-7b9f-4600-913c-7fa43daa27ef\" (UID: \"dce7889e-7b9f-4600-913c-7fa43daa27ef\") "
Sep 12 00:58:49.002564 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:49.002564 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:58:49.002838 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.002675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:49.003091 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.003066    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.003167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.003097    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dce7889e-7b9f-4600-913c-7fa43daa27ef-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.003167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.003113    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.003167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.003127    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.003167 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.003141    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.004389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.004340    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk" (OuterVolumeSpecName: "kube-api-access-5lfvk") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "kube-api-access-5lfvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:58:49.004389 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.004360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:58:49.004734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.004708    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:58:49.004734 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.004718    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "dce7889e-7b9f-4600-913c-7fa43daa27ef" (UID: "dce7889e-7b9f-4600-913c-7fa43daa27ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:58:49.104051 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.104020    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lfvk\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-kube-api-access-5lfvk\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.104051 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.104047    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.104051 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.104056    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.104264 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.104065    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dce7889e-7b9f-4600-913c-7fa43daa27ef-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:58:49.180800 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.180770    2576 generic.go:356] "Generic (PLEG): container finished" podID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerID="7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd" exitCode=0
Sep 12 00:58:49.180947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.180819    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"
Sep 12 00:58:49.180947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.180827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerDied","Data":"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"}
Sep 12 00:58:49.180947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.180874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q" event={"ID":"dce7889e-7b9f-4600-913c-7fa43daa27ef","Type":"ContainerDied","Data":"743d1fdadf26063e0099a557acac849273b21021a0f555a8f692717edbaae2b3"}
Sep 12 00:58:49.180947 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.180896    2576 scope.go:117] "RemoveContainer" containerID="7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"
Sep 12 00:58:49.191665 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.191649    2576 scope.go:117] "RemoveContainer" containerID="17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"
Sep 12 00:58:49.201312 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.201261    2576 scope.go:117] "RemoveContainer" containerID="7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"
Sep 12 00:58:49.201575 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:58:49.201556    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd\": container with ID starting with 7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd not found: ID does not exist" containerID="7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"
Sep 12 00:58:49.201662 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.201588    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd"} err="failed to get container status \"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd\": rpc error: code = NotFound desc = could not find container \"7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd\": container with ID starting with 7f15420f30b9fd46e63926164f9e7d5fa9f27a999cbb56f28c9bd633c552d8bd not found: ID does not exist"
Sep 12 00:58:49.201662 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.201612    2576 scope.go:117] "RemoveContainer" containerID="17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"
Sep 12 00:58:49.201920 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:58:49.201901    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891\": container with ID starting with 17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891 not found: ID does not exist" containerID="17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"
Sep 12 00:58:49.201966 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.201926    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891"} err="failed to get container status \"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891\": rpc error: code = NotFound desc = could not find container \"17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891\": container with ID starting with 17d9d1c6e853fb5ba902342e575190e1541b887caab1ab4070f7fd61d984b891 not found: ID does not exist"
Sep 12 00:58:49.203425 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.203404    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:49.208168 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.208147    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7c4848b5-openshift-default-58fcf8db64-ttj9q"]
Sep 12 00:58:49.585841 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:58:49.585807    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" path="/var/lib/kubelet/pods/dce7889e-7b9f-4600-913c-7fa43daa27ef/volumes"
Sep 12 00:59:02.260308 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:02.260262    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:59:32.662563 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:32.662479    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 00:59:39.891967 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:39.891934    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:59:39.892495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:39.892134    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy" containerID="cri-o://fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc" gracePeriod=30
Sep 12 00:59:45.152978 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.152950    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:59:45.289439 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289407    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289620 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289620 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fgm6\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289620 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289620 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289623    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289851 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289792    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289969 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289873    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:45.289969 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:45.289969 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.289969 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.289923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert\") pod \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\" (UID: \"9360adb3-0911-4f6c-b0d4-bc3d7b563e00\") "
Sep 12 00:59:45.290343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290034    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data" (OuterVolumeSpecName: "istio-data") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:45.290343 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290070    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:45.290471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290369    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 00:59:45.290471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290437    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.290471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290456    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.290471 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290469    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.290691 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.290484    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.291867 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.291844    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 00:59:45.292000 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.291977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 00:59:45.292065 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.292000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6" (OuterVolumeSpecName: "kube-api-access-7fgm6") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "kube-api-access-7fgm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:45.292105 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.292056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token" (OuterVolumeSpecName: "istio-token") pod "9360adb3-0911-4f6c-b0d4-bc3d7b563e00" (UID: "9360adb3-0911-4f6c-b0d4-bc3d7b563e00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 00:59:45.391936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.391903    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.391936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.391932    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.391936 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.391940    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.392156 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.391950    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.392156 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.391958    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fgm6\" (UniqueName: \"kubernetes.io/projected/9360adb3-0911-4f6c-b0d4-bc3d7b563e00-kube-api-access-7fgm6\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 00:59:45.557569 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.557477    2576 generic.go:356] "Generic (PLEG): container finished" podID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerID="fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc" exitCode=0
Sep 12 00:59:45.557569 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.557533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"
Sep 12 00:59:45.557744 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.557565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerDied","Data":"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"}
Sep 12 00:59:45.557744 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.557623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb" event={"ID":"9360adb3-0911-4f6c-b0d4-bc3d7b563e00","Type":"ContainerDied","Data":"cb8306b4efb30eedd5e1aef5f05459770a4d30e648c4b8986c6303f24483d4ec"}
Sep 12 00:59:45.557744 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.557644    2576 scope.go:117] "RemoveContainer" containerID="fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"
Sep 12 00:59:45.568324 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.568306    2576 scope.go:117] "RemoveContainer" containerID="2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"
Sep 12 00:59:45.577894 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.577879    2576 scope.go:117] "RemoveContainer" containerID="fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"
Sep 12 00:59:45.578172 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:59:45.578150    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc\": container with ID starting with fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc not found: ID does not exist" containerID="fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"
Sep 12 00:59:45.578262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.578179    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc"} err="failed to get container status \"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc\": rpc error: code = NotFound desc = could not find container \"fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc\": container with ID starting with fb50a2fb9c7e29f121833fc655522a7e3cd2c204786f0c5f6f7c83c6439a70dc not found: ID does not exist"
Sep 12 00:59:45.578262 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.578194    2576 scope.go:117] "RemoveContainer" containerID="2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"
Sep 12 00:59:45.578440 ip-10-0-142-242 kubenswrapper[2576]: E0912 00:59:45.578416    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf\": container with ID starting with 2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf not found: ID does not exist" containerID="2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"
Sep 12 00:59:45.578495 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.578448    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf"} err="failed to get container status \"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf\": rpc error: code = NotFound desc = could not find container \"2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf\": container with ID starting with 2996ef7ae6b3781cbea39438dfcaa902b838340619e40ab1ef3ea0692cbf20bf not found: ID does not exist"
Sep 12 00:59:45.583852 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.583810    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:59:45.586612 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:45.586593    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-64f698-openshift-default-69c89b5ccb-qpzhb"]
Sep 12 00:59:46.437476 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.437442    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 00:59:46.438182 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438159    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc931c1-cfa9-469a-81b7-c9257ab80bb0" containerName="revoke-keys"
Sep 12 00:59:46.438259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438189    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc931c1-cfa9-469a-81b7-c9257ab80bb0" containerName="revoke-keys"
Sep 12 00:59:46.438259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438225    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438234    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438249    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438259 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438258    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438290    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438318    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438327    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438439    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438454    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438466    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438479    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce7889e-7b9f-4600-913c-7fa43daa27ef" containerName="istio-proxy"
Sep 12 00:59:46.438535 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.438490    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc931c1-cfa9-469a-81b7-c9257ab80bb0" containerName="revoke-keys"
Sep 12 00:59:46.443633 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.443615    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.446301 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.446262    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bf547a\"/\"kube-root-ca.crt\""
Sep 12 00:59:46.447201 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.447179    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-bf547a\"/\"openshift-service-ca.crt\""
Sep 12 00:59:46.447634 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.447315    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bf547a\"/\"test-model-bf547a-kserve-self-signed-certs\""
Sep 12 00:59:46.447768 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.447342    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-bf547a\"/\"default-dockercfg-ht6cp\""
Sep 12 00:59:46.452478 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.452455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 00:59:46.501923 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.501890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.502121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.501950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.502121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.502031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.502121 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.502089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.502346 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.502122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdzf\" (UniqueName: \"kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.502346 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.502170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603111 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603302 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603302 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603302 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603473 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603473 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdzf\" (UniqueName: \"kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603658 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603658 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.603777 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.603677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.605714 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.605692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.605811 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.605782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.611234 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.611206    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdzf\" (UniqueName: \"kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf\") pod \"test-model-bf547a-kserve-8669d45df9-svvqw\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") " pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:46.754999 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:46.754911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:47.070391 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:47.070364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 00:59:47.071799 ip-10-0-142-242 kubenswrapper[2576]: W0912 00:59:47.071761    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd87dc48_d2f8_488a_ad9b_ee55cfc57106.slice/crio-c316addd0ff00ba23c77ea87aacf7489c4d75e30021c3f0ed8b1298373c00acf WatchSource:0}: Error finding container c316addd0ff00ba23c77ea87aacf7489c4d75e30021c3f0ed8b1298373c00acf: Status 404 returned error can't find the container with id c316addd0ff00ba23c77ea87aacf7489c4d75e30021c3f0ed8b1298373c00acf
Sep 12 00:59:47.573976 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:47.573937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" event={"ID":"fd87dc48-d2f8-488a-ad9b-ee55cfc57106","Type":"ContainerStarted","Data":"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"}
Sep 12 00:59:47.574474 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:47.573985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" event={"ID":"fd87dc48-d2f8-488a-ad9b-ee55cfc57106","Type":"ContainerStarted","Data":"c316addd0ff00ba23c77ea87aacf7489c4d75e30021c3f0ed8b1298373c00acf"}
Sep 12 00:59:47.583103 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:47.583077    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9360adb3-0911-4f6c-b0d4-bc3d7b563e00" path="/var/lib/kubelet/pods/9360adb3-0911-4f6c-b0d4-bc3d7b563e00/volumes"
Sep 12 00:59:47.594506 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:47.594459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" podStartSLOduration=1.59444473 podStartE2EDuration="1.59444473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 00:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 00:59:47.591557317 +0000 UTC m=+1010.504236271" watchObservedRunningTime="2026-09-12 00:59:47.59444473 +0000 UTC m=+1010.507123706"
Sep 12 00:59:56.755991 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:56.755958    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:56.756497 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:56.756298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:56.768561 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:56.768540    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:57.646341 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:57.646311    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 00:59:59.262483 ip-10-0-142-242 kubenswrapper[2576]: I0912 00:59:59.262450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:00:00.146099 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.146060    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"]
Sep 12 01:00:00.151871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.151837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"
Sep 12 01:00:00.153821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.153795    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"]
Sep 12 01:00:00.155881 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.155677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:00:00.158607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.158578    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"]
Sep 12 01:00:00.158732 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.158693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"
Sep 12 01:00:00.163775 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.162809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"]
Sep 12 01:00:00.163775 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.162890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"
Sep 12 01:00:00.172334 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.172311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"
Sep 12 01:00:00.176508 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.176481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"]
Sep 12 01:00:00.181771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.181748    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"]
Sep 12 01:00:00.210949 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.210746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"
Sep 12 01:00:00.220704 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.220651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"
Sep 12 01:00:00.472537 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.472501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"]
Sep 12 01:00:00.472944 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:00.472790    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13fe5ed_a8d5_42c3_b56f_4bcfe6c90e2a.slice/crio-6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d WatchSource:0}: Error finding container 6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d: Status 404 returned error can't find the container with id 6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d
Sep 12 01:00:00.535497 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.535382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"]
Sep 12 01:00:00.536418 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:00.536392    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5293255f_4232_4b70_b6b7_9e3c4c184794.slice/crio-4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f WatchSource:0}: Error finding container 4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f: Status 404 returned error can't find the container with id 4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f
Sep 12 01:00:00.539471 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.539424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"]
Sep 12 01:00:00.540298 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:00.540248    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607814fa_0757_409f_b945_7db0f501fccf.slice/crio-80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758 WatchSource:0}: Error finding container 80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758: Status 404 returned error can't find the container with id 80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758
Sep 12 01:00:00.655842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.655806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv" event={"ID":"607814fa-0757-409f-b945-7db0f501fccf","Type":"ContainerStarted","Data":"80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758"}
Sep 12 01:00:00.657169 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.657136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8" event={"ID":"f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a","Type":"ContainerStarted","Data":"6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d"}
Sep 12 01:00:00.658518 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:00.658494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj" event={"ID":"5293255f-4232-4b70-b6b7-9e3c4c184794","Type":"ContainerStarted","Data":"4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f"}
Sep 12 01:00:01.670340 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.670302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj" event={"ID":"5293255f-4232-4b70-b6b7-9e3c4c184794","Type":"ContainerStarted","Data":"3f11ba7d1281ce1c4ba88fe6b7c70aa67ed82d4c7da688c051dde888ae8bc2c8"}
Sep 12 01:00:01.675670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.672431    2576 generic.go:356] "Generic (PLEG): container finished" podID="607814fa-0757-409f-b945-7db0f501fccf" containerID="ea2f2d2fe8ad6dc29b17a87fc53c8460f4ade9b30d261984b61483956fa39992" exitCode=0
Sep 12 01:00:01.675670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.672606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv" event={"ID":"607814fa-0757-409f-b945-7db0f501fccf","Type":"ContainerDied","Data":"ea2f2d2fe8ad6dc29b17a87fc53c8460f4ade9b30d261984b61483956fa39992"}
Sep 12 01:00:01.681722 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.681687    2576 generic.go:356] "Generic (PLEG): container finished" podID="f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a" containerID="cc7f5f6ad19c0d76d8ed197a66bb212c39225050b426e6c243732d2455851fce" exitCode=0
Sep 12 01:00:01.681864 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.681749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8" event={"ID":"f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a","Type":"ContainerDied","Data":"cc7f5f6ad19c0d76d8ed197a66bb212c39225050b426e6c243732d2455851fce"}
Sep 12 01:00:01.690100 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:01.690055    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj" podStartSLOduration=1.690040789 podStartE2EDuration="1.690040789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:00:01.686163479 +0000 UTC m=+1024.598842416" watchObservedRunningTime="2026-09-12 01:00:01.690040789 +0000 UTC m=+1024.602719722"
Sep 12 01:00:02.690215 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:02.690180    2576 generic.go:356] "Generic (PLEG): container finished" podID="5293255f-4232-4b70-b6b7-9e3c4c184794" containerID="3f11ba7d1281ce1c4ba88fe6b7c70aa67ed82d4c7da688c051dde888ae8bc2c8" exitCode=0
Sep 12 01:00:02.690673 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:02.690269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj" event={"ID":"5293255f-4232-4b70-b6b7-9e3c4c184794","Type":"ContainerDied","Data":"3f11ba7d1281ce1c4ba88fe6b7c70aa67ed82d4c7da688c051dde888ae8bc2c8"}
Sep 12 01:00:02.865044 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:02.865017    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"
Sep 12 01:00:02.868677 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:02.868655    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"
Sep 12 01:00:03.698354 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.698326    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"
Sep 12 01:00:03.698720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.698371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8" event={"ID":"f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a","Type":"ContainerDied","Data":"6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d"}
Sep 12 01:00:03.698720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.698421    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a11e1e100f6938e698d4dff4024c510bcfd49ec362a42694600001a5294588d"
Sep 12 01:00:03.699845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.699818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv" event={"ID":"607814fa-0757-409f-b945-7db0f501fccf","Type":"ContainerDied","Data":"80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758"}
Sep 12 01:00:03.699845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.699842    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"
Sep 12 01:00:03.700042 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.699873    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80b931cb47a2bc29110e21bb64c07ea39f2ee86cb6fd60a74c267b875f2ea758"
Sep 12 01:00:03.838323 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:03.838302    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"
Sep 12 01:00:04.707921 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:04.707891    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"
Sep 12 01:00:04.707921 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:04.707917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj" event={"ID":"5293255f-4232-4b70-b6b7-9e3c4c184794","Type":"ContainerDied","Data":"4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f"}
Sep 12 01:00:04.708372 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:04.707966    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b57b15ce7cee520be3b16f003799929862a5da31c08c1e2d712c2f33daaeb1f"
Sep 12 01:00:21.589352 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589765    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607814fa-0757-409f-b945-7db0f501fccf" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589775    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="607814fa-0757-409f-b945-7db0f501fccf" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589787    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589792    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589810    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5293255f-4232-4b70-b6b7-9e3c4c184794" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589816    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5293255f-4232-4b70-b6b7-9e3c4c184794" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589883    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="607814fa-0757-409f-b945-7db0f501fccf" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589891    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a" containerName="cleanup"
Sep 12 01:00:21.589916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.589900    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5293255f-4232-4b70-b6b7-9e3c4c184794" containerName="cleanup"
Sep 12 01:00:21.593538 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.593518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.596236 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.596217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9eca3408-openshift-default-dockercfg-jvvwl\""
Sep 12 01:00:21.609473 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.609449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:00:21.682561 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682758 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682758 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stsgm\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682758 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682758 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682995 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682995 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682995 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.682995 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.682963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.783712 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.783672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.783900 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.783742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.783900 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.783794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stsgm\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784021 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.783955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784021 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784137 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784217 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784367 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784463 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784532 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.784887 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.785081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.784988    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.786705 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.786674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.787036 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.787013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.792434 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.792408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.793243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.793221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stsgm\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm\") pod \"e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") " pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:21.904408 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:21.904382    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:22.216339 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:22.216305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11376103_4eee_4125_a34f_338f718f1d0f.slice/crio-7f44f4c0d10e5c0fb129c90f7ec5400532c093dfc1ce9e953a8f30394cf0efd5 WatchSource:0}: Error finding container 7f44f4c0d10e5c0fb129c90f7ec5400532c093dfc1ce9e953a8f30394cf0efd5: Status 404 returned error can't find the container with id 7f44f4c0d10e5c0fb129c90f7ec5400532c093dfc1ce9e953a8f30394cf0efd5
Sep 12 01:00:22.218684 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.218646    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:22.218810 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.218734    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:22.218810 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.218778    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:22.227374 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.227351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:00:22.825849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.825817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerStarted","Data":"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"}
Sep 12 01:00:22.826398 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.825877    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerStarted","Data":"7f44f4c0d10e5c0fb129c90f7ec5400532c093dfc1ce9e953a8f30394cf0efd5"}
Sep 12 01:00:22.849343 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.849291    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podStartSLOduration=1.849257867 podStartE2EDuration="1.849257867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:00:22.847634128 +0000 UTC m=+1045.760313084" watchObservedRunningTime="2026-09-12 01:00:22.849257867 +0000 UTC m=+1045.761936805"
Sep 12 01:00:22.904688 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:22.904650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:23.910410 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:23.910384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:24.839829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:24.839796    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:24.840683 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:24.840667    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:30.259533 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:30.259499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:00:33.065931 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.065899    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:00:33.070796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.070779    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.073442 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.073417    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9eca3408-dockercfg-cxznx\""
Sep 12 01:00:33.073777 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.073753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9eca3408\""
Sep 12 01:00:33.083429 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.083408    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:00:33.207545 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.207505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.207768 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.207596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmbzb\" (UniqueName: \"kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.308424 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.308388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.308424 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.308431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmbzb\" (UniqueName: \"kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.309092 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.309070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.316979 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.316920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmbzb\" (UniqueName: \"kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb\") pod \"payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.383431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.383407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.659346 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.659317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:00:33.660289 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:33.660252    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9529a99_d240_4b2c_8fa7_ef2906bd0d09.slice/crio-7608cd9799ef089316b7642062fba140ae04432279f5e7920d6272a62b9286c9 WatchSource:0}: Error finding container 7608cd9799ef089316b7642062fba140ae04432279f5e7920d6272a62b9286c9: Status 404 returned error can't find the container with id 7608cd9799ef089316b7642062fba140ae04432279f5e7920d6272a62b9286c9
Sep 12 01:00:33.913144 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.913054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" event={"ID":"e9529a99-d240-4b2c-8fa7-ef2906bd0d09","Type":"ContainerStarted","Data":"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"}
Sep 12 01:00:33.913144 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.913119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" event={"ID":"e9529a99-d240-4b2c-8fa7-ef2906bd0d09","Type":"ContainerStarted","Data":"7608cd9799ef089316b7642062fba140ae04432279f5e7920d6272a62b9286c9"}
Sep 12 01:00:33.913373 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.913154    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:33.931109 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:33.931057    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" podStartSLOduration=0.931042861 podStartE2EDuration="931.042861ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:00:33.928451683 +0000 UTC m=+1056.841130631" watchObservedRunningTime="2026-09-12 01:00:33.931042861 +0000 UTC m=+1056.843721798"
Sep 12 01:00:44.929139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:44.929107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:00:55.881495 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:55.881452    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 01:00:55.881912 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:55.881526    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 01:00:56.621790 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.621752    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:00:56.625606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.625582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.628097 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.628077    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-8a4fbb\"/\"kube-root-ca.crt\""
Sep 12 01:00:56.628869 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.628847    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-8a4fbb\"/\"explicit-model-8a4fbb-kserve-self-signed-certs\""
Sep 12 01:00:56.628984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.628878    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-8a4fbb\"/\"default-dockercfg-v8j29\""
Sep 12 01:00:56.628984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.628878    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-8a4fbb\"/\"openshift-service-ca.crt\""
Sep 12 01:00:56.638200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.638177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:00:56.754384 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.754384 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.754581 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spvj\" (UniqueName: \"kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.754581 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.754655 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.754655 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.754634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855495 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855693 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855693 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855813 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855813 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spvj\" (UniqueName: \"kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.855924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.855831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.856079 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.856057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.856200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.856132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.856436 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.856398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.857941 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.857919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.858256 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.858237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.864710 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.864691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spvj\" (UniqueName: \"kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj\") pod \"explicit-model-8a4fbb-kserve-655c4b9c87-r76wb\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") " pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:56.941056 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:56.941023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:00:57.218366 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:57.218341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:00:57.219029 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:00:57.219003    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda6621c9_7415_423c_a479_e5e675d9e686.slice/crio-5b1bac64b4683818ee812871d58dfff905fb06f88bd2c36c1c96e2ad8801fcef WatchSource:0}: Error finding container 5b1bac64b4683818ee812871d58dfff905fb06f88bd2c36c1c96e2ad8801fcef: Status 404 returned error can't find the container with id 5b1bac64b4683818ee812871d58dfff905fb06f88bd2c36c1c96e2ad8801fcef
Sep 12 01:00:58.088491 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.088413    2576 generic.go:356] "Generic (PLEG): container finished" podID="11376103-4eee-4125-a34f-338f718f1d0f" containerID="4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213" exitCode=0
Sep 12 01:00:58.088934 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.088488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerDied","Data":"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"}
Sep 12 01:00:58.089005 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.088952    2576 scope.go:117] "RemoveContainer" containerID="4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"
Sep 12 01:00:58.090314 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.090268    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:58.090418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.090353    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:58.090418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.090384    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:00:58.090418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.090399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" event={"ID":"da6621c9-7415-423c-a479-e5e675d9e686","Type":"ContainerStarted","Data":"f103a0839c75ab26d60c268db063b3bd3cdd05d1bfa5e006f2c4a824369c21ac"}
Sep 12 01:00:58.090534 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:58.090431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" event={"ID":"da6621c9-7415-423c-a479-e5e675d9e686","Type":"ContainerStarted","Data":"5b1bac64b4683818ee812871d58dfff905fb06f88bd2c36c1c96e2ad8801fcef"}
Sep 12 01:00:59.102357 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:59.102316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerStarted","Data":"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"}
Sep 12 01:00:59.125780 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:59.125733    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" podStartSLOduration=3.125716889 podStartE2EDuration="3.125716889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:00:58.131879649 +0000 UTC m=+1081.044558612" watchObservedRunningTime="2026-09-12 01:00:59.125716889 +0000 UTC m=+1082.038395826"
Sep 12 01:00:59.905114 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:59.905080    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:00:59.905358 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:59.905335    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 12 01:00:59.905459 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:00:59.905404    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 12 01:01:00.904896 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:00.904850    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 12 01:01:00.905307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:00.904919    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 12 01:01:01.905517 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:01.905478    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 12 01:01:01.905908 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:01.905537    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 12 01:01:02.904922 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:02.904878    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 12 01:01:02.905141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:02.904938    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 12 01:01:03.905569 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:03.905529    2576 patch_prober.go:28] interesting pod/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 12 01:01:03.906013 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:03.905596    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 12 01:01:04.772306 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:04.772260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:01:04.908734 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:04.908703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:01:04.909159 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:04.909104    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:01:04.909860 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:04.909838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:01:05.099873 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.099794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"]
Sep 12 01:01:05.104174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.104140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:05.107603 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.107334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:01:05.107603 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.107425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:01:05.109674 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.109645    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"]
Sep 12 01:01:05.249388 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.249346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9eca3408-dvszh\" (UID: \"02ead617-f474-468a-94fd-d06dd4e8217d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:05.350530 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.350454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9eca3408-dvszh\" (UID: \"02ead617-f474-468a-94fd-d06dd4e8217d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:05.351070 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.351050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9eca3408-dvszh\" (UID: \"02ead617-f474-468a-94fd-d06dd4e8217d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:05.418136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.418101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:05.692413 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:05.692384    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"]
Sep 12 01:01:05.693130 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:01:05.693106    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ead617_f474_468a_94fd_d06dd4e8217d.slice/crio-6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f WatchSource:0}: Error finding container 6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f: Status 404 returned error can't find the container with id 6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f
Sep 12 01:01:06.152791 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.152744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh" event={"ID":"02ead617-f474-468a-94fd-d06dd4e8217d","Type":"ContainerStarted","Data":"b0753d15456bb80df6065cabe8e52313869a3081680e2c31e8607ef4b4ae463b"}
Sep 12 01:01:06.153257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.152816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh" event={"ID":"02ead617-f474-468a-94fd-d06dd4e8217d","Type":"ContainerStarted","Data":"6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f"}
Sep 12 01:01:06.176598 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.176544    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh" podStartSLOduration=1.176525765 podStartE2EDuration="1.176525765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:01:06.173353897 +0000 UTC m=+1089.086032858" watchObservedRunningTime="2026-09-12 01:01:06.176525765 +0000 UTC m=+1089.089204703"
Sep 12 01:01:06.941620 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.941588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:06.941894 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.941872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:06.954426 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:06.954402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:07.161143 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:07.161112    2576 generic.go:356] "Generic (PLEG): container finished" podID="02ead617-f474-468a-94fd-d06dd4e8217d" containerID="b0753d15456bb80df6065cabe8e52313869a3081680e2c31e8607ef4b4ae463b" exitCode=0
Sep 12 01:01:07.161534 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:07.161204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh" event={"ID":"02ead617-f474-468a-94fd-d06dd4e8217d","Type":"ContainerDied","Data":"b0753d15456bb80df6065cabe8e52313869a3081680e2c31e8607ef4b4ae463b"}
Sep 12 01:01:07.173482 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:07.173454    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:08.324054 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:08.324029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:08.384083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:08.384046    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca\") pod \"02ead617-f474-468a-94fd-d06dd4e8217d\" (UID: \"02ead617-f474-468a-94fd-d06dd4e8217d\") "
Sep 12 01:01:08.384436 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:08.384414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02ead617-f474-468a-94fd-d06dd4e8217d" (UID: "02ead617-f474-468a-94fd-d06dd4e8217d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:01:08.484989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:08.484904    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02ead617-f474-468a-94fd-d06dd4e8217d-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:09.175782 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:09.175746    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"
Sep 12 01:01:09.175782 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:09.175778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh" event={"ID":"02ead617-f474-468a-94fd-d06dd4e8217d","Type":"ContainerDied","Data":"6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f"}
Sep 12 01:01:09.176001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:09.175828    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c5b4b705846c5db52d577274ddedc01d99177ca97244ff95b756416f61fdc7f"
Sep 12 01:01:15.665591 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.665551    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:01:15.666025 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.665839    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" podUID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" containerName="payload-pre-processing" containerID="cri-o://9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4" gracePeriod=30
Sep 12 01:01:15.830061 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.830022    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"]
Sep 12 01:01:15.833044 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.833017    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9eca3408-dvszh"]
Sep 12 01:01:15.932584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.932516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:01:15.963212 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.963187    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume\") pod \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") "
Sep 12 01:01:15.963395 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.963383    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmbzb\" (UniqueName: \"kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb\") pod \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\" (UID: \"e9529a99-d240-4b2c-8fa7-ef2906bd0d09\") "
Sep 12 01:01:15.963638 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.963612    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9529a99-d240-4b2c-8fa7-ef2906bd0d09" (UID: "e9529a99-d240-4b2c-8fa7-ef2906bd0d09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:01:15.965581 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:15.965555    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb" (OuterVolumeSpecName: "kube-api-access-wmbzb") pod "e9529a99-d240-4b2c-8fa7-ef2906bd0d09" (UID: "e9529a99-d240-4b2c-8fa7-ef2906bd0d09"). InnerVolumeSpecName "kube-api-access-wmbzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:01:16.064927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.064886    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:16.064927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.064921    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmbzb\" (UniqueName: \"kubernetes.io/projected/e9529a99-d240-4b2c-8fa7-ef2906bd0d09-kube-api-access-wmbzb\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:16.223752 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.223656    2576 generic.go:356] "Generic (PLEG): container finished" podID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" containerID="9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4" exitCode=0
Sep 12 01:01:16.223752 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.223708    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"
Sep 12 01:01:16.223752 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.223739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" event={"ID":"e9529a99-d240-4b2c-8fa7-ef2906bd0d09","Type":"ContainerDied","Data":"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"}
Sep 12 01:01:16.224037 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.223806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn" event={"ID":"e9529a99-d240-4b2c-8fa7-ef2906bd0d09","Type":"ContainerDied","Data":"7608cd9799ef089316b7642062fba140ae04432279f5e7920d6272a62b9286c9"}
Sep 12 01:01:16.224037 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.223839    2576 scope.go:117] "RemoveContainer" containerID="9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"
Sep 12 01:01:16.234432 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.234352    2576 scope.go:117] "RemoveContainer" containerID="9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"
Sep 12 01:01:16.234649 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:01:16.234633    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4\": container with ID starting with 9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4 not found: ID does not exist" containerID="9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"
Sep 12 01:01:16.234690 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.234657    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4"} err="failed to get container status \"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4\": rpc error: code = NotFound desc = could not find container \"9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4\": container with ID starting with 9f21888299d94be373523cbf7167b960309b39a06beea8bb00d1f21534b8efa4 not found: ID does not exist"
Sep 12 01:01:16.247419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.247395    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:01:16.253431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:16.253409    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9eca3408-5598f7695d-kzbkn"]
Sep 12 01:01:17.583574 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:17.583539    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ead617-f474-468a-94fd-d06dd4e8217d" path="/var/lib/kubelet/pods/02ead617-f474-468a-94fd-d06dd4e8217d/volumes"
Sep 12 01:01:17.584049 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:17.584031    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" path="/var/lib/kubelet/pods/e9529a99-d240-4b2c-8fa7-ef2906bd0d09/volumes"
Sep 12 01:01:22.299010 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:22.298878    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:01:22.299494 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:22.299113    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy" containerID="cri-o://6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00" gracePeriod=30
Sep 12 01:01:27.570682 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.570618    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:01:27.688110 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688124    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688153    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688239    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688548 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688548 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688395    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688548 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688438    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stsgm\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.688548 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688463    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:27.688548 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data\") pod \"11376103-4eee-4125-a34f-338f718f1d0f\" (UID: \"11376103-4eee-4125-a34f-338f718f1d0f\") "
Sep 12 01:01:27.689081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:27.689081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:27.689081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.688727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:01:27.689650 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.689354    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:27.689787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.689715    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.689787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.689736    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.689787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.689750    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.689787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.689764    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11376103-4eee-4125-a34f-338f718f1d0f-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.690730 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.690704    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:01:27.690730 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.690713    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:27.691269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.691247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:01:27.691269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.691251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm" (OuterVolumeSpecName: "kube-api-access-stsgm") pod "11376103-4eee-4125-a34f-338f718f1d0f" (UID: "11376103-4eee-4125-a34f-338f718f1d0f"). InnerVolumeSpecName "kube-api-access-stsgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:01:27.797526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.790743    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.797526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.790816    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11376103-4eee-4125-a34f-338f718f1d0f-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.797526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.790833    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stsgm\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-kube-api-access-stsgm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.797526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.790851    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11376103-4eee-4125-a34f-338f718f1d0f-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:27.797526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:27.790874    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11376103-4eee-4125-a34f-338f718f1d0f-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:28.317192 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.317158    2576 generic.go:356] "Generic (PLEG): container finished" podID="11376103-4eee-4125-a34f-338f718f1d0f" containerID="6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00" exitCode=0
Sep 12 01:01:28.317428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.317218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerDied","Data":"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"}
Sep 12 01:01:28.317428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.317221    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"
Sep 12 01:01:28.317428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.317329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99" event={"ID":"11376103-4eee-4125-a34f-338f718f1d0f","Type":"ContainerDied","Data":"7f44f4c0d10e5c0fb129c90f7ec5400532c093dfc1ce9e953a8f30394cf0efd5"}
Sep 12 01:01:28.317428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.317352    2576 scope.go:117] "RemoveContainer" containerID="6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"
Sep 12 01:01:28.328049 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.328031    2576 scope.go:117] "RemoveContainer" containerID="4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"
Sep 12 01:01:28.337399 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.337374    2576 scope.go:117] "RemoveContainer" containerID="6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"
Sep 12 01:01:28.337796 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:01:28.337766    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00\": container with ID starting with 6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00 not found: ID does not exist" containerID="6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"
Sep 12 01:01:28.337911 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.337809    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00"} err="failed to get container status \"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00\": rpc error: code = NotFound desc = could not find container \"6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00\": container with ID starting with 6bc1dbffb9b75970ec7a1136cd060d7ac01dbef53e93da1c02752cab16676f00 not found: ID does not exist"
Sep 12 01:01:28.337911 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.337834    2576 scope.go:117] "RemoveContainer" containerID="4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"
Sep 12 01:01:28.338559 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:01:28.338531    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213\": container with ID starting with 4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213 not found: ID does not exist" containerID="4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"
Sep 12 01:01:28.338647 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.338569    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213"} err="failed to get container status \"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213\": rpc error: code = NotFound desc = could not find container \"4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213\": container with ID starting with 4946798ae96895bbebfa7ac85515c85784c430932ca86e242b0409cd56a0a213 not found: ID does not exist"
Sep 12 01:01:28.342135 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.342100    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:01:28.345529 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.345507    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9eca3408-openshift-default-7d66cfb4b4-dmz99"]
Sep 12 01:01:28.537434 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537401    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:01:28.537921 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537906    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:28.537980 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537924    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:28.537980 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537945    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ead617-f474-468a-94fd-d06dd4e8217d" containerName="revoke-keys"
Sep 12 01:01:28.537980 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537951    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ead617-f474-468a-94fd-d06dd4e8217d" containerName="revoke-keys"
Sep 12 01:01:28.537980 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537957    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" containerName="payload-pre-processing"
Sep 12 01:01:28.537980 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.537963    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" containerName="payload-pre-processing"
Sep 12 01:01:28.538134 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.538050    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:28.538134 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.538061    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:28.538134 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.538073    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ead617-f474-468a-94fd-d06dd4e8217d" containerName="revoke-keys"
Sep 12 01:01:28.538134 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.538082    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9529a99-d240-4b2c-8fa7-ef2906bd0d09" containerName="payload-pre-processing"
Sep 12 01:01:28.542826 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.542806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.545699 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.545675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"distinct-w0-10ba6f-kserve-self-signed-certs\""
Sep 12 01:01:28.549689 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.549665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:01:28.701179 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.701584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.701584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2dt4\" (UniqueName: \"kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.701584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.701584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.701584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.701538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803113 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803113 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803362 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2dt4\" (UniqueName: \"kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803362 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803441 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803473 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.803741 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.803722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.805870 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.805849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.805986 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.805853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.815513 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.815491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2dt4\" (UniqueName: \"kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4\") pod \"distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:28.855130 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:28.855079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:29.143136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:29.143108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:01:29.143306 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:01:29.143245    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bd374ca_66f9_43c7_b2c5_9fcb5ab16663.slice/crio-44560e6c3a9fd6ebfd56f033690391f0ee469381c7cd73a44eb3594671c34207 WatchSource:0}: Error finding container 44560e6c3a9fd6ebfd56f033690391f0ee469381c7cd73a44eb3594671c34207: Status 404 returned error can't find the container with id 44560e6c3a9fd6ebfd56f033690391f0ee469381c7cd73a44eb3594671c34207
Sep 12 01:01:29.326584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:29.326550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" event={"ID":"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663","Type":"ContainerStarted","Data":"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"}
Sep 12 01:01:29.326774 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:29.326599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" event={"ID":"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663","Type":"ContainerStarted","Data":"44560e6c3a9fd6ebfd56f033690391f0ee469381c7cd73a44eb3594671c34207"}
Sep 12 01:01:29.350367 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:29.350317    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" podStartSLOduration=1.350302457 podStartE2EDuration="1.350302457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:01:29.346985039 +0000 UTC m=+1112.259663999" watchObservedRunningTime="2026-09-12 01:01:29.350302457 +0000 UTC m=+1112.262981388"
Sep 12 01:01:29.582958 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:29.582924    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11376103-4eee-4125-a34f-338f718f1d0f" path="/var/lib/kubelet/pods/11376103-4eee-4125-a34f-338f718f1d0f/volumes"
Sep 12 01:01:31.109916 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.109872    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"]
Sep 12 01:01:31.111005 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.110978    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:31.111191 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.111177    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11376103-4eee-4125-a34f-338f718f1d0f" containerName="istio-proxy"
Sep 12 01:01:31.115583 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.115560    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:31.118697 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.118676    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:01:31.123088 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.123064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:01:31.123800 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.123776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"]
Sep 12 01:01:31.214999 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.214965    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:01:31.230388 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.230352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j\" (UID: \"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:31.331862 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.331824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j\" (UID: \"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:31.332473 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.332454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j\" (UID: \"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:31.429821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.429788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:31.719266 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:31.719234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"]
Sep 12 01:01:31.720981 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:01:31.720959    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ec9036_d5b1_4200_b05a_b44c4f1f6e2d.slice/crio-d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076 WatchSource:0}: Error finding container d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076: Status 404 returned error can't find the container with id d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076
Sep 12 01:01:32.120864 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:32.120829    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 01:01:32.350161 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:32.350071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j" event={"ID":"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d","Type":"ContainerStarted","Data":"c7731fac9665d1e5811baca1c1f5d0810f219f7bf55d2d71e93257a2e13612b3"}
Sep 12 01:01:32.350161 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:32.350136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j" event={"ID":"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d","Type":"ContainerStarted","Data":"d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076"}
Sep 12 01:01:32.369475 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:32.369427    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j" podStartSLOduration=1.369410495 podStartE2EDuration="1.369410495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:01:32.366331006 +0000 UTC m=+1115.279009965" watchObservedRunningTime="2026-09-12 01:01:32.369410495 +0000 UTC m=+1115.282089433"
Sep 12 01:01:33.359200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:33.359169    2576 generic.go:356] "Generic (PLEG): container finished" podID="40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" containerID="c7731fac9665d1e5811baca1c1f5d0810f219f7bf55d2d71e93257a2e13612b3" exitCode=0
Sep 12 01:01:33.359631 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:33.359262    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j" event={"ID":"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d","Type":"ContainerDied","Data":"c7731fac9665d1e5811baca1c1f5d0810f219f7bf55d2d71e93257a2e13612b3"}
Sep 12 01:01:34.510696 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:34.510669    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:34.667361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:34.667326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca\") pod \"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d\" (UID: \"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d\") "
Sep 12 01:01:34.667655 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:34.667634    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" (UID: "40ec9036-d5b1-4200-b05a-b44c4f1f6e2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:01:34.667902 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:34.667882    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:35.374865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:35.374831    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"
Sep 12 01:01:35.374865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:35.374847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j" event={"ID":"40ec9036-d5b1-4200-b05a-b44c4f1f6e2d","Type":"ContainerDied","Data":"d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076"}
Sep 12 01:01:35.375091 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:35.374904    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d757b36c79776ccded70c96d1d3b28a2cc0e8a3434b7931b0e325e215001a076"
Sep 12 01:01:36.464102 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.464073    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:01:36.464584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.464570    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" containerName="revoke-keys"
Sep 12 01:01:36.464584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.464585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" containerName="revoke-keys"
Sep 12 01:01:36.464685 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.464668    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" containerName="revoke-keys"
Sep 12 01:01:36.468002 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.467983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.471297 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.471265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-8e62c2-openshift-default-dockercfg-9plsr\""
Sep 12 01:01:36.481838 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.481816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:01:36.587114 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587325 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587325 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587325 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587325 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587477 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587477 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmmdc\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587477 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.587477 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.587453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688588 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688761 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688807 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.688998 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.688973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmmdc\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689072 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689130 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689130 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689239 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689239 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689407 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689407 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.689791 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.689771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.691138 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.691108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.691439 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.691422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.696698 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.696678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.696856 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.696839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmmdc\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc\") pod \"e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") " pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:36.779720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:36.779628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:37.066393 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.066361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:01:37.066977 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:01:37.066946    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84adec16_c7d7_4082_8abe_dfeb770aedd2.slice/crio-7f7cf8e42475076d2f51b1e65cba7296ebb85dc4a096fb09e1c85b40acc3b325 WatchSource:0}: Error finding container 7f7cf8e42475076d2f51b1e65cba7296ebb85dc4a096fb09e1c85b40acc3b325: Status 404 returned error can't find the container with id 7f7cf8e42475076d2f51b1e65cba7296ebb85dc4a096fb09e1c85b40acc3b325
Sep 12 01:01:37.069416 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.069385    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:37.069500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.069461    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:37.069574 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.069507    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:37.394159 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.394058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerStarted","Data":"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"}
Sep 12 01:01:37.394159 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.394121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerStarted","Data":"7f7cf8e42475076d2f51b1e65cba7296ebb85dc4a096fb09e1c85b40acc3b325"}
Sep 12 01:01:37.418529 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.418471    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podStartSLOduration=1.418450244 podStartE2EDuration="1.418450244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:01:37.415916662 +0000 UTC m=+1120.328595600" watchObservedRunningTime="2026-09-12 01:01:37.418450244 +0000 UTC m=+1120.331129183"
Sep 12 01:01:37.780172 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:37.780135    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:38.785553 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:38.785517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:38.855952 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:38.855920    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:38.856154 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:38.855965    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:38.868469 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:38.868448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:39.276795 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:39.276752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:01:39.408108 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:39.408055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:39.408963 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:39.408938    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:01:39.419971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:39.419926    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:01:42.757724 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:42.757686    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"]
Sep 12 01:01:42.760754 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:42.760731    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a4fbb-chj5j"]
Sep 12 01:01:43.583319 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:43.583260    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ec9036-d5b1-4200-b05a-b44c4f1f6e2d" path="/var/lib/kubelet/pods/40ec9036-d5b1-4200-b05a-b44c4f1f6e2d/volumes"
Sep 12 01:01:46.234982 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.234941    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" podUID="da6621c9-7415-423c-a479-e5e675d9e686" containerName="main" containerID="cri-o://f103a0839c75ab26d60c268db063b3bd3cdd05d1bfa5e006f2c4a824369c21ac" gracePeriod=45
Sep 12 01:01:46.462168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.462135    2576 generic.go:356] "Generic (PLEG): container finished" podID="da6621c9-7415-423c-a479-e5e675d9e686" containerID="f103a0839c75ab26d60c268db063b3bd3cdd05d1bfa5e006f2c4a824369c21ac" exitCode=0
Sep 12 01:01:46.462365 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.462218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" event={"ID":"da6621c9-7415-423c-a479-e5e675d9e686","Type":"ContainerDied","Data":"f103a0839c75ab26d60c268db063b3bd3cdd05d1bfa5e006f2c4a824369c21ac"}
Sep 12 01:01:46.492342 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.492243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:46.593515 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593528    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593568    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593686    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6spvj\" (UniqueName: \"kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj\") pod \"da6621c9-7415-423c-a479-e5e675d9e686\" (UID: \"da6621c9-7415-423c-a479-e5e675d9e686\") "
Sep 12 01:01:46.593969 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593746    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:46.593969 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593768    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache" (OuterVolumeSpecName: "model-cache") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:46.593969 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.593874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home" (OuterVolumeSpecName: "home") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:46.594161 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.594142    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:46.594217 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.594167    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:46.594217 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.594182    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:46.596087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.596064    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj" (OuterVolumeSpecName: "kube-api-access-6spvj") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "kube-api-access-6spvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:01:46.596168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.596100    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:01:46.596168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.596113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm" (OuterVolumeSpecName: "dshm") pod "da6621c9-7415-423c-a479-e5e675d9e686" (UID: "da6621c9-7415-423c-a479-e5e675d9e686"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:46.695436 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.695354    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da6621c9-7415-423c-a479-e5e675d9e686-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:46.695436 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.695382    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da6621c9-7415-423c-a479-e5e675d9e686-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:46.695436 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:46.695393    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6spvj\" (UniqueName: \"kubernetes.io/projected/da6621c9-7415-423c-a479-e5e675d9e686-kube-api-access-6spvj\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.141939 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.141901    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" podUID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" containerName="main" containerID="cri-o://342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3" gracePeriod=45
Sep 12 01:01:47.410621 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.410595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 01:01:47.470629 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.470597    2576 generic.go:356] "Generic (PLEG): container finished" podID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" containerID="342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3" exitCode=0
Sep 12 01:01:47.470829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.470639    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"
Sep 12 01:01:47.470829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.470680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" event={"ID":"58bfb66e-5d70-4a86-8c80-6dfb90f92307","Type":"ContainerDied","Data":"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"}
Sep 12 01:01:47.470829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.470723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt" event={"ID":"58bfb66e-5d70-4a86-8c80-6dfb90f92307","Type":"ContainerDied","Data":"d9ab8de9b9ff8ad89fda49a569df35570a7aeedb54c29dea5a4ed599a4878411"}
Sep 12 01:01:47.470829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.470746    2576 scope.go:117] "RemoveContainer" containerID="342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"
Sep 12 01:01:47.472357 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.472327    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb" event={"ID":"da6621c9-7415-423c-a479-e5e675d9e686","Type":"ContainerDied","Data":"5b1bac64b4683818ee812871d58dfff905fb06f88bd2c36c1c96e2ad8801fcef"}
Sep 12 01:01:47.472703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.472679    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"
Sep 12 01:01:47.486204 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.486187    2576 scope.go:117] "RemoveContainer" containerID="342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"
Sep 12 01:01:47.486561 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:01:47.486542    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3\": container with ID starting with 342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3 not found: ID does not exist" containerID="342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"
Sep 12 01:01:47.486633 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.486570    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3"} err="failed to get container status \"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3\": rpc error: code = NotFound desc = could not find container \"342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3\": container with ID starting with 342ac97866c490cc7bacca27ce2a6572c079d3a334247c9458a6f3f8472867c3 not found: ID does not exist"
Sep 12 01:01:47.486633 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.486588    2576 scope.go:117] "RemoveContainer" containerID="f103a0839c75ab26d60c268db063b3bd3cdd05d1bfa5e006f2c4a824369c21ac"
Sep 12 01:01:47.504619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.504734 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504636    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.504851 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq7cx\" (UniqueName: \"kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.504928 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home" (OuterVolumeSpecName: "home") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:47.504928 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504891    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.504928 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504919    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.505095 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.504954    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache\") pod \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\" (UID: \"58bfb66e-5d70-4a86-8c80-6dfb90f92307\") "
Sep 12 01:01:47.505150 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.505132    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:47.505447 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.505345    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache" (OuterVolumeSpecName: "model-cache") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:47.505447 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.505426    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.505447 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.505446    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.507027 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.507008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:01:47.507385 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.507354    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:01:47.507822 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.507798    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm" (OuterVolumeSpecName: "dshm") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:01:47.507991 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.507968    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx" (OuterVolumeSpecName: "kube-api-access-cq7cx") pod "58bfb66e-5d70-4a86-8c80-6dfb90f92307" (UID: "58bfb66e-5d70-4a86-8c80-6dfb90f92307"). InnerVolumeSpecName "kube-api-access-cq7cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:01:47.511351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.511330    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-8a4fbb/explicit-model-8a4fbb-kserve-655c4b9c87-r76wb"]
Sep 12 01:01:47.584817 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.584782    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6621c9-7415-423c-a479-e5e675d9e686" path="/var/lib/kubelet/pods/da6621c9-7415-423c-a479-e5e675d9e686/volumes"
Sep 12 01:01:47.605925 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.605898    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.605925 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.605923    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bfb66e-5d70-4a86-8c80-6dfb90f92307-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.606140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.605949    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bfb66e-5d70-4a86-8c80-6dfb90f92307-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.606140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.605958    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq7cx\" (UniqueName: \"kubernetes.io/projected/58bfb66e-5d70-4a86-8c80-6dfb90f92307-kube-api-access-cq7cx\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:01:47.789603 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.789540    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 01:01:47.792929 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:47.792904    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5cee89/test-model-5cee89-kserve-84bbcdbd75-p7vjt"]
Sep 12 01:01:49.582826 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:49.582792    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" path="/var/lib/kubelet/pods/58bfb66e-5d70-4a86-8c80-6dfb90f92307/volumes"
Sep 12 01:01:50.240043 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240011    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:01:50.240610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240589    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6621c9-7415-423c-a479-e5e675d9e686" containerName="main"
Sep 12 01:01:50.240610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240610    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6621c9-7415-423c-a479-e5e675d9e686" containerName="main"
Sep 12 01:01:50.240783 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240625    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" containerName="main"
Sep 12 01:01:50.240783 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240633    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" containerName="main"
Sep 12 01:01:50.240783 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240780    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58bfb66e-5d70-4a86-8c80-6dfb90f92307" containerName="main"
Sep 12 01:01:50.240926 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.240797    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6621c9-7415-423c-a479-e5e675d9e686" containerName="main"
Sep 12 01:01:50.245746 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.245722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.248047 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.248024    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-bafa8a-openshift-default-dockercfg-kjgpx\""
Sep 12 01:01:50.255569 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.255544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:01:50.332512 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k28jg\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.332703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.332703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.332703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.332703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.332703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.333008 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.333008 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.333008 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.332857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434230 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434453 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434453 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k28jg\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434699 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434699 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434802 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434802 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.434802 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.435031 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.435172 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.434997    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.435172 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.435163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.435317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.435228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.436814 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.436792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.437862 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.437840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.443502 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.443480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k28jg\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.443599 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.443533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token\") pod \"e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") " pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.558040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.557948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:50.854028 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.853999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:01:50.855033 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:01:50.855009    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3ca84c_725b_448b_af9c_94c7a9168615.slice/crio-b035621e01ffd35eba0235f1a43fa5d8df4c69870af116a13fe32c368b020e48 WatchSource:0}: Error finding container b035621e01ffd35eba0235f1a43fa5d8df4c69870af116a13fe32c368b020e48: Status 404 returned error can't find the container with id b035621e01ffd35eba0235f1a43fa5d8df4c69870af116a13fe32c368b020e48
Sep 12 01:01:50.857526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.857493    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:50.857604 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.857563    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:50.857604 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:50.857589    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:01:51.509469 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:51.509437    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" event={"ID":"3f3ca84c-725b-448b-af9c-94c7a9168615","Type":"ContainerStarted","Data":"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"}
Sep 12 01:01:51.509659 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:51.509490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" event={"ID":"3f3ca84c-725b-448b-af9c-94c7a9168615","Type":"ContainerStarted","Data":"b035621e01ffd35eba0235f1a43fa5d8df4c69870af116a13fe32c368b020e48"}
Sep 12 01:01:51.531088 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:51.531030    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" podStartSLOduration=1.531014501 podStartE2EDuration="1.531014501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:01:51.530198383 +0000 UTC m=+1134.442877343" watchObservedRunningTime="2026-09-12 01:01:51.531014501 +0000 UTC m=+1134.443693437"
Sep 12 01:01:51.558847 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:51.558807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:51.564171 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:51.564146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:52.516852 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:52.516825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:01:52.517841 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:01:52.517823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:02:09.929833 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:09.929783    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": read tcp 10.133.0.2:36504->10.133.0.82:15021: read: connection reset by peer" start-of-body=
Sep 12 01:02:09.930439 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:09.929884    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": read tcp 10.133.0.2:36504->10.133.0.82:15021: read: connection reset by peer"
Sep 12 01:02:10.665070 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.665034    2576 generic.go:356] "Generic (PLEG): container finished" podID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerID="0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494" exitCode=0
Sep 12 01:02:10.665257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.665107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerDied","Data":"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"}
Sep 12 01:02:10.665554 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.665539    2576 scope.go:117] "RemoveContainer" containerID="0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"
Sep 12 01:02:10.666742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.666713    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:10.666825 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.666798    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:10.666869 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:10.666856    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:11.675180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:11.674148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerStarted","Data":"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"}
Sep 12 01:02:11.780685 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:11.780654    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:02:11.781106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:11.781014    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 01:02:11.781310 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:11.781261    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 01:02:12.780560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:12.780516    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 01:02:12.781054 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:12.780584    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 01:02:13.780146 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:13.780111    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 01:02:13.780463 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:13.780431    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 01:02:14.781489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:14.780988    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 01:02:14.781489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:14.781058    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 01:02:15.051174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.051079    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"]
Sep 12 01:02:15.054053 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.054028    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-5cee89-29819580-b9ccv"]
Sep 12 01:02:15.110335 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.109322    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 01:02:15.110335 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.109621    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" podUID="9e2aa489-ba88-4601-b34e-52d0965d10c5" containerName="payload-processing" containerID="cri-o://e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85" gracePeriod=30
Sep 12 01:02:15.405586 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.405552    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 01:02:15.514718 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.514682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume\") pod \"9e2aa489-ba88-4601-b34e-52d0965d10c5\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") "
Sep 12 01:02:15.514894 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.514745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbnnn\" (UniqueName: \"kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn\") pod \"9e2aa489-ba88-4601-b34e-52d0965d10c5\" (UID: \"9e2aa489-ba88-4601-b34e-52d0965d10c5\") "
Sep 12 01:02:15.515126 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.515098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e2aa489-ba88-4601-b34e-52d0965d10c5" (UID: "9e2aa489-ba88-4601-b34e-52d0965d10c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:02:15.516979 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.516954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn" (OuterVolumeSpecName: "kube-api-access-vbnnn") pod "9e2aa489-ba88-4601-b34e-52d0965d10c5" (UID: "9e2aa489-ba88-4601-b34e-52d0965d10c5"). InnerVolumeSpecName "kube-api-access-vbnnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:15.587726 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.587680    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607814fa-0757-409f-b945-7db0f501fccf" path="/var/lib/kubelet/pods/607814fa-0757-409f-b945-7db0f501fccf/volumes"
Sep 12 01:02:15.616223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.616152    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e2aa489-ba88-4601-b34e-52d0965d10c5-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:15.616223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.616181    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbnnn\" (UniqueName: \"kubernetes.io/projected/9e2aa489-ba88-4601-b34e-52d0965d10c5-kube-api-access-vbnnn\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:15.712619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.712586    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e2aa489-ba88-4601-b34e-52d0965d10c5" containerID="e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85" exitCode=0
Sep 12 01:02:15.712803 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.712627    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"
Sep 12 01:02:15.712803 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.712654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" event={"ID":"9e2aa489-ba88-4601-b34e-52d0965d10c5","Type":"ContainerDied","Data":"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"}
Sep 12 01:02:15.712803 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.712702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77" event={"ID":"9e2aa489-ba88-4601-b34e-52d0965d10c5","Type":"ContainerDied","Data":"957e17dd46790ac60d693d9b769562621a367c8ee7a9ea69b7690192d8d2376c"}
Sep 12 01:02:15.712803 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.712724    2576 scope.go:117] "RemoveContainer" containerID="e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"
Sep 12 01:02:15.729030 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.729008    2576 scope.go:117] "RemoveContainer" containerID="e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"
Sep 12 01:02:15.729727 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:15.729701    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85\": container with ID starting with e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85 not found: ID does not exist" containerID="e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"
Sep 12 01:02:15.729821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.729740    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85"} err="failed to get container status \"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85\": rpc error: code = NotFound desc = could not find container \"e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85\": container with ID starting with e7cbfc26bdd2c30bbd8abc473ea1a9d7db46fc52d8ea9d7ad9890bfd7d236b85 not found: ID does not exist"
Sep 12 01:02:15.731988 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.731966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 01:02:15.740212 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.740184    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-5cee89-7c67799c5f-l2j77"]
Sep 12 01:02:15.780498 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.780458    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 01:02:15.780694 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:15.780539    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 01:02:16.792586 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:16.792550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:02:16.793053 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:16.792931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:02:16.793925 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:16.793906    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:02:17.583996 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:17.583964    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2aa489-ba88-4601-b34e-52d0965d10c5" path="/var/lib/kubelet/pods/9e2aa489-ba88-4601-b34e-52d0965d10c5/volumes"
Sep 12 01:02:17.974884 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:17.974842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:02:22.484359 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.484260    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"]
Sep 12 01:02:22.484774 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.484760    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2aa489-ba88-4601-b34e-52d0965d10c5" containerName="payload-processing"
Sep 12 01:02:22.484774 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.484775    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2aa489-ba88-4601-b34e-52d0965d10c5" containerName="payload-processing"
Sep 12 01:02:22.484856 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.484846    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2aa489-ba88-4601-b34e-52d0965d10c5" containerName="payload-processing"
Sep 12 01:02:22.487658 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.487639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:22.489899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.489877    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:02:22.490035 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.489924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:02:22.495923 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.495590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"]
Sep 12 01:02:22.587875 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.587838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz\" (UID: \"897111b8-3e34-48bc-bbe0-9bef29462c79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:22.688929 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.688894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz\" (UID: \"897111b8-3e34-48bc-bbe0-9bef29462c79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:22.689615 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.689588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz\" (UID: \"897111b8-3e34-48bc-bbe0-9bef29462c79\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:22.799494 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:22.799406    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:23.076247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:23.076215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"]
Sep 12 01:02:23.077664 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:23.077639    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897111b8_3e34_48bc_bbe0_9bef29462c79.slice/crio-3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88 WatchSource:0}: Error finding container 3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88: Status 404 returned error can't find the container with id 3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88
Sep 12 01:02:23.770070 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:23.770032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz" event={"ID":"897111b8-3e34-48bc-bbe0-9bef29462c79","Type":"ContainerStarted","Data":"fc255589fab5a221fc2f247d010632cbed78c357a8bf6ff68e2225739f26bc67"}
Sep 12 01:02:23.770070 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:23.770081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz" event={"ID":"897111b8-3e34-48bc-bbe0-9bef29462c79","Type":"ContainerStarted","Data":"3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88"}
Sep 12 01:02:23.787314 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:23.787247    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz" podStartSLOduration=1.787232135 podStartE2EDuration="1.787232135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:23.785265446 +0000 UTC m=+1166.697944402" watchObservedRunningTime="2026-09-12 01:02:23.787232135 +0000 UTC m=+1166.699911072"
Sep 12 01:02:24.779738 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:24.779701    2576 generic.go:356] "Generic (PLEG): container finished" podID="897111b8-3e34-48bc-bbe0-9bef29462c79" containerID="fc255589fab5a221fc2f247d010632cbed78c357a8bf6ff68e2225739f26bc67" exitCode=0
Sep 12 01:02:24.780166 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:24.779744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz" event={"ID":"897111b8-3e34-48bc-bbe0-9bef29462c79","Type":"ContainerDied","Data":"fc255589fab5a221fc2f247d010632cbed78c357a8bf6ff68e2225739f26bc67"}
Sep 12 01:02:25.933347 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:25.933323    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:26.024269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.024230    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca\") pod \"897111b8-3e34-48bc-bbe0-9bef29462c79\" (UID: \"897111b8-3e34-48bc-bbe0-9bef29462c79\") "
Sep 12 01:02:26.024606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.024584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "897111b8-3e34-48bc-bbe0-9bef29462c79" (UID: "897111b8-3e34-48bc-bbe0-9bef29462c79"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:02:26.125858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.125765    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/897111b8-3e34-48bc-bbe0-9bef29462c79-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:26.794796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.794760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz" event={"ID":"897111b8-3e34-48bc-bbe0-9bef29462c79","Type":"ContainerDied","Data":"3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88"}
Sep 12 01:02:26.794796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.794792    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"
Sep 12 01:02:26.795023 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:26.794821    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a245fd09499d20a7354630944f310703e4d7cc0a2b0f55ccd4d9f1c60a48d88"
Sep 12 01:02:33.070689 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.070653    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 01:02:33.071159 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.070902    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" podUID="774d9077-da27-44c4-8bbe-32c4062ca40e" containerName="payload-pre-processing" containerID="cri-o://d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc" gracePeriod=30
Sep 12 01:02:33.247133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.247100    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"]
Sep 12 01:02:33.250044 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.250016    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bf547a-bhpqz"]
Sep 12 01:02:33.334539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.334481    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 01:02:33.427559 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.427526    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8020-65e81d"]
Sep 12 01:02:33.428003 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.427991    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897111b8-3e34-48bc-bbe0-9bef29462c79" containerName="revoke-keys"
Sep 12 01:02:33.428048 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.428005    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="897111b8-3e34-48bc-bbe0-9bef29462c79" containerName="revoke-keys"
Sep 12 01:02:33.428048 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.428017    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774d9077-da27-44c4-8bbe-32c4062ca40e" containerName="payload-pre-processing"
Sep 12 01:02:33.428048 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.428024    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="774d9077-da27-44c4-8bbe-32c4062ca40e" containerName="payload-pre-processing"
Sep 12 01:02:33.428140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.428094    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="897111b8-3e34-48bc-bbe0-9bef29462c79" containerName="revoke-keys"
Sep 12 01:02:33.428140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.428101    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="774d9077-da27-44c4-8bbe-32c4062ca40e" containerName="payload-pre-processing"
Sep 12 01:02:33.430520 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.430503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:33.433488 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.433466    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n87bf\""
Sep 12 01:02:33.440043 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.439798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-65e81d"]
Sep 12 01:02:33.507022 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.506984    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume\") pod \"774d9077-da27-44c4-8bbe-32c4062ca40e\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") "
Sep 12 01:02:33.507189 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.507178    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h58z\" (UniqueName: \"kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z\") pod \"774d9077-da27-44c4-8bbe-32c4062ca40e\" (UID: \"774d9077-da27-44c4-8bbe-32c4062ca40e\") "
Sep 12 01:02:33.507416 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.507401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxct\" (UniqueName: \"kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct\") pod \"test-curl-8020-65e81d\" (UID: \"73478bc2-d05a-40e3-9db3-8b7c2cbb2102\") " pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:33.507474 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.507424    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "774d9077-da27-44c4-8bbe-32c4062ca40e" (UID: "774d9077-da27-44c4-8bbe-32c4062ca40e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:02:33.509541 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.509512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z" (OuterVolumeSpecName: "kube-api-access-7h58z") pod "774d9077-da27-44c4-8bbe-32c4062ca40e" (UID: "774d9077-da27-44c4-8bbe-32c4062ca40e"). InnerVolumeSpecName "kube-api-access-7h58z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:33.582523 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.582490    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897111b8-3e34-48bc-bbe0-9bef29462c79" path="/var/lib/kubelet/pods/897111b8-3e34-48bc-bbe0-9bef29462c79/volumes"
Sep 12 01:02:33.608842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.608806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxct\" (UniqueName: \"kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct\") pod \"test-curl-8020-65e81d\" (UID: \"73478bc2-d05a-40e3-9db3-8b7c2cbb2102\") " pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:33.608984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.608944    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h58z\" (UniqueName: \"kubernetes.io/projected/774d9077-da27-44c4-8bbe-32c4062ca40e-kube-api-access-7h58z\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:33.608984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.608954    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774d9077-da27-44c4-8bbe-32c4062ca40e-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:33.617449 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.617424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxct\" (UniqueName: \"kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct\") pod \"test-curl-8020-65e81d\" (UID: \"73478bc2-d05a-40e3-9db3-8b7c2cbb2102\") " pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:33.742735 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.742697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:33.851036 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.850932    2576 generic.go:356] "Generic (PLEG): container finished" podID="774d9077-da27-44c4-8bbe-32c4062ca40e" containerID="d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc" exitCode=0
Sep 12 01:02:33.851036 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.851001    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"
Sep 12 01:02:33.851036 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.851015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" event={"ID":"774d9077-da27-44c4-8bbe-32c4062ca40e","Type":"ContainerDied","Data":"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"}
Sep 12 01:02:33.851364 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.851096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd" event={"ID":"774d9077-da27-44c4-8bbe-32c4062ca40e","Type":"ContainerDied","Data":"317078307e73b72b0ef6972ed492f434212d1c04f80e00dbc371337cb02d201d"}
Sep 12 01:02:33.851364 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.851118    2576 scope.go:117] "RemoveContainer" containerID="d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"
Sep 12 01:02:33.863219 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.863199    2576 scope.go:117] "RemoveContainer" containerID="d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"
Sep 12 01:02:33.863541 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:33.863514    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc\": container with ID starting with d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc not found: ID does not exist" containerID="d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"
Sep 12 01:02:33.863633 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.863549    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc"} err="failed to get container status \"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc\": rpc error: code = NotFound desc = could not find container \"d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc\": container with ID starting with d8350e3025862b6430d0e0fa55ee55c65c9f065b2e5f4abeb307bd841d8288dc not found: ID does not exist"
Sep 12 01:02:33.870695 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.870675    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 01:02:33.875668 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:33.875646    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-bf547a-5fccd5fb54-vw4rd"]
Sep 12 01:02:34.021738 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:34.021711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-65e81d"]
Sep 12 01:02:34.022534 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:34.022509    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73478bc2_d05a_40e3_9db3_8b7c2cbb2102.slice/crio-348929a173bab079554badcdbd6d1649b864d45e78adeb40ead4331ab99e5e58 WatchSource:0}: Error finding container 348929a173bab079554badcdbd6d1649b864d45e78adeb40ead4331ab99e5e58: Status 404 returned error can't find the container with id 348929a173bab079554badcdbd6d1649b864d45e78adeb40ead4331ab99e5e58
Sep 12 01:02:34.024414 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:34.024397    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 01:02:34.861524 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:34.861492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-65e81d" event={"ID":"73478bc2-d05a-40e3-9db3-8b7c2cbb2102","Type":"ContainerStarted","Data":"348929a173bab079554badcdbd6d1649b864d45e78adeb40ead4331ab99e5e58"}
Sep 12 01:02:35.582292 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:35.582238    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774d9077-da27-44c4-8bbe-32c4062ca40e" path="/var/lib/kubelet/pods/774d9077-da27-44c4-8bbe-32c4062ca40e/volumes"
Sep 12 01:02:35.870148 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:35.870054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-65e81d" event={"ID":"73478bc2-d05a-40e3-9db3-8b7c2cbb2102","Type":"ContainerStarted","Data":"61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113"}
Sep 12 01:02:35.885418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:35.885361    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8020-65e81d" podStartSLOduration=2.098928069 podStartE2EDuration="2.885343086s" totalImagesPullingTime="786.415017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:35.884594694 +0000 UTC m=+1178.797273631" watchObservedRunningTime="2026-09-12 01:02:35.885343086 +0000 UTC m=+1178.798022063"
Sep 12 01:02:36.470443 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.470411    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8020-65e81d"]
Sep 12 01:02:36.475179 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.475144    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8020-65e81d"]
Sep 12 01:02:36.595741 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.595661    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8020-67a686"]
Sep 12 01:02:36.596191 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.596177    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" containerName="test-curl-8020-65e81d"
Sep 12 01:02:36.596232 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.596193    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" containerName="test-curl-8020-65e81d"
Sep 12 01:02:36.596300 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.596286    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" containerName="test-curl-8020-65e81d"
Sep 12 01:02:36.598729 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.598713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:36.605127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.605103    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-67a686"]
Sep 12 01:02:36.741930 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.741898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d22\" (UniqueName: \"kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22\") pod \"test-curl-8020-67a686\" (UID: \"0db23b96-6871-4ec1-95ef-050373d229dd\") " pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:36.843570 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.843537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d22\" (UniqueName: \"kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22\") pod \"test-curl-8020-67a686\" (UID: \"0db23b96-6871-4ec1-95ef-050373d229dd\") " pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:36.852181 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.852110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d22\" (UniqueName: \"kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22\") pod \"test-curl-8020-67a686\" (UID: \"0db23b96-6871-4ec1-95ef-050373d229dd\") " pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:36.877515 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:36.877488    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8020-65e81d" container="test-curl-8020-65e81d"
Sep 12 01:02:36.910044 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:36.910022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:37.185510 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:37.183558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-67a686"]
Sep 12 01:02:37.186408 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:37.186376    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0db23b96_6871_4ec1_95ef_050373d229dd.slice/crio-b0b3cae3cb6bcbedb6da360ee1630ef216d4053eef096b36e2c35edb7db7fc64 WatchSource:0}: Error finding container b0b3cae3cb6bcbedb6da360ee1630ef216d4053eef096b36e2c35edb7db7fc64: Status 404 returned error can't find the container with id b0b3cae3cb6bcbedb6da360ee1630ef216d4053eef096b36e2c35edb7db7fc64
Sep 12 01:02:37.887326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:37.887259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-67a686" event={"ID":"0db23b96-6871-4ec1-95ef-050373d229dd","Type":"ContainerStarted","Data":"9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7"}
Sep 12 01:02:37.887887 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:37.887337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-67a686" event={"ID":"0db23b96-6871-4ec1-95ef-050373d229dd","Type":"ContainerStarted","Data":"b0b3cae3cb6bcbedb6da360ee1630ef216d4053eef096b36e2c35edb7db7fc64"}
Sep 12 01:02:37.887887 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:37.887439    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8020-65e81d" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" containerName="test-curl-8020-65e81d" containerID="cri-o://61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113" gracePeriod=2
Sep 12 01:02:37.901367 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:37.901325    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8020-67a686" podStartSLOduration=1.9013053869999998 podStartE2EDuration="1.901305387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:37.900434702 +0000 UTC m=+1180.813113638" watchObservedRunningTime="2026-09-12 01:02:37.901305387 +0000 UTC m=+1180.813984322"
Sep 12 01:02:38.514454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.514412    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8020-67a686"]
Sep 12 01:02:38.518924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.518883    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8020-67a686"]
Sep 12 01:02:38.581584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.581502    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 01:02:38.632817 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.632780    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8020-6ed8b7"]
Sep 12 01:02:38.633377 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.633357    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" containerName="test-curl-8020-67a686"
Sep 12 01:02:38.633377 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.633378    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" containerName="test-curl-8020-67a686"
Sep 12 01:02:38.633564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.633507    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" containerName="test-curl-8020-67a686"
Sep 12 01:02:38.637126 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.637097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:38.640226 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.640202    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-6ed8b7"]
Sep 12 01:02:38.762546 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.762502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9jz5\" (UniqueName: \"kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5\") pod \"test-curl-8020-6ed8b7\" (UID: \"77654182-17d2-4e4c-8bac-b88925736e21\") " pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:38.863891 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.863798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9jz5\" (UniqueName: \"kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5\") pod \"test-curl-8020-6ed8b7\" (UID: \"77654182-17d2-4e4c-8bac-b88925736e21\") " pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:38.873668 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.873641    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9jz5\" (UniqueName: \"kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5\") pod \"test-curl-8020-6ed8b7\" (UID: \"77654182-17d2-4e4c-8bac-b88925736e21\") " pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:38.893990 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:38.893958    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8020-67a686" container="test-curl-8020-67a686"
Sep 12 01:02:38.947658 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:38.947621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:39.222005 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:39.221978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-6ed8b7"]
Sep 12 01:02:39.222387 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:39.222355    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77654182_17d2_4e4c_8bac_b88925736e21.slice/crio-37e6c524b6aa847ccd19fdfe1d32e2f35521e301f39fb3b93b2b51e7b93dca80 WatchSource:0}: Error finding container 37e6c524b6aa847ccd19fdfe1d32e2f35521e301f39fb3b93b2b51e7b93dca80: Status 404 returned error can't find the container with id 37e6c524b6aa847ccd19fdfe1d32e2f35521e301f39fb3b93b2b51e7b93dca80
Sep 12 01:02:39.904050 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:39.904017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-6ed8b7" event={"ID":"77654182-17d2-4e4c-8bac-b88925736e21","Type":"ContainerStarted","Data":"2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f"}
Sep 12 01:02:39.904395 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:39.904066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-6ed8b7" event={"ID":"77654182-17d2-4e4c-8bac-b88925736e21","Type":"ContainerStarted","Data":"37e6c524b6aa847ccd19fdfe1d32e2f35521e301f39fb3b93b2b51e7b93dca80"}
Sep 12 01:02:39.904395 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:39.904095    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8020-67a686" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" containerName="test-curl-8020-67a686" containerID="cri-o://9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7" gracePeriod=2
Sep 12 01:02:39.921791 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:39.921748    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8020-6ed8b7" podStartSLOduration=1.921733798 podStartE2EDuration="1.921733798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:39.918167004 +0000 UTC m=+1182.830845940" watchObservedRunningTime="2026-09-12 01:02:39.921733798 +0000 UTC m=+1182.834412759"
Sep 12 01:02:40.082503 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.082478    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:40.178456 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.178431    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvxct\" (UniqueName: \"kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct\") pod \"73478bc2-d05a-40e3-9db3-8b7c2cbb2102\" (UID: \"73478bc2-d05a-40e3-9db3-8b7c2cbb2102\") "
Sep 12 01:02:40.180576 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.180552    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct" (OuterVolumeSpecName: "kube-api-access-xvxct") pod "73478bc2-d05a-40e3-9db3-8b7c2cbb2102" (UID: "73478bc2-d05a-40e3-9db3-8b7c2cbb2102"). InnerVolumeSpecName "kube-api-access-xvxct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:40.279843 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.279811    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvxct\" (UniqueName: \"kubernetes.io/projected/73478bc2-d05a-40e3-9db3-8b7c2cbb2102-kube-api-access-xvxct\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:40.523760 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.523659    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8020-6ed8b7"]
Sep 12 01:02:40.528481 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.528458    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8020-6ed8b7"]
Sep 12 01:02:40.644851 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.644817    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8020-34b9a5"]
Sep 12 01:02:40.645360 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.645340    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77654182-17d2-4e4c-8bac-b88925736e21" containerName="test-curl-8020-6ed8b7"
Sep 12 01:02:40.645360 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.645361    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="77654182-17d2-4e4c-8bac-b88925736e21" containerName="test-curl-8020-6ed8b7"
Sep 12 01:02:40.645527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.645496    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="77654182-17d2-4e4c-8bac-b88925736e21" containerName="test-curl-8020-6ed8b7"
Sep 12 01:02:40.648539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.648519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:40.654330 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.654306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-34b9a5"]
Sep 12 01:02:40.783590 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.783506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz27s\" (UniqueName: \"kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s\") pod \"test-curl-8020-34b9a5\" (UID: \"cb8672bb-fb48-4ec9-95a6-cbb68f17da77\") " pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:40.884840 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.884796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz27s\" (UniqueName: \"kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s\") pod \"test-curl-8020-34b9a5\" (UID: \"cb8672bb-fb48-4ec9-95a6-cbb68f17da77\") " pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:40.895363 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.895331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz27s\" (UniqueName: \"kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s\") pod \"test-curl-8020-34b9a5\" (UID: \"cb8672bb-fb48-4ec9-95a6-cbb68f17da77\") " pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:40.911660 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.911632    2576 generic.go:356] "Generic (PLEG): container finished" podID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" containerID="61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113" exitCode=137
Sep 12 01:02:40.912021 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.911683    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:40.912021 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.911728    2576 scope.go:117] "RemoveContainer" containerID="61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113"
Sep 12 01:02:40.912120 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:40.912036    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8020-6ed8b7" container="test-curl-8020-6ed8b7"
Sep 12 01:02:40.921555 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.921537    2576 scope.go:117] "RemoveContainer" containerID="61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113"
Sep 12 01:02:40.921830 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:40.921811    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113\": container with ID starting with 61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113 not found: ID does not exist" containerID="61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113"
Sep 12 01:02:40.921886 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.921837    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113"} err="failed to get container status \"61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113\": rpc error: code = NotFound desc = could not find container \"61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113\": container with ID starting with 61948dce6902681d0f445d7a33bd98f0684ae8fe7c5c77911524b65ebbbd1113 not found: ID does not exist"
Sep 12 01:02:40.923248 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:40.923230    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-65e81d\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" pod="opendatahub/test-curl-8020-65e81d"
Sep 12 01:02:40.959767 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:40.959740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:41.235562 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.235537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8020-34b9a5"]
Sep 12 01:02:41.236845 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:41.236823    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb8672bb_fb48_4ec9_95a6_cbb68f17da77.slice/crio-e2346fbd5a85afbca95e4bc9c216cbdf4ec13554d80d170bcc8d49606220ff39 WatchSource:0}: Error finding container e2346fbd5a85afbca95e4bc9c216cbdf4ec13554d80d170bcc8d49606220ff39: Status 404 returned error can't find the container with id e2346fbd5a85afbca95e4bc9c216cbdf4ec13554d80d170bcc8d49606220ff39
Sep 12 01:02:41.582871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.582793    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73478bc2-d05a-40e3-9db3-8b7c2cbb2102" path="/var/lib/kubelet/pods/73478bc2-d05a-40e3-9db3-8b7c2cbb2102/volumes"
Sep 12 01:02:41.922646 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.922620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-34b9a5" event={"ID":"cb8672bb-fb48-4ec9-95a6-cbb68f17da77","Type":"ContainerStarted","Data":"922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4"}
Sep 12 01:02:41.923001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.922657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8020-34b9a5" event={"ID":"cb8672bb-fb48-4ec9-95a6-cbb68f17da77","Type":"ContainerStarted","Data":"e2346fbd5a85afbca95e4bc9c216cbdf4ec13554d80d170bcc8d49606220ff39"}
Sep 12 01:02:41.923001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.922832    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8020-6ed8b7" podUID="77654182-17d2-4e4c-8bac-b88925736e21" containerName="test-curl-8020-6ed8b7" containerID="cri-o://2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f" gracePeriod=2
Sep 12 01:02:41.936946 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:41.936899    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-8020-34b9a5" podStartSLOduration=1.936883047 podStartE2EDuration="1.936883047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:41.935535481 +0000 UTC m=+1184.848214418" watchObservedRunningTime="2026-09-12 01:02:41.936883047 +0000 UTC m=+1184.849561984"
Sep 12 01:02:42.092390 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.092368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:42.197209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.197124    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8d22\" (UniqueName: \"kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22\") pod \"0db23b96-6871-4ec1-95ef-050373d229dd\" (UID: \"0db23b96-6871-4ec1-95ef-050373d229dd\") "
Sep 12 01:02:42.199343 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.199312    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22" (OuterVolumeSpecName: "kube-api-access-x8d22") pod "0db23b96-6871-4ec1-95ef-050373d229dd" (UID: "0db23b96-6871-4ec1-95ef-050373d229dd"). InnerVolumeSpecName "kube-api-access-x8d22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:42.298897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.298869    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8d22\" (UniqueName: \"kubernetes.io/projected/0db23b96-6871-4ec1-95ef-050373d229dd-kube-api-access-x8d22\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:42.534728 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.534635    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8020-34b9a5"]
Sep 12 01:02:42.540262 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.540232    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8020-34b9a5"]
Sep 12 01:02:42.930986 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.930950    2576 generic.go:356] "Generic (PLEG): container finished" podID="0db23b96-6871-4ec1-95ef-050373d229dd" containerID="9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7" exitCode=137
Sep 12 01:02:42.930986 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.930989    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:42.931538 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.931020    2576 scope.go:117] "RemoveContainer" containerID="9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7"
Sep 12 01:02:42.931538 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:42.931299    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-8020-34b9a5" container="test-curl-8020-34b9a5"
Sep 12 01:02:42.941532 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:42.941508    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-67a686\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:42.941620 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.941515    2576 scope.go:117] "RemoveContainer" containerID="9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7"
Sep 12 01:02:42.941833 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:42.941814    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7\": container with ID starting with 9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7 not found: ID does not exist" containerID="9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7"
Sep 12 01:02:42.941885 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:42.941844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7"} err="failed to get container status \"9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7\": rpc error: code = NotFound desc = could not find container \"9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7\": container with ID starting with 9ede49b0cc6db4952a8d5f0c0516295cdd0f20697badea45a8272b1808553ed7 not found: ID does not exist"
Sep 12 01:02:43.565844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.565814    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:02:43.566270 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.566257    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" containerName="test-curl-8020-34b9a5"
Sep 12 01:02:43.566270 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.566287    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" containerName="test-curl-8020-34b9a5"
Sep 12 01:02:43.566422 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.566411    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" containerName="test-curl-8020-34b9a5"
Sep 12 01:02:43.571811 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.571795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.574194 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.574174    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0cfc70f5-openshift-default-dockercfg-6k84h\""
Sep 12 01:02:43.582798 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.582776    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" path="/var/lib/kubelet/pods/0db23b96-6871-4ec1-95ef-050373d229dd/volumes"
Sep 12 01:02:43.586751 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.586727    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:02:43.607902 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:43.607865    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-67a686\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="0db23b96-6871-4ec1-95ef-050373d229dd" pod="opendatahub/test-curl-8020-67a686"
Sep 12 01:02:43.612342 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612470 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612514 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612551 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddz4j\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612601 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612637 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612674 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612674 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.612738 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.612687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.713902 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.713869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.713902 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.713907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714121 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.713989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714121 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddz4j\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714121 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714121 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714590 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714590 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714705 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.714879 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.714856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.716507 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.716491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.716911 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.716891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.728200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.728180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddz4j\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.729932 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.729912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token\") pod \"e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") " pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.882978 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.882891    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:43.950599 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:43.950562    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-8020-34b9a5" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" containerName="test-curl-8020-34b9a5" containerID="cri-o://922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4" gracePeriod=2
Sep 12 01:02:44.086044 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.086021    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:44.118369 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.118338    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9jz5\" (UniqueName: \"kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5\") pod \"77654182-17d2-4e4c-8bac-b88925736e21\" (UID: \"77654182-17d2-4e4c-8bac-b88925736e21\") "
Sep 12 01:02:44.120488 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.120466    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5" (OuterVolumeSpecName: "kube-api-access-x9jz5") pod "77654182-17d2-4e4c-8bac-b88925736e21" (UID: "77654182-17d2-4e4c-8bac-b88925736e21"). InnerVolumeSpecName "kube-api-access-x9jz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:44.166689 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.166658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:02:44.167359 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:02:44.167335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f49a27_38a6_4c35_b391_1a8d4dc96974.slice/crio-102d9b5f7d5860d6c1830c46c3e137fc917f53974304e83a5879cd226bc45726 WatchSource:0}: Error finding container 102d9b5f7d5860d6c1830c46c3e137fc917f53974304e83a5879cd226bc45726: Status 404 returned error can't find the container with id 102d9b5f7d5860d6c1830c46c3e137fc917f53974304e83a5879cd226bc45726
Sep 12 01:02:44.169784 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.169743    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:44.169903 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.169829    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:44.169903 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.169875    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:02:44.220247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.220216    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9jz5\" (UniqueName: \"kubernetes.io/projected/77654182-17d2-4e4c-8bac-b88925736e21-kube-api-access-x9jz5\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:44.959149 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.959111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerStarted","Data":"2b80c37668479068e28c0cfefd7fe7ede32f8653dab3966709fd3722ab4ad1af"}
Sep 12 01:02:44.959601 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.959186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerStarted","Data":"102d9b5f7d5860d6c1830c46c3e137fc917f53974304e83a5879cd226bc45726"}
Sep 12 01:02:44.960542 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.960518    2576 generic.go:356] "Generic (PLEG): container finished" podID="77654182-17d2-4e4c-8bac-b88925736e21" containerID="2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f" exitCode=137
Sep 12 01:02:44.960640 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.960553    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:44.960640 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.960624    2576 scope.go:117] "RemoveContainer" containerID="2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f"
Sep 12 01:02:44.971082 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.971052    2576 scope.go:117] "RemoveContainer" containerID="2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f"
Sep 12 01:02:44.971400 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:44.971381    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f\": container with ID starting with 2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f not found: ID does not exist" containerID="2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f"
Sep 12 01:02:44.971485 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.971409    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f"} err="failed to get container status \"2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f\": rpc error: code = NotFound desc = could not find container \"2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f\": container with ID starting with 2990370a2e596d93d2f62ea689bb053d92457032c72447ec90393526732ef96f not found: ID does not exist"
Sep 12 01:02:44.980587 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:44.980526    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-6ed8b7\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="77654182-17d2-4e4c-8bac-b88925736e21" pod="opendatahub/test-curl-8020-6ed8b7"
Sep 12 01:02:44.980685 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:44.980620    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podStartSLOduration=1.9806077979999999 podStartE2EDuration="1.980607798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:02:44.978602017 +0000 UTC m=+1187.891280975" watchObservedRunningTime="2026-09-12 01:02:44.980607798 +0000 UTC m=+1187.893286735"
Sep 12 01:02:45.584144 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:45.584113    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77654182-17d2-4e4c-8bac-b88925736e21" path="/var/lib/kubelet/pods/77654182-17d2-4e4c-8bac-b88925736e21/volumes"
Sep 12 01:02:45.883769 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:45.883692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:45.888900 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:45.888873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:45.969066 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:45.969041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:45.970101 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:45.970082    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:02:46.153012 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.152987    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:46.240798 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.240765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz27s\" (UniqueName: \"kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s\") pod \"cb8672bb-fb48-4ec9-95a6-cbb68f17da77\" (UID: \"cb8672bb-fb48-4ec9-95a6-cbb68f17da77\") "
Sep 12 01:02:46.242999 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.242974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s" (OuterVolumeSpecName: "kube-api-access-pz27s") pod "cb8672bb-fb48-4ec9-95a6-cbb68f17da77" (UID: "cb8672bb-fb48-4ec9-95a6-cbb68f17da77"). InnerVolumeSpecName "kube-api-access-pz27s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:46.341909 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.341872    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz27s\" (UniqueName: \"kubernetes.io/projected/cb8672bb-fb48-4ec9-95a6-cbb68f17da77-kube-api-access-pz27s\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:46.978789 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.978755    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" containerID="922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4" exitCode=137
Sep 12 01:02:46.979257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.978799    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:46.979257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.978861    2576 scope.go:117] "RemoveContainer" containerID="922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4"
Sep 12 01:02:46.989308 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.989288    2576 scope.go:117] "RemoveContainer" containerID="922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4"
Sep 12 01:02:46.989626 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:46.989607    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4\": container with ID starting with 922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4 not found: ID does not exist" containerID="922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4"
Sep 12 01:02:46.989679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:46.989635    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4"} err="failed to get container status \"922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4\": rpc error: code = NotFound desc = could not find container \"922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4\": container with ID starting with 922c071a8ba7a008839cbb8c67b936b228ef66acbc39aabac57d6b70d55300d4 not found: ID does not exist"
Sep 12 01:02:46.989740 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:46.989712    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-34b9a5\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:47.189001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:47.188965    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:02:47.581208 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:47.581160    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-8020-34b9a5\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" pod="opendatahub/test-curl-8020-34b9a5"
Sep 12 01:02:47.583251 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:47.583223    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8672bb-fb48-4ec9-95a6-cbb68f17da77" path="/var/lib/kubelet/pods/cb8672bb-fb48-4ec9-95a6-cbb68f17da77/volumes"
Sep 12 01:02:53.604815 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.604755    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" podUID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" containerName="main" containerID="cri-o://e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5" gracePeriod=45
Sep 12 01:02:53.866157 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.866099    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 01:02:53.922620 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922590    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcdzf\" (UniqueName: \"kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922779 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922779 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922705    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922779 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922779 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922987 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache\") pod \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\" (UID: \"fd87dc48-d2f8-488a-ad9b-ee55cfc57106\") "
Sep 12 01:02:53.922987 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.922917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:02:53.923250 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.923209    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:02:53.923250 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.923243    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:53.923665 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.923263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home" (OuterVolumeSpecName: "home") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:02:53.925137 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.925111    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:02:53.925252 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.925164    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf" (OuterVolumeSpecName: "kube-api-access-bcdzf") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "kube-api-access-bcdzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:02:53.925502 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:53.925488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm" (OuterVolumeSpecName: "dshm") pod "fd87dc48-d2f8-488a-ad9b-ee55cfc57106" (UID: "fd87dc48-d2f8-488a-ad9b-ee55cfc57106"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:02:54.024769 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.024728    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdzf\" (UniqueName: \"kubernetes.io/projected/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-kube-api-access-bcdzf\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:54.024769 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.024761    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:54.024949 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.024782    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:54.024949 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.024803    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:54.024949 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.024824    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd87dc48-d2f8-488a-ad9b-ee55cfc57106-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:02:54.027964 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.027933    2576 generic.go:356] "Generic (PLEG): container finished" podID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" containerID="e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5" exitCode=0
Sep 12 01:02:54.028076 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.027974    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"
Sep 12 01:02:54.028076 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.028028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" event={"ID":"fd87dc48-d2f8-488a-ad9b-ee55cfc57106","Type":"ContainerDied","Data":"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"}
Sep 12 01:02:54.028076 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.028066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw" event={"ID":"fd87dc48-d2f8-488a-ad9b-ee55cfc57106","Type":"ContainerDied","Data":"c316addd0ff00ba23c77ea87aacf7489c4d75e30021c3f0ed8b1298373c00acf"}
Sep 12 01:02:54.028189 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.028083    2576 scope.go:117] "RemoveContainer" containerID="e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"
Sep 12 01:02:54.047539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.047522    2576 scope.go:117] "RemoveContainer" containerID="e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"
Sep 12 01:02:54.047803 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:02:54.047780    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5\": container with ID starting with e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5 not found: ID does not exist" containerID="e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"
Sep 12 01:02:54.047878 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.047814    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5"} err="failed to get container status \"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5\": rpc error: code = NotFound desc = could not find container \"e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5\": container with ID starting with e5d2e649b9c19d83a52e7bd9436569ca95acbf9074be64d2a81d2dce737e7da5 not found: ID does not exist"
Sep 12 01:02:54.058324 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.058298    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 01:02:54.061358 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:54.061334    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-bf547a/test-model-bf547a-kserve-8669d45df9-svvqw"]
Sep 12 01:02:55.583776 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:55.583744    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" path="/var/lib/kubelet/pods/fd87dc48-d2f8-488a-ad9b-ee55cfc57106/volumes"
Sep 12 01:02:58.711322 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:02:58.711270    2576 scope.go:117] "RemoveContainer" containerID="76032045539f6d69459929692f040485594dddba539aedf2bf14966681109a48"
Sep 12 01:03:09.148235 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.148144    2576 generic.go:356] "Generic (PLEG): container finished" podID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerID="2b80c37668479068e28c0cfefd7fe7ede32f8653dab3966709fd3722ab4ad1af" exitCode=0
Sep 12 01:03:09.148235 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.148220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerDied","Data":"2b80c37668479068e28c0cfefd7fe7ede32f8653dab3966709fd3722ab4ad1af"}
Sep 12 01:03:09.148708 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.148659    2576 scope.go:117] "RemoveContainer" containerID="2b80c37668479068e28c0cfefd7fe7ede32f8653dab3966709fd3722ab4ad1af"
Sep 12 01:03:09.149865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.149828    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:09.149975 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.149916    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:09.149975 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:09.149962    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:10.157017 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:10.156986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerStarted","Data":"77892c00f38fcb0534d30ab5e1fb70621ef972fe8c9b4092da1a06a8e83caea1"}
Sep 12 01:03:10.883603 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:10.883569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:03:10.883779 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:10.883730    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:10.883824 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:10.883791    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:11.884014 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:11.883958    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:11.884554 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:11.884041    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:12.883378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:12.883338    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:12.883682 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:12.883650    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:12.966528 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:12.966499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:03:13.884812 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:13.884775    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:13.885015 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:13.884833    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:14.884078 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:14.884036    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:14.884607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:14.884100    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:15.884157 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:15.884120    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:15.884773 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:15.884740    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:15.969710 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:15.969678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:03:16.343033 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:16.343001    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 01:03:16.343235 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:16.343213    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy" containerID="cri-o://9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22" gracePeriod=30
Sep 12 01:03:16.883422 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:16.883377    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Sep 12 01:03:16.883635 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:16.883444    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Sep 12 01:03:17.274045 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.274008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:03:17.274750 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.274732    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" containerName="main"
Sep 12 01:03:17.274750 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.274751    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" containerName="main"
Sep 12 01:03:17.274890 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.274847    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd87dc48-d2f8-488a-ad9b-ee55cfc57106" containerName="main"
Sep 12 01:03:17.278203 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.278182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.280489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.280467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-61f73f-openshift-default-dockercfg-4v47f\""
Sep 12 01:03:17.289324 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.289298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:03:17.375940 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.375885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.375977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vljjm\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.376484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.376349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.477647 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.477614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.477647 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.477647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.477920 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.477705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.477920 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.477734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478132 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478132 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vljjm\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478246 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478246 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478246 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478935 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478653    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478935 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.478935 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.478901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.479230 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.479193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.480733 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.480710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.481089 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.481073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.486625 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.486591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vljjm\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.486625 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.486604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token\") pod \"e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") " pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.589844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.589757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:17.888386 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.888304    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:03:17.889444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.889421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:03:17.896035 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.896015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:03:17.898052 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:03:17.898029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b40b72_4da2_4f9c_b3f9_45597df361be.slice/crio-aaddec9e9db518d87156083a9361c3749db5e7170893723c3d836e6fdc8a201c WatchSource:0}: Error finding container aaddec9e9db518d87156083a9361c3749db5e7170893723c3d836e6fdc8a201c: Status 404 returned error can't find the container with id aaddec9e9db518d87156083a9361c3749db5e7170893723c3d836e6fdc8a201c
Sep 12 01:03:17.900440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.900406    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:17.900554 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.900483    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:17.900554 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:17.900526    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:18.226539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:18.226505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerStarted","Data":"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"}
Sep 12 01:03:18.226748 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:18.226562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerStarted","Data":"aaddec9e9db518d87156083a9361c3749db5e7170893723c3d836e6fdc8a201c"}
Sep 12 01:03:18.250474 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:18.250425    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podStartSLOduration=1.250406347 podStartE2EDuration="1.250406347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:18.247603071 +0000 UTC m=+1221.160282008" watchObservedRunningTime="2026-09-12 01:03:18.250406347 +0000 UTC m=+1221.163085284"
Sep 12 01:03:18.590720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:18.590636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:18.595899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:18.595876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:19.233803 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:19.233764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:19.234804 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:19.234780    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:21.600639 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.600614    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 01:03:21.724001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.723969    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724160 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724160 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724066    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724160 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724098    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8td\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724264 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724264 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724218    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724379 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724352    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:03:21.724434 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724412    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724434 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:03:21.724545 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:03:21.724545 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724648 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data\") pod \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\" (UID: \"59c32b82-7f3c-498d-ac48-3e3dedb484e6\") "
Sep 12 01:03:21.724795 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724805    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724958    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724971    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724979    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724988    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.725084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.724997    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.726500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.726478    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:03:21.726773 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.726756    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td" (OuterVolumeSpecName: "kube-api-access-jl8td") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "kube-api-access-jl8td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:03:21.726870 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.726854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:03:21.726870 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.726855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59c32b82-7f3c-498d-ac48-3e3dedb484e6" (UID: "59c32b82-7f3c-498d-ac48-3e3dedb484e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:03:21.825937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.825907    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.825937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.825933    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8td\" (UniqueName: \"kubernetes.io/projected/59c32b82-7f3c-498d-ac48-3e3dedb484e6-kube-api-access-jl8td\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.825937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.825944    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:21.826142 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:21.825953    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59c32b82-7f3c-498d-ac48-3e3dedb484e6-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:03:22.256368 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.256330    2576 generic.go:356] "Generic (PLEG): container finished" podID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerID="9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22" exitCode=0
Sep 12 01:03:22.256575 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.256380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"
Sep 12 01:03:22.256575 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.256412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerDied","Data":"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"}
Sep 12 01:03:22.256575 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.256470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62" event={"ID":"59c32b82-7f3c-498d-ac48-3e3dedb484e6","Type":"ContainerDied","Data":"060fd34d509610645c3558e8a74856faa03bc8563b86cef6d20c5bca0e17b763"}
Sep 12 01:03:22.256575 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.256494    2576 scope.go:117] "RemoveContainer" containerID="9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"
Sep 12 01:03:22.270261 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.270236    2576 scope.go:117] "RemoveContainer" containerID="4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"
Sep 12 01:03:22.280426 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.280401    2576 scope.go:117] "RemoveContainer" containerID="9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"
Sep 12 01:03:22.280724 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:03:22.280703    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22\": container with ID starting with 9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22 not found: ID does not exist" containerID="9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"
Sep 12 01:03:22.280808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.280733    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22"} err="failed to get container status \"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22\": rpc error: code = NotFound desc = could not find container \"9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22\": container with ID starting with 9d35b69cbd05785cf9319255e799cbc2d72c806a91775a4fe6063dd832303c22 not found: ID does not exist"
Sep 12 01:03:22.280808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.280750    2576 scope.go:117] "RemoveContainer" containerID="4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"
Sep 12 01:03:22.281075 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:03:22.281053    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65\": container with ID starting with 4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65 not found: ID does not exist" containerID="4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"
Sep 12 01:03:22.281114 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.281087    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65"} err="failed to get container status \"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65\": rpc error: code = NotFound desc = could not find container \"4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65\": container with ID starting with 4c238e24d7ac32769d907b82e94715163662a99427c9ff86ece160690755be65 not found: ID does not exist"
Sep 12 01:03:22.282954 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.282933    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 01:03:22.287993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:22.287973    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-bf547a-openshift-default-6885c86f5d-58n62"]
Sep 12 01:03:23.582294 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:23.582253    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" path="/var/lib/kubelet/pods/59c32b82-7f3c-498d-ac48-3e3dedb484e6/volumes"
Sep 12 01:03:24.722314 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.722254    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:03:24.724773 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.724743    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.725028 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.724998    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.725171 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.725056    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.725171 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.725067    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.725331 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.725209    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.725331 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.725226    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c32b82-7f3c-498d-ac48-3e3dedb484e6" containerName="istio-proxy"
Sep 12 01:03:24.727913 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.727888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.731463 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.731441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-bafa8a\"/\"kube-root-ca.crt\""
Sep 12 01:03:24.731667 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.731441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-bafa8a\"/\"openshift-service-ca.crt\""
Sep 12 01:03:24.731823 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.731521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-bafa8a\"/\"default-dockercfg-tjq57\""
Sep 12 01:03:24.732016 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.731541    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-bafa8a\"/\"noten-model-bafa8a-kserve-self-signed-certs\""
Sep 12 01:03:24.737200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.737179    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:03:24.856994 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.856966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.857139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.857010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.857139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.857035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shghv\" (UniqueName: \"kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.857139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.857054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.857139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.857078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.857321 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.857191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958092 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shghv\" (UniqueName: \"kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958311 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958659 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.958771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.958757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.960494 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.960469    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.960736 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.960717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:24.965498 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:24.965478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shghv\" (UniqueName: \"kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv\") pod \"noten-model-bafa8a-kserve-6544975d7-xjsbf\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") " pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:25.041674 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:25.041585    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:25.319662 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:25.319628    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:03:25.319797 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:03:25.319783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37b9747b_5460_4d8f_b55a_8c42e26ba4a7.slice/crio-8c44dbd29c885d21beaa4e849ff2fe7da66a702391942366d54917e779c49aef WatchSource:0}: Error finding container 8c44dbd29c885d21beaa4e849ff2fe7da66a702391942366d54917e779c49aef: Status 404 returned error can't find the container with id 8c44dbd29c885d21beaa4e849ff2fe7da66a702391942366d54917e779c49aef
Sep 12 01:03:26.287187 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:26.287148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" event={"ID":"37b9747b-5460-4d8f-b55a-8c42e26ba4a7","Type":"ContainerStarted","Data":"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"}
Sep 12 01:03:26.287619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:26.287197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" event={"ID":"37b9747b-5460-4d8f-b55a-8c42e26ba4a7","Type":"ContainerStarted","Data":"8c44dbd29c885d21beaa4e849ff2fe7da66a702391942366d54917e779c49aef"}
Sep 12 01:03:26.327513 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:26.327460    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" podStartSLOduration=2.327444053 podStartE2EDuration="2.327444053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:26.325426219 +0000 UTC m=+1229.238105166" watchObservedRunningTime="2026-09-12 01:03:26.327444053 +0000 UTC m=+1229.240123030"
Sep 12 01:03:35.042175 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:35.042138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:35.042175 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:35.042183    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:35.054970 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:35.054945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:35.361464 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:35.361380    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:03:39.265293 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:39.265248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:03:40.237556 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.237512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:03:40.241970 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.241943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.244742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.244711    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"openshift-service-ca.crt\""
Sep 12 01:03:40.245490 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.245468    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"kube-root-ca.crt\""
Sep 12 01:03:40.245490 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.245481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"e2e-conflict-b-f6b886e1-kserve-self-signed-certs\""
Sep 12 01:03:40.245686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.245597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"default-dockercfg-r5zvh\""
Sep 12 01:03:40.255823 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.255801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:03:40.321675 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.322040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q5g5\" (UniqueName: \"kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.322040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.322040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.322040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.322040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.321850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.422996 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.422941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q5g5\" (UniqueName: \"kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423491 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.423778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.423753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.424195 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.424175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.424574 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.424555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.428650 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.428627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.436711 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.429024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.440878 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.440302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q5g5\" (UniqueName: \"kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5\") pod \"e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") " pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.553609 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.553507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:40.843520 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:40.843496    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:03:40.844812 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:03:40.844784    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25b2db7a_1954_49ae_b669_fe2edede54a3.slice/crio-70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808 WatchSource:0}: Error finding container 70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808: Status 404 returned error can't find the container with id 70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808
Sep 12 01:03:41.399047 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:41.399008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" event={"ID":"25b2db7a-1954-49ae-b669-fe2edede54a3","Type":"ContainerStarted","Data":"825afb3fdf2142bd608ae93e1007cc0534465f8ca56049eae11e3f9c0bbf14f8"}
Sep 12 01:03:41.399557 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:41.399064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" event={"ID":"25b2db7a-1954-49ae-b669-fe2edede54a3","Type":"ContainerStarted","Data":"70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808"}
Sep 12 01:03:41.418297 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:41.418224    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" podStartSLOduration=1.418208267 podStartE2EDuration="1.418208267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:41.416261663 +0000 UTC m=+1244.328940600" watchObservedRunningTime="2026-09-12 01:03:41.418208267 +0000 UTC m=+1244.330887200"
Sep 12 01:03:49.336139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.336104    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": read tcp 10.133.0.2:49608->10.133.0.90:15021: read: connection reset by peer" start-of-body=
Sep 12 01:03:49.336584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.336176    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": read tcp 10.133.0.2:49608->10.133.0.90:15021: read: connection reset by peer"
Sep 12 01:03:49.457004 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.456972    2576 generic.go:356] "Generic (PLEG): container finished" podID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerID="a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9" exitCode=0
Sep 12 01:03:49.457152 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.457049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerDied","Data":"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"}
Sep 12 01:03:49.457490 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.457474    2576 scope.go:117] "RemoveContainer" containerID="a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"
Sep 12 01:03:49.458627 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.458599    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:49.458689 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.458664    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:49.458726 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:49.458694    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:50.490302 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.487777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerStarted","Data":"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"}
Sep 12 01:03:50.554155 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.554121    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:50.554513 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.554482    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:50.566887 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.566860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:50.590622 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.590589    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:50.590933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.590779    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:50.591111 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.591088    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:50.855817 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.855743    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:03:50.858603 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.858581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.861649 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.861629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-ef5997-openshift-default-dockercfg-w6jwm\""
Sep 12 01:03:50.876923 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.876890    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:03:50.960943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.960904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961152 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.960990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961152 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961152 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxq7w\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:50.961411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:50.961323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxq7w\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062907 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.062972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.062924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.063137 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.063110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.063255 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.063137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.068368 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.068346    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.068614 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.068595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.071049 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.071019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.071206 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.071176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxq7w\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w\") pod \"e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") " pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.170312 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.170265    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:51.500354 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.480474    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:03:51.505519 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:03:51.505487    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc07d692_673d_4128_b76c_98aa4322e666.slice/crio-255d70f190782b985aede0cf64ca874b2510e438bb921a8bcf7bfbcc6fddf2c6 WatchSource:0}: Error finding container 255d70f190782b985aede0cf64ca874b2510e438bb921a8bcf7bfbcc6fddf2c6: Status 404 returned error can't find the container with id 255d70f190782b985aede0cf64ca874b2510e438bb921a8bcf7bfbcc6fddf2c6
Sep 12 01:03:51.507971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.507924    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:51.508065 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.508018    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:51.508114 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.508060    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:03:51.514878 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.514839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:03:51.595297 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.591808    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:51.595297 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:51.591887    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:52.510190 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:52.510148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerStarted","Data":"03270c67e2d456d55d95cb33466e136ea39e3f518055a7b1c524eb4ce109ed47"}
Sep 12 01:03:52.510683 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:52.510204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerStarted","Data":"255d70f190782b985aede0cf64ca874b2510e438bb921a8bcf7bfbcc6fddf2c6"}
Sep 12 01:03:52.535519 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:52.535472    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podStartSLOduration=2.535456837 podStartE2EDuration="2.535456837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:03:52.532268792 +0000 UTC m=+1255.444947784" watchObservedRunningTime="2026-09-12 01:03:52.535456837 +0000 UTC m=+1255.448135774"
Sep 12 01:03:52.590937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:52.590899    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:52.591238 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:52.591206    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:53.173250 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.173211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:53.185535 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.185508    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:53.517960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.517864    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:53.518809 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.518789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:03:53.597301 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.591664    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:53.597301 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:53.591727    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:54.590259 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:54.590219    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:54.591254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:54.590815    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:55.590991 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:55.590957    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused" start-of-body=
Sep 12 01:03:55.591411 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:55.591011    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.90:15021/healthz/ready\": dial tcp 10.133.0.90:15021: connect: connection refused"
Sep 12 01:03:55.839063 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:55.839030    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:03:55.839302 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:55.839249    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" podUID="3f3ca84c-725b-448b-af9c-94c7a9168615" containerName="istio-proxy" containerID="cri-o://629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956" gracePeriod=30
Sep 12 01:03:56.594237 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:56.594201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:56.594717 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:56.594611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:56.595314 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:56.595268    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:03:58.806297 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:03:58.806247    2576 scope.go:117] "RemoveContainer" containerID="dcbb1c901c02b0aea9f8f7dc8c8f9c47ac4acc0968bf4702969b5fe15391e50c"
Sep 12 01:04:00.037187 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.037152    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:04:00.040806 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.040785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.044604 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.044580    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-ef5997\""
Sep 12 01:04:00.044773 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.044753    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-ef5997-dockercfg-kctmv\""
Sep 12 01:04:00.053904 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.053880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:04:00.167355 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.167319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrmqc\" (UniqueName: \"kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.167525 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.167448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.268661 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.268631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrmqc\" (UniqueName: \"kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.268854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.268725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.269454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.269433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.277265 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.277237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrmqc\" (UniqueName: \"kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc\") pod \"payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.352214 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.352150    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:00.627129 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:00.627098    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:04:00.627512 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:04:00.627490    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a0185f_afaf_4a3b_b03f_49ad22b868b3.slice/crio-15ef9df182adafd582c2fc5b2effafe102cc9f89b91702366235cf7f75031d33 WatchSource:0}: Error finding container 15ef9df182adafd582c2fc5b2effafe102cc9f89b91702366235cf7f75031d33: Status 404 returned error can't find the container with id 15ef9df182adafd582c2fc5b2effafe102cc9f89b91702366235cf7f75031d33
Sep 12 01:04:01.080489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.080458    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:04:01.150415 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.150382    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:04:01.179620 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k28jg\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179740    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179901    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.179962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.179964    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy\") pod \"3f3ca84c-725b-448b-af9c-94c7a9168615\" (UID: \"3f3ca84c-725b-448b-af9c-94c7a9168615\") "
Sep 12 01:04:01.180209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180006    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:01.180209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180054    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:04:01.180426 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180407    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f3ca84c-725b-448b-af9c-94c7a9168615-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.180556 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180431    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.180556 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:01.180687 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180634    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:01.180731 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.180687    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:01.181989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.181965    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:04:01.182098 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.182050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg" (OuterVolumeSpecName: "kube-api-access-k28jg") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "kube-api-access-k28jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:04:01.182182 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.182160    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:04:01.182589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.182574    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f3ca84c-725b-448b-af9c-94c7a9168615" (UID: "3f3ca84c-725b-448b-af9c-94c7a9168615"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.280981    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281008    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281024    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281038    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281050    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281063    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.281407 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.281075    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k28jg\" (UniqueName: \"kubernetes.io/projected/3f3ca84c-725b-448b-af9c-94c7a9168615-kube-api-access-k28jg\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:01.586175 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.586096    2576 generic.go:356] "Generic (PLEG): container finished" podID="3f3ca84c-725b-448b-af9c-94c7a9168615" containerID="629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956" exitCode=0
Sep 12 01:04:01.586175 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.586147    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"
Sep 12 01:04:01.586403 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.586185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" event={"ID":"3f3ca84c-725b-448b-af9c-94c7a9168615","Type":"ContainerDied","Data":"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"}
Sep 12 01:04:01.586403 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.586233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z" event={"ID":"3f3ca84c-725b-448b-af9c-94c7a9168615","Type":"ContainerDied","Data":"b035621e01ffd35eba0235f1a43fa5d8df4c69870af116a13fe32c368b020e48"}
Sep 12 01:04:01.586403 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.586257    2576 scope.go:117] "RemoveContainer" containerID="629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"
Sep 12 01:04:01.588242 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.588212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" event={"ID":"c3a0185f-afaf-4a3b-b03f-49ad22b868b3","Type":"ContainerStarted","Data":"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"}
Sep 12 01:04:01.588392 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.588368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:01.588438 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.588404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" event={"ID":"c3a0185f-afaf-4a3b-b03f-49ad22b868b3","Type":"ContainerStarted","Data":"15ef9df182adafd582c2fc5b2effafe102cc9f89b91702366235cf7f75031d33"}
Sep 12 01:04:01.597796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.597780    2576 scope.go:117] "RemoveContainer" containerID="629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"
Sep 12 01:04:01.598054 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:04:01.598040    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956\": container with ID starting with 629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956 not found: ID does not exist" containerID="629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"
Sep 12 01:04:01.598105 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.598061    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956"} err="failed to get container status \"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956\": rpc error: code = NotFound desc = could not find container \"629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956\": container with ID starting with 629393735d9f654907f43313d15f731d02bea5f7e92009d84dbff3f8dad14956 not found: ID does not exist"
Sep 12 01:04:01.608397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.608354    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" podStartSLOduration=1.608340814 podStartE2EDuration="1.608340814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:04:01.607101546 +0000 UTC m=+1264.519780484" watchObservedRunningTime="2026-09-12 01:04:01.608340814 +0000 UTC m=+1264.521019750"
Sep 12 01:04:01.625438 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.625413    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:04:01.628371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:01.628351    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-bafa8a-openshift-default-6df8445d78-mfh8z"]
Sep 12 01:04:03.582429 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:03.582400    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3ca84c-725b-448b-af9c-94c7a9168615" path="/var/lib/kubelet/pods/3f3ca84c-725b-448b-af9c-94c7a9168615/volumes"
Sep 12 01:04:04.764070 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:04.764024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:04:09.138087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.138055    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:04:09.138645 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.138630    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3ca84c-725b-448b-af9c-94c7a9168615" containerName="istio-proxy"
Sep 12 01:04:09.138690 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.138647    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3ca84c-725b-448b-af9c-94c7a9168615" containerName="istio-proxy"
Sep 12 01:04:09.138748 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.138739    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3ca84c-725b-448b-af9c-94c7a9168615" containerName="istio-proxy"
Sep 12 01:04:09.141791 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.141776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.144966 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.144933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0cfc70f5\"/\"e2e-lifecycle-model-0cfc70f5-kserve-self-signed-certs\""
Sep 12 01:04:09.144966 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.144940    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0cfc70f5\"/\"openshift-service-ca.crt\""
Sep 12 01:04:09.145147 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.144985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0cfc70f5\"/\"kube-root-ca.crt\""
Sep 12 01:04:09.145147 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.144962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0cfc70f5\"/\"default-dockercfg-42gbh\""
Sep 12 01:04:09.150425 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.150399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:04:09.162467 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.162592 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.162592 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5rfh\" (UniqueName: \"kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.162685 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.162730 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.162730 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.162723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264227 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264678 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5rfh\" (UniqueName: \"kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264678 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264653    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264781 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.264864 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.264833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.266785 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.266765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.267010 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.266990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.273112 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.273091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5rfh\" (UniqueName: \"kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh\") pod \"e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") " pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.454119 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.454093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:09.731136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:09.731103    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:04:09.731708 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:04:09.731687    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac3ab59e_3a07_45dc_bc98_798088039c75.slice/crio-849caf5059e602c09e893bd6e8003c6af59c5449b053eaebb1f940c7ec949ac5 WatchSource:0}: Error finding container 849caf5059e602c09e893bd6e8003c6af59c5449b053eaebb1f940c7ec949ac5: Status 404 returned error can't find the container with id 849caf5059e602c09e893bd6e8003c6af59c5449b053eaebb1f940c7ec949ac5
Sep 12 01:04:10.651103 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:10.651059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" event={"ID":"ac3ab59e-3a07-45dc-bc98-798088039c75","Type":"ContainerStarted","Data":"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"}
Sep 12 01:04:10.651536 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:10.651114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" event={"ID":"ac3ab59e-3a07-45dc-bc98-798088039c75","Type":"ContainerStarted","Data":"849caf5059e602c09e893bd6e8003c6af59c5449b053eaebb1f940c7ec949ac5"}
Sep 12 01:04:10.669899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:10.669847    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" podStartSLOduration=1.669832005 podStartE2EDuration="1.669832005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:04:10.668633929 +0000 UTC m=+1273.581312894" watchObservedRunningTime="2026-09-12 01:04:10.669832005 +0000 UTC m=+1273.582510965"
Sep 12 01:04:12.598951 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:12.598924    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:04:16.171118 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.171071    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" podUID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" containerName="main" containerID="cri-o://bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e" gracePeriod=45
Sep 12 01:04:16.436361 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.436295    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:04:16.547705 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547675    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.547874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.547874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.547874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.547874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.547874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547867    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shghv\" (UniqueName: \"kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv\") pod \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\" (UID: \"37b9747b-5460-4d8f-b55a-8c42e26ba4a7\") "
Sep 12 01:04:16.548139 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.547977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home" (OuterVolumeSpecName: "home") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:16.548203 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.548131    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:16.548203 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.548139    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:16.548326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.548270    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.548326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.548314    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.548326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.548324    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.550001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.549974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm" (OuterVolumeSpecName: "dshm") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:04:16.550001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.549992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv" (OuterVolumeSpecName: "kube-api-access-shghv") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "kube-api-access-shghv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:04:16.550188 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.550108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37b9747b-5460-4d8f-b55a-8c42e26ba4a7" (UID: "37b9747b-5460-4d8f-b55a-8c42e26ba4a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:04:16.649844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.649766    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.649844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.649802    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shghv\" (UniqueName: \"kubernetes.io/projected/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-kube-api-access-shghv\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.649844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.649819    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b9747b-5460-4d8f-b55a-8c42e26ba4a7-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:04:16.692718 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.692641    2576 generic.go:356] "Generic (PLEG): container finished" podID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" containerID="bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e" exitCode=0
Sep 12 01:04:16.692718 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.692687    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"
Sep 12 01:04:16.692873 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.692733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" event={"ID":"37b9747b-5460-4d8f-b55a-8c42e26ba4a7","Type":"ContainerDied","Data":"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"}
Sep 12 01:04:16.692873 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.692784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf" event={"ID":"37b9747b-5460-4d8f-b55a-8c42e26ba4a7","Type":"ContainerDied","Data":"8c44dbd29c885d21beaa4e849ff2fe7da66a702391942366d54917e779c49aef"}
Sep 12 01:04:16.692873 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.692803    2576 scope.go:117] "RemoveContainer" containerID="bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"
Sep 12 01:04:16.703245 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.703228    2576 scope.go:117] "RemoveContainer" containerID="bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"
Sep 12 01:04:16.703575 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:04:16.703552    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e\": container with ID starting with bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e not found: ID does not exist" containerID="bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"
Sep 12 01:04:16.703638 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.703584    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e"} err="failed to get container status \"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e\": rpc error: code = NotFound desc = could not find container \"bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e\": container with ID starting with bf6da0c5869fa4035873b9562c0e7675b3851b7334ddcf9b53d770ac5ef0c08e not found: ID does not exist"
Sep 12 01:04:16.715568 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.715532    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:04:16.718463 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:16.718439    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-bafa8a/noten-model-bafa8a-kserve-6544975d7-xjsbf"]
Sep 12 01:04:17.583742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:17.583709    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" path="/var/lib/kubelet/pods/37b9747b-5460-4d8f-b55a-8c42e26ba4a7/volumes"
Sep 12 01:04:19.454876 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:19.454825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:19.455328 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:19.454901    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:19.467881 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:19.467858    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:19.725146 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:19.725059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:04:24.032193 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.032157    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:04:24.032719 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.032653    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" containerName="main"
Sep 12 01:04:24.032719 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.032665    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" containerName="main"
Sep 12 01:04:24.032868 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.032750    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="37b9747b-5460-4d8f-b55a-8c42e26ba4a7" containerName="main"
Sep 12 01:04:24.037347 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.037325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.039961 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.039937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-10ba6f\"/\"distinct-2-w0-10ba6f-kserve-self-signed-certs\""
Sep 12 01:04:24.048486 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.048452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:04:24.130102 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44x44\" (UniqueName: \"kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.130307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.130307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.130397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.130397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.130467 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.130415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231429 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231429 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231701 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231701 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231701 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.231701 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.231590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44x44\" (UniqueName: \"kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.232196 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.232162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.232854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.232802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.235354 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.234972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.235354 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.235191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.235354 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.235266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.241424 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.241398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44x44\" (UniqueName: \"kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44\") pod \"distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") " pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.360040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.359946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:24.648389 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.648356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:04:24.649561 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:04:24.649535    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod153a47cb_10ad_485b_97ef_b9d8b1977013.slice/crio-dc4bc85e609541b2db94a75aad08601b5ed8fa72c34bec0a76449c63c2c26d6d WatchSource:0}: Error finding container dc4bc85e609541b2db94a75aad08601b5ed8fa72c34bec0a76449c63c2c26d6d: Status 404 returned error can't find the container with id dc4bc85e609541b2db94a75aad08601b5ed8fa72c34bec0a76449c63c2c26d6d
Sep 12 01:04:24.754866 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.754835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" event={"ID":"153a47cb-10ad-485b-97ef-b9d8b1977013","Type":"ContainerStarted","Data":"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"}
Sep 12 01:04:24.755086 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.754873    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" event={"ID":"153a47cb-10ad-485b-97ef-b9d8b1977013","Type":"ContainerStarted","Data":"dc4bc85e609541b2db94a75aad08601b5ed8fa72c34bec0a76449c63c2c26d6d"}
Sep 12 01:04:24.774177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:24.774125    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" podStartSLOduration=0.774111189 podStartE2EDuration="774.111189ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:04:24.77242839 +0000 UTC m=+1287.685107348" watchObservedRunningTime="2026-09-12 01:04:24.774111189 +0000 UTC m=+1287.686790126"
Sep 12 01:04:34.360468 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.360380    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:34.360468 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.360428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:34.373387 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.373359    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:34.856087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.856056    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc07d692-673d-4128-b76c-98aa4322e666" containerID="03270c67e2d456d55d95cb33466e136ea39e3f518055a7b1c524eb4ce109ed47" exitCode=0
Sep 12 01:04:34.856254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.856130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerDied","Data":"03270c67e2d456d55d95cb33466e136ea39e3f518055a7b1c524eb4ce109ed47"}
Sep 12 01:04:34.856706 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.856686    2576 scope.go:117] "RemoveContainer" containerID="03270c67e2d456d55d95cb33466e136ea39e3f518055a7b1c524eb4ce109ed47"
Sep 12 01:04:34.857907 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.857875    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:04:34.858013 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.857960    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:04:34.858075 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.858010    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:04:34.868833 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:34.868813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:04:35.859410 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:35.859372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:04:35.867241 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:35.867209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerStarted","Data":"1ecf521ea0fab5ee03a8eb7feb47282ff0477369f8900a9868874f989c68f999"}
Sep 12 01:04:36.170762 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:36.170724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:04:36.172071 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:36.172039    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 01:04:36.172334 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:36.172300    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 01:04:37.171558 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:37.171520    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 01:04:37.172179 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:37.172145    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 01:04:38.171461 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:38.171423    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 01:04:38.171756 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:38.171730    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 01:04:38.518440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:38.518350    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:04:39.171569 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:39.171525    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 01:04:39.171778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:39.171592    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 01:04:40.171363 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:40.171323    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 01:04:40.171696 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:40.171667    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 01:04:41.176025 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:41.175994    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:04:41.177094 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:41.177074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:04:58.835587 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:58.835560    2576 scope.go:117] "RemoveContainer" containerID="da70bfe9f933cfca80b8ba0dac871e78611344d83313a14e2fec5b649a704691"
Sep 12 01:04:58.846016 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:04:58.845995    2576 scope.go:117] "RemoveContainer" containerID="7ec88a84af11d302c8f0d608e263c9345e35e7a9a5b62560f95c908ce143bb0d"
Sep 12 01:05:21.050397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:21.050306    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:05:21.471371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:21.471324    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:05:29.367542 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.367509    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"]
Sep 12 01:05:29.370594 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.370571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:29.372989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.372967    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:05:29.373174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.373160    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:05:29.378352 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.378331    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"]
Sep 12 01:05:29.477871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.477829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv\" (UID: \"5d05c00e-8037-4574-8cf6-d182a4716cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:29.579418 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.579384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv\" (UID: \"5d05c00e-8037-4574-8cf6-d182a4716cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:29.580015 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.579972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv\" (UID: \"5d05c00e-8037-4574-8cf6-d182a4716cc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:29.685684 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.685657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:29.962547 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:29.962513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"]
Sep 12 01:05:29.962685 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:05:29.962596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d05c00e_8037_4574_8cf6_d182a4716cc5.slice/crio-18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb WatchSource:0}: Error finding container 18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb: Status 404 returned error can't find the container with id 18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb
Sep 12 01:05:30.252168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:30.252072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv" event={"ID":"5d05c00e-8037-4574-8cf6-d182a4716cc5","Type":"ContainerStarted","Data":"ded6d9358b25f48c8c2316027d820f492b16b71c43d13403a2be95b0dd5808d8"}
Sep 12 01:05:30.252168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:30.252137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv" event={"ID":"5d05c00e-8037-4574-8cf6-d182a4716cc5","Type":"ContainerStarted","Data":"18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb"}
Sep 12 01:05:30.270839 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:30.270792    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv" podStartSLOduration=1.27077617 podStartE2EDuration="1.27077617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:05:30.26817535 +0000 UTC m=+1353.180854298" watchObservedRunningTime="2026-09-12 01:05:30.27077617 +0000 UTC m=+1353.183455107"
Sep 12 01:05:31.260307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:31.260251    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d05c00e-8037-4574-8cf6-d182a4716cc5" containerID="ded6d9358b25f48c8c2316027d820f492b16b71c43d13403a2be95b0dd5808d8" exitCode=0
Sep 12 01:05:31.260683 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:31.260342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv" event={"ID":"5d05c00e-8037-4574-8cf6-d182a4716cc5","Type":"ContainerDied","Data":"ded6d9358b25f48c8c2316027d820f492b16b71c43d13403a2be95b0dd5808d8"}
Sep 12 01:05:32.403351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:32.403326    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:32.516471 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:32.516435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca\") pod \"5d05c00e-8037-4574-8cf6-d182a4716cc5\" (UID: \"5d05c00e-8037-4574-8cf6-d182a4716cc5\") "
Sep 12 01:05:32.516769 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:32.516747    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d05c00e-8037-4574-8cf6-d182a4716cc5" (UID: "5d05c00e-8037-4574-8cf6-d182a4716cc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:05:32.618184 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:32.618097    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d05c00e-8037-4574-8cf6-d182a4716cc5-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:33.276560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:33.276536    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"
Sep 12 01:05:33.276762 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:33.276579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv" event={"ID":"5d05c00e-8037-4574-8cf6-d182a4716cc5","Type":"ContainerDied","Data":"18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb"}
Sep 12 01:05:33.276762 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:33.276632    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18e3176dabf15ee6b4e017bcf8b8f18f3e82ae41999fcfd646a783c06b4923fb"
Sep 12 01:05:36.070717 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.070621    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" podUID="25b2db7a-1954-49ae-b669-fe2edede54a3" containerName="main" containerID="cri-o://825afb3fdf2142bd608ae93e1007cc0534465f8ca56049eae11e3f9c0bbf14f8" gracePeriod=45
Sep 12 01:05:36.300351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.300322    2576 generic.go:356] "Generic (PLEG): container finished" podID="25b2db7a-1954-49ae-b669-fe2edede54a3" containerID="825afb3fdf2142bd608ae93e1007cc0534465f8ca56049eae11e3f9c0bbf14f8" exitCode=0
Sep 12 01:05:36.300500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.300397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" event={"ID":"25b2db7a-1954-49ae-b669-fe2edede54a3","Type":"ContainerDied","Data":"825afb3fdf2142bd608ae93e1007cc0534465f8ca56049eae11e3f9c0bbf14f8"}
Sep 12 01:05:36.300500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.300447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx" event={"ID":"25b2db7a-1954-49ae-b669-fe2edede54a3","Type":"ContainerDied","Data":"70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808"}
Sep 12 01:05:36.300500 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.300462    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70db0b4a2e64ed308b5ea6d01ea2b9807b41c3df6a4d4a1fa06bdb1804fa4808"
Sep 12 01:05:36.310370 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.310347    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:05:36.358083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358312 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q5g5\" (UniqueName: \"kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358312 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358312 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358246    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358312 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358296    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home" (OuterVolumeSpecName: "home") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:05:36.358543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs\") pod \"25b2db7a-1954-49ae-b669-fe2edede54a3\" (UID: \"25b2db7a-1954-49ae-b669-fe2edede54a3\") "
Sep 12 01:05:36.358543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:05:36.358651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358567    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache" (OuterVolumeSpecName: "model-cache") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:05:36.358763 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358746    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:36.358991 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358768    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:36.358991 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.358783    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:36.360588 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.360567    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm" (OuterVolumeSpecName: "dshm") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:05:36.360588 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.360575    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:05:36.360797 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.360778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5" (OuterVolumeSpecName: "kube-api-access-4q5g5") pod "25b2db7a-1954-49ae-b669-fe2edede54a3" (UID: "25b2db7a-1954-49ae-b669-fe2edede54a3"). InnerVolumeSpecName "kube-api-access-4q5g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:05:36.460010 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.459978    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25b2db7a-1954-49ae-b669-fe2edede54a3-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:36.460010 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.460008    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q5g5\" (UniqueName: \"kubernetes.io/projected/25b2db7a-1954-49ae-b669-fe2edede54a3-kube-api-access-4q5g5\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:36.460186 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:36.460021    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25b2db7a-1954-49ae-b669-fe2edede54a3-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:05:37.306717 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:37.306690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"
Sep 12 01:05:37.329634 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:37.329605    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:05:37.333875 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:37.333848    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/e2e-conflict-b-f6b886e1-kserve-6b45b8597-2h4kx"]
Sep 12 01:05:37.582772 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:37.582691    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b2db7a-1954-49ae-b669-fe2edede54a3" path="/var/lib/kubelet/pods/25b2db7a-1954-49ae-b669-fe2edede54a3/volumes"
Sep 12 01:05:45.213138 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:45.213103    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"]
Sep 12 01:05:45.218448 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:45.218418    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cfc70f5-2tpgv"]
Sep 12 01:05:45.584601 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:45.584485    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d05c00e-8037-4574-8cf6-d182a4716cc5" path="/var/lib/kubelet/pods/5d05c00e-8037-4574-8cf6-d182a4716cc5/volumes"
Sep 12 01:05:53.420142 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:53.420104    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:05:55.930247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930215    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:05:55.930720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930707    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d05c00e-8037-4574-8cf6-d182a4716cc5" containerName="revoke-keys"
Sep 12 01:05:55.930720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930722    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d05c00e-8037-4574-8cf6-d182a4716cc5" containerName="revoke-keys"
Sep 12 01:05:55.930795 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930731    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b2db7a-1954-49ae-b669-fe2edede54a3" containerName="main"
Sep 12 01:05:55.930795 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930737    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b2db7a-1954-49ae-b669-fe2edede54a3" containerName="main"
Sep 12 01:05:55.930882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930829    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d05c00e-8037-4574-8cf6-d182a4716cc5" containerName="revoke-keys"
Sep 12 01:05:55.930882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.930839    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b2db7a-1954-49ae-b669-fe2edede54a3" containerName="main"
Sep 12 01:05:55.934003 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.933988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.936997 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.936976    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"kube-root-ca.crt\""
Sep 12 01:05:55.938034 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.938014    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"openshift-service-ca.crt\""
Sep 12 01:05:55.938222 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.938191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"auth-test-model-ef5997-kserve-self-signed-certs\""
Sep 12 01:05:55.938334 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.938078    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"default-dockercfg-fh9nk\""
Sep 12 01:05:55.942829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.942807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:05:55.987379 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.987546 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.987546 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rfn\" (UniqueName: \"kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.987662 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.987710 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:55.987797 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:55.987765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.088757 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.088718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.088960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.088793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.088960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.088858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.088960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.088883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.088960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.088900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rfn\" (UniqueName: \"kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.089188 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.089045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.089319 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.089268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.089371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.089337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.089421 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.089376    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.091338 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.091317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.091592 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.091574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.097078 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.097057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rfn\" (UniqueName: \"kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn\") pod \"auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.244502 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.244404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:05:56.523406 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:56.523378    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:05:56.524336 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:05:56.524308    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6609418b_3ac9_4337_970c_3e703bb66c59.slice/crio-7413c9a255d1dcc7959ec0c03a3fd43192910091023b56d1349e4c033cd41399 WatchSource:0}: Error finding container 7413c9a255d1dcc7959ec0c03a3fd43192910091023b56d1349e4c033cd41399: Status 404 returned error can't find the container with id 7413c9a255d1dcc7959ec0c03a3fd43192910091023b56d1349e4c033cd41399
Sep 12 01:05:57.450210 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:57.450176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" event={"ID":"6609418b-3ac9-4337-970c-3e703bb66c59","Type":"ContainerStarted","Data":"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"}
Sep 12 01:05:57.450210 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:57.450220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" event={"ID":"6609418b-3ac9-4337-970c-3e703bb66c59","Type":"ContainerStarted","Data":"7413c9a255d1dcc7959ec0c03a3fd43192910091023b56d1349e4c033cd41399"}
Sep 12 01:05:57.468581 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:57.468532    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" podStartSLOduration=2.468515355 podStartE2EDuration="2.468515355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:05:57.467189056 +0000 UTC m=+1380.379867991" watchObservedRunningTime="2026-09-12 01:05:57.468515355 +0000 UTC m=+1380.381194292"
Sep 12 01:05:57.964806 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:05:57.964768    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:06:06.245033 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:06.244997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:06:06.245517 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:06.245165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:06:06.257557 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:06.257535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:06:06.524360 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:06.524262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:06:08.440564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.440496    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" podUID="ac3ab59e-3a07-45dc-bc98-798088039c75" containerName="main" containerID="cri-o://a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980" gracePeriod=45
Sep 12 01:06:08.698339 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.698262    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:06:08.840918 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.840889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841080 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.840972    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5rfh\" (UniqueName: \"kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841080 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.840996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841080 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841019    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841081    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841214    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home\") pod \"ac3ab59e-3a07-45dc-bc98-798088039c75\" (UID: \"ac3ab59e-3a07-45dc-bc98-798088039c75\") "
Sep 12 01:06:08.841317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841248    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:08.841468 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:08.841523 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841499    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home" (OuterVolumeSpecName: "home") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:08.841922 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841896    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:08.842033 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841926    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:08.842033 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.841940    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:08.843482 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.843456    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm" (OuterVolumeSpecName: "dshm") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:08.843482 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.843470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:06:08.843607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.843488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh" (OuterVolumeSpecName: "kube-api-access-m5rfh") pod "ac3ab59e-3a07-45dc-bc98-798088039c75" (UID: "ac3ab59e-3a07-45dc-bc98-798088039c75"). InnerVolumeSpecName "kube-api-access-m5rfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:06:08.942744 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.942714    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5rfh\" (UniqueName: \"kubernetes.io/projected/ac3ab59e-3a07-45dc-bc98-798088039c75-kube-api-access-m5rfh\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:08.942744 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.942741    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3ab59e-3a07-45dc-bc98-798088039c75-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:08.942744 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:08.942750    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3ab59e-3a07-45dc-bc98-798088039c75-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:09.535032 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.534996    2576 generic.go:356] "Generic (PLEG): container finished" podID="ac3ab59e-3a07-45dc-bc98-798088039c75" containerID="a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980" exitCode=0
Sep 12 01:06:09.535032 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.535038    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" event={"ID":"ac3ab59e-3a07-45dc-bc98-798088039c75","Type":"ContainerDied","Data":"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"}
Sep 12 01:06:09.535602 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.535042    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"
Sep 12 01:06:09.535602 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.535074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz" event={"ID":"ac3ab59e-3a07-45dc-bc98-798088039c75","Type":"ContainerDied","Data":"849caf5059e602c09e893bd6e8003c6af59c5449b053eaebb1f940c7ec949ac5"}
Sep 12 01:06:09.535602 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.535095    2576 scope.go:117] "RemoveContainer" containerID="a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"
Sep 12 01:06:09.545761 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.545743    2576 scope.go:117] "RemoveContainer" containerID="a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"
Sep 12 01:06:09.546024 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:06:09.546005    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980\": container with ID starting with a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980 not found: ID does not exist" containerID="a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"
Sep 12 01:06:09.546079 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.546034    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980"} err="failed to get container status \"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980\": rpc error: code = NotFound desc = could not find container \"a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980\": container with ID starting with a270868caa4e3a3d8b52ae08a2f54154dc7806a9a0e28493c4189261a59ee980 not found: ID does not exist"
Sep 12 01:06:09.559046 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.559025    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:06:09.565838 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.565805    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0cfc70f5/e2e-lifecycle-model-0cfc70f5-kserve-7748878955-t2npz"]
Sep 12 01:06:09.591528 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:09.591502    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3ab59e-3a07-45dc-bc98-798088039c75" path="/var/lib/kubelet/pods/ac3ab59e-3a07-45dc-bc98-798088039c75/volumes"
Sep 12 01:06:31.061806 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:31.061770    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:06:37.523103 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.523068    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:06:37.523864 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.523845    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3ab59e-3a07-45dc-bc98-798088039c75" containerName="main"
Sep 12 01:06:37.523915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.523867    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3ab59e-3a07-45dc-bc98-798088039c75" containerName="main"
Sep 12 01:06:37.524017 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.524006    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3ab59e-3a07-45dc-bc98-798088039c75" containerName="main"
Sep 12 01:06:37.527882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.527862    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.531397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.531352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"openshift-service-ca.crt\""
Sep 12 01:06:37.531397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.531378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"default-dockercfg-r5zvh\""
Sep 12 01:06:37.531684 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.531665    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"kube-root-ca.crt\""
Sep 12 01:06:37.531842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.531822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-f19fd1\"/\"distinct-2-w4-f19fd1-kserve-self-signed-certs\""
Sep 12 01:06:37.533797 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.533776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:06:37.657982 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.657949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.658148 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.658002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsnw4\" (UniqueName: \"kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.658148 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.658093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.658223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.658180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.658265 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.658253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.658420 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.658297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.759927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.759880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.759927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.759930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.759987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.760039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsnw4\" (UniqueName: \"kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.760103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.760177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760645 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.760622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.760909 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.760885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.761878 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.761855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.768962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.768908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.769829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.769805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.772437 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.772381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsnw4\" (UniqueName: \"kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4\") pod \"distinct-2-w4-f19fd1-kserve-985c687c-4fwb7\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") " pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:37.840295 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:37.840203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:38.118207 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:06:38.118169    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56fc06bb_39c3_486b_9719_fcb4de8ad7c4.slice/crio-5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215 WatchSource:0}: Error finding container 5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215: Status 404 returned error can't find the container with id 5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215
Sep 12 01:06:38.118783 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:38.118758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:06:38.755345 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:38.755309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" event={"ID":"56fc06bb-39c3-486b-9719-fcb4de8ad7c4","Type":"ContainerStarted","Data":"538562e482a5051f829e0507c41bf3702c8eee372e96057fd7e09d0640cbdd18"}
Sep 12 01:06:38.755737 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:38.755359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" event={"ID":"56fc06bb-39c3-486b-9719-fcb4de8ad7c4","Type":"ContainerStarted","Data":"5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215"}
Sep 12 01:06:38.778010 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:38.777958    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" podStartSLOduration=1.777943447 podStartE2EDuration="1.777943447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:06:38.777323039 +0000 UTC m=+1421.690001977" watchObservedRunningTime="2026-09-12 01:06:38.777943447 +0000 UTC m=+1421.690622384"
Sep 12 01:06:42.654209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:42.654173    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:06:42.654643 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:42.654459    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" containerID="cri-o://77892c00f38fcb0534d30ab5e1fb70621ef972fe8c9b4092da1a06a8e83caea1" gracePeriod=30
Sep 12 01:06:47.820828 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.820790    2576 generic.go:356] "Generic (PLEG): container finished" podID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerID="77892c00f38fcb0534d30ab5e1fb70621ef972fe8c9b4092da1a06a8e83caea1" exitCode=0
Sep 12 01:06:47.821259 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.820863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerDied","Data":"77892c00f38fcb0534d30ab5e1fb70621ef972fe8c9b4092da1a06a8e83caea1"}
Sep 12 01:06:47.821259 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.820941    2576 scope.go:117] "RemoveContainer" containerID="2b80c37668479068e28c0cfefd7fe7ede32f8653dab3966709fd3722ab4ad1af"
Sep 12 01:06:47.840430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.840407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:47.840566 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.840441    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:47.853591 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.853563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:47.922862 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.922794    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:06:47.974702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974913 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974913 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974842    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974941    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974970    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddz4j\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.974993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.974976    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:47.975140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975005    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.975140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975064    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.975140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975092    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:47.975140 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token\") pod \"17f49a27-38a6-4c35-b391-1a8d4dc96974\" (UID: \"17f49a27-38a6-4c35-b391-1a8d4dc96974\") "
Sep 12 01:06:47.975397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975228    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data" (OuterVolumeSpecName: "istio-data") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:47.975397 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975270    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:47.975670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975646    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:47.975670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975674    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:47.976083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975688    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:47.976083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975702    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:47.976083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.975875    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:06:47.977317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.977294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:06:47.977422 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.977371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j" (OuterVolumeSpecName: "kube-api-access-ddz4j") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "kube-api-access-ddz4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:06:47.977856 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.977831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:06:47.977856 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:47.977837    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token" (OuterVolumeSpecName: "istio-token") pod "17f49a27-38a6-4c35-b391-1a8d4dc96974" (UID: "17f49a27-38a6-4c35-b391-1a8d4dc96974"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:06:48.076641 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.076607    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddz4j\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-kube-api-access-ddz4j\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:48.076641 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.076636    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:48.076641 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.076646    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:48.076872 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.076653    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17f49a27-38a6-4c35-b391-1a8d4dc96974-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:48.076872 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.076661    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17f49a27-38a6-4c35-b391-1a8d4dc96974-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:06:48.829905 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.829833    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"
Sep 12 01:06:48.829905 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.829872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" event={"ID":"17f49a27-38a6-4c35-b391-1a8d4dc96974","Type":"ContainerDied","Data":"102d9b5f7d5860d6c1830c46c3e137fc917f53974304e83a5879cd226bc45726"}
Sep 12 01:06:48.830462 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.829931    2576 scope.go:117] "RemoveContainer" containerID="77892c00f38fcb0534d30ab5e1fb70621ef972fe8c9b4092da1a06a8e83caea1"
Sep 12 01:06:48.842217 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.842198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:06:48.859211 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.859185    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:06:48.864268 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.864241    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj"]
Sep 12 01:06:48.889388 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.889351    2576 patch_prober.go:28] interesting pod/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 01:06:48.889560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:48.889417    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0cfc70f5-openshift-default-5547b5fb6d-8zfnj" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 01:06:49.582704 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:49.582666    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" path="/var/lib/kubelet/pods/17f49a27-38a6-4c35-b391-1a8d4dc96974/volumes"
Sep 12 01:06:58.899858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:06:58.899825    2576 scope.go:117] "RemoveContainer" containerID="ea2f2d2fe8ad6dc29b17a87fc53c8460f4ade9b30d261984b61483956fa39992"
Sep 12 01:07:14.367210 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:14.367159    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:07:38.952540 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.952505    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:07:38.953160 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953140    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.953253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953163    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.953253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953180    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.953253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953188    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.953431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953366    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.953431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.953381    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f49a27-38a6-4c35-b391-1a8d4dc96974" containerName="istio-proxy"
Sep 12 01:07:38.956626 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.956607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:38.959257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.959236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-033ca6-openshift-default-dockercfg-ccfvp\""
Sep 12 01:07:38.971685 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:38.971656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:07:39.022865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.022834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023060 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.022875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bk6m\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023060 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.022948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023060 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.022987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023060 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.023037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.023099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.023126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.023153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.023333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.023207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.124861 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.124861 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.124978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125087 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125425 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bk6m\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125425 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125541 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125642 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.125742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.125680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.127370 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.127350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.127619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.127600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.134178 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.134155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.134325 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.134308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bk6m\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m\") pod \"e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") " pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.267634 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.267538    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:39.548862 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.548837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:07:39.550153 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:07:39.550130    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bacffaf_457e_4d8a_8567_b8bf63239a98.slice/crio-3f4769c18ffe6ad633e3b2ed41352d1860bf096bf8b07e748f53d1d4906ed50d WatchSource:0}: Error finding container 3f4769c18ffe6ad633e3b2ed41352d1860bf096bf8b07e748f53d1d4906ed50d: Status 404 returned error can't find the container with id 3f4769c18ffe6ad633e3b2ed41352d1860bf096bf8b07e748f53d1d4906ed50d
Sep 12 01:07:39.552907 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.552872    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:07:39.552993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.552941    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:07:39.552993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:39.552975    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:07:40.192194 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:40.192162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerStarted","Data":"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"}
Sep 12 01:07:40.192607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:40.192215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerStarted","Data":"3f4769c18ffe6ad633e3b2ed41352d1860bf096bf8b07e748f53d1d4906ed50d"}
Sep 12 01:07:40.234748 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:40.234688    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podStartSLOduration=2.234671622 podStartE2EDuration="2.234671622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:07:40.23441886 +0000 UTC m=+1483.147097845" watchObservedRunningTime="2026-09-12 01:07:40.234671622 +0000 UTC m=+1483.147350558"
Sep 12 01:07:40.268605 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:40.268570    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:40.274986 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:40.274960    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:41.200334 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:41.200299    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:41.201469 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:41.201447    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:07:53.479344 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:53.479309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:07:58.941547 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:58.941514    2576 scope.go:117] "RemoveContainer" containerID="b0753d15456bb80df6065cabe8e52313869a3081680e2c31e8607ef4b4ae463b"
Sep 12 01:07:58.951115 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:07:58.951090    2576 scope.go:117] "RemoveContainer" containerID="c7731fac9665d1e5811baca1c1f5d0810f219f7bf55d2d71e93257a2e13612b3"
Sep 12 01:08:13.104924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.104890    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:08:13.110350 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.110326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.113431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.113412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-49980f-openshift-default-dockercfg-s7xsl\""
Sep 12 01:08:13.129083 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.129060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:08:13.208251 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.208212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.208674 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.208650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.208833 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.208816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zbq5\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.208971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.208956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.209122 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.209104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.209249 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.209235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.209396 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.209380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.209542 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.209520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.209677 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.209561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311096 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zbq5\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311619 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.311899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.311824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.312498 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.312473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.313754 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.313733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.313959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.313942    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.320611 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.320588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.320798 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.320778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zbq5\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5\") pod \"e2e-api-b-49980f-openshift-default-7d59f74494-tb97t\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") " pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.421091 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.421053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:13.708564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.708534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:08:13.709711 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:08:13.709687    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51651397_2f9f_466b_9af1_d39b3f939865.slice/crio-58dba41dd9d6d4f8449be4cfefa3a4439ecec0a5e36ed9386b938e792f52d271 WatchSource:0}: Error finding container 58dba41dd9d6d4f8449be4cfefa3a4439ecec0a5e36ed9386b938e792f52d271: Status 404 returned error can't find the container with id 58dba41dd9d6d4f8449be4cfefa3a4439ecec0a5e36ed9386b938e792f52d271
Sep 12 01:08:13.712267 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.712233    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:13.712378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.712321    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:13.712378 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:13.712355    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:14.431211 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:14.431178    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerStarted","Data":"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"}
Sep 12 01:08:14.431609 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:14.431237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerStarted","Data":"58dba41dd9d6d4f8449be4cfefa3a4439ecec0a5e36ed9386b938e792f52d271"}
Sep 12 01:08:14.453832 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:14.453782    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podStartSLOduration=1.4537667060000001 podStartE2EDuration="1.453766706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:08:14.450395358 +0000 UTC m=+1517.363074319" watchObservedRunningTime="2026-09-12 01:08:14.453766706 +0000 UTC m=+1517.366445643"
Sep 12 01:08:15.421621 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:15.421583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:15.426988 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:15.426961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:15.437830 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:15.437808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:15.438767 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:15.438751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:08:27.242491 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:27.242451    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 01:08:27.242956 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:27.242523    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 01:08:28.549850 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.549812    2576 generic.go:356] "Generic (PLEG): container finished" podID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerID="4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a" exitCode=0
Sep 12 01:08:28.550413 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.549875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerDied","Data":"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"}
Sep 12 01:08:28.550501 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.550479    2576 scope.go:117] "RemoveContainer" containerID="4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"
Sep 12 01:08:28.551808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.551774    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:28.551901 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.551850    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:28.551901 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:28.551882    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:08:29.559179 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:29.559135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerStarted","Data":"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"}
Sep 12 01:08:30.268490 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:30.268451    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:08:30.268816 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:30.268793    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:30.268893 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:30.268874    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:31.268142 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:31.268107    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:31.268577 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:31.268164    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:32.268101 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:32.268065    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:32.268308 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:32.268121    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:33.268062 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:33.268023    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:33.268248 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:33.268087    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:34.267934 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:34.267897    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:34.268430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:34.267968    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:35.268591 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:35.268550    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:35.268997 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:35.268622    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:36.268554 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:36.268512    2576 patch_prober.go:28] interesting pod/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused" start-of-body=
Sep 12 01:08:36.268737 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:36.268576    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.100:15021/healthz/ready\": dial tcp 10.133.0.100:15021: connect: connection refused"
Sep 12 01:08:37.272420 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:37.272391    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:08:37.272818 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:37.272794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:08:37.273605 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:37.273581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:08:49.339317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.339266    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"]
Sep 12 01:08:49.344438 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.344417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:49.346970 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.346948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:08:49.347729 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.347708    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:08:49.352174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.352150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"]
Sep 12 01:08:49.434835 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.434793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv\" (UID: \"914d1c92-72dd-446c-a292-dd6c27349bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:49.535904 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.535863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv\" (UID: \"914d1c92-72dd-446c-a292-dd6c27349bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:49.536494 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.536475    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv\" (UID: \"914d1c92-72dd-446c-a292-dd6c27349bc3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:49.657025 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.657001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:49.932131 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:49.932100    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"]
Sep 12 01:08:49.933370 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:08:49.933341    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914d1c92_72dd_446c_a292_dd6c27349bc3.slice/crio-aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17 WatchSource:0}: Error finding container aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17: Status 404 returned error can't find the container with id aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17
Sep 12 01:08:50.724971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:50.724939    2576 generic.go:356] "Generic (PLEG): container finished" podID="914d1c92-72dd-446c-a292-dd6c27349bc3" containerID="9469f38601d22ddb8d4e5e234fcb3d309d851bf76a2dad966d0d68ac96e17ec4" exitCode=0
Sep 12 01:08:50.725383 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:50.725017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv" event={"ID":"914d1c92-72dd-446c-a292-dd6c27349bc3","Type":"ContainerDied","Data":"9469f38601d22ddb8d4e5e234fcb3d309d851bf76a2dad966d0d68ac96e17ec4"}
Sep 12 01:08:50.725383 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:50.725062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv" event={"ID":"914d1c92-72dd-446c-a292-dd6c27349bc3","Type":"ContainerStarted","Data":"aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17"}
Sep 12 01:08:51.871997 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:51.871974    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:51.962142 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:51.962105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca\") pod \"914d1c92-72dd-446c-a292-dd6c27349bc3\" (UID: \"914d1c92-72dd-446c-a292-dd6c27349bc3\") "
Sep 12 01:08:51.962515 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:51.962492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "914d1c92-72dd-446c-a292-dd6c27349bc3" (UID: "914d1c92-72dd-446c-a292-dd6c27349bc3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:08:52.063924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:52.063845    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914d1c92-72dd-446c-a292-dd6c27349bc3-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:08:52.740247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:52.740211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv" event={"ID":"914d1c92-72dd-446c-a292-dd6c27349bc3","Type":"ContainerDied","Data":"aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17"}
Sep 12 01:08:52.740247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:52.740245    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"
Sep 12 01:08:52.740486 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:52.740264    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aca7424cdb2140b32a4964402ea155617f4cd68c63ff20ba1e918d578a058d17"
Sep 12 01:08:58.980026 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:08:58.979994    2576 scope.go:117] "RemoveContainer" containerID="fc255589fab5a221fc2f247d010632cbed78c357a8bf6ff68e2225739f26bc67"
Sep 12 01:09:04.063553 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:04.063510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:09:05.162382 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:05.162345    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"]
Sep 12 01:09:05.165632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:05.165600    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-033ca6-vmsfv"]
Sep 12 01:09:05.587821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:05.587732    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914d1c92-72dd-446c-a292-dd6c27349bc3" path="/var/lib/kubelet/pods/914d1c92-72dd-446c-a292-dd6c27349bc3/volumes"
Sep 12 01:09:12.314268 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:12.314235    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:09:12.314720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:12.314470    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy" containerID="cri-o://5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf" gracePeriod=30
Sep 12 01:09:15.563794 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.563673    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": read tcp 10.133.0.2:33020->10.133.0.101:15021: read: connection reset by peer" start-of-body=
Sep 12 01:09:15.563794 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.563749    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": read tcp 10.133.0.2:33020->10.133.0.101:15021: read: connection reset by peer"
Sep 12 01:09:15.917782 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.917752    2576 generic.go:356] "Generic (PLEG): container finished" podID="51651397-2f9f-466b-9af1-d39b3f939865" containerID="82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32" exitCode=0
Sep 12 01:09:15.917946 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.917838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerDied","Data":"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"}
Sep 12 01:09:15.918321 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.918306    2576 scope.go:117] "RemoveContainer" containerID="82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"
Sep 12 01:09:15.919698 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.919673    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:09:15.919778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.919742    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:09:15.919820 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:15.919776    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:09:16.926377 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:16.926345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerStarted","Data":"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"}
Sep 12 01:09:17.421534 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.421500    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:17.421728 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.421659    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:17.421728 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.421704    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:17.609496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.609432    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:09:17.658572 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bk6m\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658753 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658613    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658813 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658790    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658852 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658840    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658896 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658874    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658945 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658906    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.658945 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.658933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.659097 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659072    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:17.659216 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659159    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:17.659216 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:17.659496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.659597 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659513    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert\") pod \"7bacffaf-457e-4d8a-8567-b8bf63239a98\" (UID: \"7bacffaf-457e-4d8a-8567-b8bf63239a98\") "
Sep 12 01:09:17.659872 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659846    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.659872 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659866    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.660018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.659882    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.660263 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.660129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:09:17.660470 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.660440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:17.661375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.661345    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:09:17.661559 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.661537    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m" (OuterVolumeSpecName: "kube-api-access-4bk6m") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "kube-api-access-4bk6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:17.661604 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.661580    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:17.661703 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.661681    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bacffaf-457e-4d8a-8567-b8bf63239a98" (UID: "7bacffaf-457e-4d8a-8567-b8bf63239a98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:17.761346 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761307    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.761346 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761339    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bacffaf-457e-4d8a-8567-b8bf63239a98-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.761346 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761349    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bk6m\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-kube-api-access-4bk6m\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.761589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761359    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.761589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761369    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.761589 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.761377    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bacffaf-457e-4d8a-8567-b8bf63239a98-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:17.935694 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.935662    2576 generic.go:356] "Generic (PLEG): container finished" podID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerID="5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf" exitCode=0
Sep 12 01:09:17.936133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.935721    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"
Sep 12 01:09:17.936133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.935754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerDied","Data":"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"}
Sep 12 01:09:17.936133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.935815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8" event={"ID":"7bacffaf-457e-4d8a-8567-b8bf63239a98","Type":"ContainerDied","Data":"3f4769c18ffe6ad633e3b2ed41352d1860bf096bf8b07e748f53d1d4906ed50d"}
Sep 12 01:09:17.936133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.935845    2576 scope.go:117] "RemoveContainer" containerID="5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"
Sep 12 01:09:17.947439 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.947423    2576 scope.go:117] "RemoveContainer" containerID="4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"
Sep 12 01:09:17.956738 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.956721    2576 scope.go:117] "RemoveContainer" containerID="5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"
Sep 12 01:09:17.957003 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:17.956984    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf\": container with ID starting with 5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf not found: ID does not exist" containerID="5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"
Sep 12 01:09:17.957067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.957011    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf"} err="failed to get container status \"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf\": rpc error: code = NotFound desc = could not find container \"5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf\": container with ID starting with 5863e3b15ac90b58840297f07b3737977da700985667d8a9d873e9e9a7976adf not found: ID does not exist"
Sep 12 01:09:17.957067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.957028    2576 scope.go:117] "RemoveContainer" containerID="4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"
Sep 12 01:09:17.957265 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:17.957249    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a\": container with ID starting with 4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a not found: ID does not exist" containerID="4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"
Sep 12 01:09:17.957351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.957310    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a"} err="failed to get container status \"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a\": rpc error: code = NotFound desc = could not find container \"4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a\": container with ID starting with 4ff0c1610f3ad5ec40825f572c1f60c7f47ecaf549e108cbebc23d80cdfe997a not found: ID does not exist"
Sep 12 01:09:17.959796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.959775    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:09:17.963760 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:17.963742    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-033ca6-openshift-default-586fbcc476-j47b8"]
Sep 12 01:09:18.422078 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:18.422041    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:18.422263 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:18.422115    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:19.422319 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:19.422258    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:19.422727 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:19.422344    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:19.589749 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:19.589714    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" path="/var/lib/kubelet/pods/7bacffaf-457e-4d8a-8567-b8bf63239a98/volumes"
Sep 12 01:09:20.422178 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:20.422142    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:20.422367 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:20.422197    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:21.422050 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:21.422015    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:21.422223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:21.422075    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:22.421660 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:22.421627    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused" start-of-body=
Sep 12 01:09:22.422053 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:22.421683    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.101:15021/healthz/ready\": dial tcp 10.133.0.101:15021: connect: connection refused"
Sep 12 01:09:23.425770 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:23.425744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:23.426196 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:23.426039    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:23.426791 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:23.426773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:34.372772 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:34.372738    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:09:34.377836 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:34.377808    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:09:34.410259 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:34.410224    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 01:09:35.528794 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:35.528758    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:09:35.529265 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:35.528999    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" containerID="cri-o://7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e" gracePeriod=30
Sep 12 01:09:38.428580 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:38.428537    2576 patch_prober.go:28] interesting pod/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:09:38.428951 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:38.428602    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:09:40.794449 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.794395    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:40.847100 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847199    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847229    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847254 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847537 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847271    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847537 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847338    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zbq5\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847537 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847421    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket\") pod \"51651397-2f9f-466b-9af1-d39b3f939865\" (UID: \"51651397-2f9f-466b-9af1-d39b3f939865\") "
Sep 12 01:09:40.847698 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847577    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:40.847698 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data" (OuterVolumeSpecName: "istio-data") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:40.847858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:40.847858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847711    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:09:40.847858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.847821    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:40.848047 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.848021    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.848366 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.848048    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.849506 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.849478    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token" (OuterVolumeSpecName: "istio-token") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:40.849587 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.849508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:40.849669 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.849650    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:09:40.849795 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.849771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5" (OuterVolumeSpecName: "kube-api-access-9zbq5") pod "51651397-2f9f-466b-9af1-d39b3f939865" (UID: "51651397-2f9f-466b-9af1-d39b3f939865"). InnerVolumeSpecName "kube-api-access-9zbq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:40.948771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948745    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948768    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948777    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948981 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948785    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51651397-2f9f-466b-9af1-d39b3f939865-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948981 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948795    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51651397-2f9f-466b-9af1-d39b3f939865-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948981 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948805    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zbq5\" (UniqueName: \"kubernetes.io/projected/51651397-2f9f-466b-9af1-d39b3f939865-kube-api-access-9zbq5\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:40.948981 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:40.948815    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51651397-2f9f-466b-9af1-d39b3f939865-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:41.104213 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.104123    2576 generic.go:356] "Generic (PLEG): container finished" podID="51651397-2f9f-466b-9af1-d39b3f939865" containerID="7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e" exitCode=0
Sep 12 01:09:41.104213 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.104160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerDied","Data":"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"}
Sep 12 01:09:41.104213 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.104168    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"
Sep 12 01:09:41.104213 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.104205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t" event={"ID":"51651397-2f9f-466b-9af1-d39b3f939865","Type":"ContainerDied","Data":"58dba41dd9d6d4f8449be4cfefa3a4439ecec0a5e36ed9386b938e792f52d271"}
Sep 12 01:09:41.104576 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.104225    2576 scope.go:117] "RemoveContainer" containerID="7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"
Sep 12 01:09:41.114841 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.114820    2576 scope.go:117] "RemoveContainer" containerID="82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"
Sep 12 01:09:41.124892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.124873    2576 scope.go:117] "RemoveContainer" containerID="7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"
Sep 12 01:09:41.125183 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:41.125161    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e\": container with ID starting with 7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e not found: ID does not exist" containerID="7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"
Sep 12 01:09:41.125247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.125193    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e"} err="failed to get container status \"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e\": rpc error: code = NotFound desc = could not find container \"7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e\": container with ID starting with 7ad7a84de084047573d4ae48c43f2b5e81138c44089d3f49bc24f215b64df87e not found: ID does not exist"
Sep 12 01:09:41.125247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.125211    2576 scope.go:117] "RemoveContainer" containerID="82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"
Sep 12 01:09:41.125514 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:41.125495    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32\": container with ID starting with 82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32 not found: ID does not exist" containerID="82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"
Sep 12 01:09:41.125561 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.125521    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32"} err="failed to get container status \"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32\": rpc error: code = NotFound desc = could not find container \"82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32\": container with ID starting with 82da13e1f67d508545d1f30828a50bc58c1366532897a7bf656ca86bcf8acf32 not found: ID does not exist"
Sep 12 01:09:41.127720 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.127698    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:09:41.131904 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.131885    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-49980f-openshift-default-7d59f74494-tb97t"]
Sep 12 01:09:41.582509 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:41.582472    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51651397-2f9f-466b-9af1-d39b3f939865" path="/var/lib/kubelet/pods/51651397-2f9f-466b-9af1-d39b3f939865/volumes"
Sep 12 01:09:45.078363 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:45.078320    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"]
Sep 12 01:09:45.082026 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:45.082002    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-10ba6f-29819580-vtjf8"]
Sep 12 01:09:45.471392 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:45.471358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:09:45.582251 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:45.582219    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a" path="/var/lib/kubelet/pods/f13fe5ed-a8d5-42c3-b56f-4bcfe6c90e2a/volumes"
Sep 12 01:09:49.394063 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.393983    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" podUID="153a47cb-10ad-485b-97ef-b9d8b1977013" containerName="main" containerID="cri-o://4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7" gracePeriod=45
Sep 12 01:09:49.399467 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.399414    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerName="main" containerID="cri-o://ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703" gracePeriod=45
Sep 12 01:09:49.408979 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.408945    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerName="main" probeResult="failure" output="Get \"https://10.133.0.80:8000/ready\": dial tcp 10.133.0.80:8000: connect: connection refused"
Sep 12 01:09:49.430665 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.430625    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" podUID="e256228a-53cf-4a2c-a5bb-c305bc197d47" containerName="main" containerID="cri-o://80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100" gracePeriod=45
Sep 12 01:09:49.735396 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.735364    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:09:49.738977 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.738946    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:09:49.743901 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.743881    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 01:09:49.845244 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845206    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.845419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845261    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.845419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845317    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.845419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845338    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.845419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qd5h\" (UniqueName: \"kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845524    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home" (OuterVolumeSpecName: "home") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44x44\" (UniqueName: \"kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845587    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845642    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845737    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845749    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache" (OuterVolumeSpecName: "model-cache") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845774    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home" (OuterVolumeSpecName: "home") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845777    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2dt4\" (UniqueName: \"kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845843    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845942    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home" (OuterVolumeSpecName: "home") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.845974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845970    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm\") pod \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\" (UID: \"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663\") "
Sep 12 01:09:49.846686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.845993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache" (OuterVolumeSpecName: "model-cache") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.846686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.846686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846125    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.846686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846248    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs\") pod \"e256228a-53cf-4a2c-a5bb-c305bc197d47\" (UID: \"e256228a-53cf-4a2c-a5bb-c305bc197d47\") "
Sep 12 01:09:49.846686 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm\") pod \"153a47cb-10ad-485b-97ef-b9d8b1977013\" (UID: \"153a47cb-10ad-485b-97ef-b9d8b1977013\") "
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846741    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846761    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846773    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846785    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846798    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846808    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846821    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.846959 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.846833    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.848606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848392    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h" (OuterVolumeSpecName: "kube-api-access-9qd5h") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "kube-api-access-9qd5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:49.848606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848402    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:09:49.848606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848428    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44" (OuterVolumeSpecName: "kube-api-access-44x44") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "kube-api-access-44x44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:49.848606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848570    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache" (OuterVolumeSpecName: "model-cache") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.848606 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848603    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:09:49.848966 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848656    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4" (OuterVolumeSpecName: "kube-api-access-m2dt4") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "kube-api-access-m2dt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:49.848966 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.848841    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm" (OuterVolumeSpecName: "dshm") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.849084 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.849045    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm" (OuterVolumeSpecName: "dshm") pod "153a47cb-10ad-485b-97ef-b9d8b1977013" (UID: "153a47cb-10ad-485b-97ef-b9d8b1977013"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.849523 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.849507    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm" (OuterVolumeSpecName: "dshm") pod "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" (UID: "8bd374ca-66f9-43c7-b2c5-9fcb5ab16663"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:49.850239 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.850221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e256228a-53cf-4a2c-a5bb-c305bc197d47" (UID: "e256228a-53cf-4a2c-a5bb-c305bc197d47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:09:49.947733 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947705    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947733 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947731    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947733 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947739    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e256228a-53cf-4a2c-a5bb-c305bc197d47-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947748    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947757    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e256228a-53cf-4a2c-a5bb-c305bc197d47-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947764    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/153a47cb-10ad-485b-97ef-b9d8b1977013-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947771    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/153a47cb-10ad-485b-97ef-b9d8b1977013-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947779    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qd5h\" (UniqueName: \"kubernetes.io/projected/e256228a-53cf-4a2c-a5bb-c305bc197d47-kube-api-access-9qd5h\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947789    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44x44\" (UniqueName: \"kubernetes.io/projected/153a47cb-10ad-485b-97ef-b9d8b1977013-kube-api-access-44x44\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:49.947960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:49.947797    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2dt4\" (UniqueName: \"kubernetes.io/projected/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663-kube-api-access-m2dt4\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:50.172802 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.172766    2576 generic.go:356] "Generic (PLEG): container finished" podID="e256228a-53cf-4a2c-a5bb-c305bc197d47" containerID="80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100" exitCode=0
Sep 12 01:09:50.172989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.172812    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"
Sep 12 01:09:50.172989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.172849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" event={"ID":"e256228a-53cf-4a2c-a5bb-c305bc197d47","Type":"ContainerDied","Data":"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"}
Sep 12 01:09:50.172989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.172900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g" event={"ID":"e256228a-53cf-4a2c-a5bb-c305bc197d47","Type":"ContainerDied","Data":"cc750506b89ebbaf31d08b74d3c53947159986d40ac0aff96b8349250a979bbf"}
Sep 12 01:09:50.172989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.172923    2576 scope.go:117] "RemoveContainer" containerID="80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"
Sep 12 01:09:50.174778 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.174757    2576 generic.go:356] "Generic (PLEG): container finished" podID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerID="ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703" exitCode=0
Sep 12 01:09:50.174871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.174789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" event={"ID":"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663","Type":"ContainerDied","Data":"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"}
Sep 12 01:09:50.174871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.174816    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"
Sep 12 01:09:50.174871 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.174843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj" event={"ID":"8bd374ca-66f9-43c7-b2c5-9fcb5ab16663","Type":"ContainerDied","Data":"44560e6c3a9fd6ebfd56f033690391f0ee469381c7cd73a44eb3594671c34207"}
Sep 12 01:09:50.176754 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.176731    2576 generic.go:356] "Generic (PLEG): container finished" podID="153a47cb-10ad-485b-97ef-b9d8b1977013" containerID="4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7" exitCode=0
Sep 12 01:09:50.176882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.176757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" event={"ID":"153a47cb-10ad-485b-97ef-b9d8b1977013","Type":"ContainerDied","Data":"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"}
Sep 12 01:09:50.176882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.176794    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"
Sep 12 01:09:50.176882 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.176802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng" event={"ID":"153a47cb-10ad-485b-97ef-b9d8b1977013","Type":"ContainerDied","Data":"dc4bc85e609541b2db94a75aad08601b5ed8fa72c34bec0a76449c63c2c26d6d"}
Sep 12 01:09:50.184112 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.184096    2576 scope.go:117] "RemoveContainer" containerID="80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"
Sep 12 01:09:50.184445 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:50.184419    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100\": container with ID starting with 80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100 not found: ID does not exist" containerID="80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"
Sep 12 01:09:50.184522 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.184453    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100"} err="failed to get container status \"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100\": rpc error: code = NotFound desc = could not find container \"80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100\": container with ID starting with 80fd3db79fd982154ef38d4f53ffd5f07886611e9ad93142a8ba9b7b8cebe100 not found: ID does not exist"
Sep 12 01:09:50.184522 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.184471    2576 scope.go:117] "RemoveContainer" containerID="ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"
Sep 12 01:09:50.193561 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.193546    2576 scope.go:117] "RemoveContainer" containerID="ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"
Sep 12 01:09:50.193825 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:50.193807    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703\": container with ID starting with ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703 not found: ID does not exist" containerID="ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"
Sep 12 01:09:50.193892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.193835    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703"} err="failed to get container status \"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703\": rpc error: code = NotFound desc = could not find container \"ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703\": container with ID starting with ea6a6cef828c954e094662c88ff60da1a92a66433a28cf6033c8b1f3cae14703 not found: ID does not exist"
Sep 12 01:09:50.193892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.193850    2576 scope.go:117] "RemoveContainer" containerID="4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"
Sep 12 01:09:50.199693 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.199645    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 01:09:50.204521 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.204497    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/simulator-w0-10ba6f-kserve-666657d697-mxw6g"]
Sep 12 01:09:50.204981 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.204969    2576 scope.go:117] "RemoveContainer" containerID="4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"
Sep 12 01:09:50.205238 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:09:50.205220    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7\": container with ID starting with 4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7 not found: ID does not exist" containerID="4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"
Sep 12 01:09:50.205302 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.205244    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7"} err="failed to get container status \"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7\": rpc error: code = NotFound desc = could not find container \"4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7\": container with ID starting with 4736da1229768f685d212e0861ab16070099178a93d4c2e8bdac8c9d2c5f88e7 not found: ID does not exist"
Sep 12 01:09:50.216245 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.216226    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:09:50.222529 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.222506    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-2-w0-10ba6f-kserve-6678cb4f64-zkzng"]
Sep 12 01:09:50.232339 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.232320    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:09:50.236166 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:50.236147    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-10ba6f/distinct-w0-10ba6f-kserve-5c4b4b59f-9w2qj"]
Sep 12 01:09:51.584204 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:51.584170    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="153a47cb-10ad-485b-97ef-b9d8b1977013" path="/var/lib/kubelet/pods/153a47cb-10ad-485b-97ef-b9d8b1977013/volumes"
Sep 12 01:09:51.584626 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:51.584612    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" path="/var/lib/kubelet/pods/8bd374ca-66f9-43c7-b2c5-9fcb5ab16663/volumes"
Sep 12 01:09:51.584974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:51.584963    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e256228a-53cf-4a2c-a5bb-c305bc197d47" path="/var/lib/kubelet/pods/e256228a-53cf-4a2c-a5bb-c305bc197d47/volumes"
Sep 12 01:09:52.073119 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:52.073081    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 01:09:52.073396 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:52.073363    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy" containerID="cri-o://2ec6b1ad9e8544bac5118e5873b7fa0301aee69dc6914bf7d29b0134fa448835" gracePeriod=30
Sep 12 01:09:54.986309 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:54.986245    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:09:54.986742 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:54.986536    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy" containerID="cri-o://21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11" gracePeriod=30
Sep 12 01:09:55.488207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488171    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"]
Sep 12 01:09:55.488648 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488635    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488650    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488660    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="153a47cb-10ad-485b-97ef-b9d8b1977013" containerName="main"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488666    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="153a47cb-10ad-485b-97ef-b9d8b1977013" containerName="main"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488673    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488679    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488695    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e256228a-53cf-4a2c-a5bb-c305bc197d47" containerName="main"
Sep 12 01:09:55.488702 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488700    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e256228a-53cf-4a2c-a5bb-c305bc197d47" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488710    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914d1c92-72dd-446c-a292-dd6c27349bc3" containerName="revoke-keys"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488715    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="914d1c92-72dd-446c-a292-dd6c27349bc3" containerName="revoke-keys"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488723    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488728    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488733    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488738    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488808    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e256228a-53cf-4a2c-a5bb-c305bc197d47" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488817    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bd374ca-66f9-43c7-b2c5-9fcb5ab16663" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488822    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488827    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="153a47cb-10ad-485b-97ef-b9d8b1977013" containerName="main"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488834    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bacffaf-457e-4d8a-8567-b8bf63239a98" containerName="istio-proxy"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488841    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="914d1c92-72dd-446c-a292-dd6c27349bc3" containerName="revoke-keys"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488846    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:09:55.488933 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.488852    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:09:55.493596 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.493578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:55.496353 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.496334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:09:55.496426 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.496405    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:09:55.509337 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.509312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"]
Sep 12 01:09:55.607322 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.607263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl\" (UID: \"b27ae05d-0a37-4183-a56b-3f20780e3078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:55.708040 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.708008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl\" (UID: \"b27ae05d-0a37-4183-a56b-3f20780e3078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:55.708637 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.708617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl\" (UID: \"b27ae05d-0a37-4183-a56b-3f20780e3078\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:55.804121 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:55.804045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:56.079847 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:56.079815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"]
Sep 12 01:09:56.081156 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:09:56.081122    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27ae05d_0a37_4183_a56b_3f20780e3078.slice/crio-3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a WatchSource:0}: Error finding container 3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a: Status 404 returned error can't find the container with id 3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a
Sep 12 01:09:56.225507 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:56.225471    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl" event={"ID":"b27ae05d-0a37-4183-a56b-3f20780e3078","Type":"ContainerStarted","Data":"3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a"}
Sep 12 01:09:57.234454 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.234418    2576 generic.go:356] "Generic (PLEG): container finished" podID="b27ae05d-0a37-4183-a56b-3f20780e3078" containerID="8a524a139a13b91a9153956be42a8deadd2ae396b3009ffc64686add13c90b58" exitCode=0
Sep 12 01:09:57.234922 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.234501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl" event={"ID":"b27ae05d-0a37-4183-a56b-3f20780e3078","Type":"ContainerDied","Data":"8a524a139a13b91a9153956be42a8deadd2ae396b3009ffc64686add13c90b58"}
Sep 12 01:09:57.236896 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.236868    2576 generic.go:356] "Generic (PLEG): container finished" podID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerID="2ec6b1ad9e8544bac5118e5873b7fa0301aee69dc6914bf7d29b0134fa448835" exitCode=0
Sep 12 01:09:57.237016 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.236938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerDied","Data":"2ec6b1ad9e8544bac5118e5873b7fa0301aee69dc6914bf7d29b0134fa448835"}
Sep 12 01:09:57.237016 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.236997    2576 scope.go:117] "RemoveContainer" containerID="bc19cae8768af9c24dbddfd68a8959a9e9174683be5c27d69ecd95ce5e1904c3"
Sep 12 01:09:57.334326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.334303    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 01:09:57.428529 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428500    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428724 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428724 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428579    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428724 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428722    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb4nw\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.428897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428867    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.429085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428907    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token\") pod \"1f157f16-0b9c-44f9-8d95-f650424d22bb\" (UID: \"1f157f16-0b9c-44f9-8d95-f650424d22bb\") "
Sep 12 01:09:57.429085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428987    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:57.429085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.428998    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:09:57.429235 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:57.429317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:57.429317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429306    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:57.429714 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429686    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.429845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429717    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.429845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429733    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.429845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429747    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.429845 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.429761    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f157f16-0b9c-44f9-8d95-f650424d22bb-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.430967 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.430940    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:09:57.430967 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.430942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:09:57.431168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.431113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw" (OuterVolumeSpecName: "kube-api-access-hb4nw") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "kube-api-access-hb4nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:57.431430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.431404    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f157f16-0b9c-44f9-8d95-f650424d22bb" (UID: "1f157f16-0b9c-44f9-8d95-f650424d22bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:09:57.530636 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.530600    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.530636 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.530633    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb4nw\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-kube-api-access-hb4nw\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.530821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.530646    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:57.530821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:57.530659    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f157f16-0b9c-44f9-8d95-f650424d22bb-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:58.245608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.245570    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"
Sep 12 01:09:58.245608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.245604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577" event={"ID":"1f157f16-0b9c-44f9-8d95-f650424d22bb","Type":"ContainerDied","Data":"e15faf9ad38ddfeb0c662aafacf98e870f8c8fac0daf477a06607d0e5cbb9821"}
Sep 12 01:09:58.246188 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.245661    2576 scope.go:117] "RemoveContainer" containerID="2ec6b1ad9e8544bac5118e5873b7fa0301aee69dc6914bf7d29b0134fa448835"
Sep 12 01:09:58.266158 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.266124    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 01:09:58.271007 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.270981    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-10ba6f-openshift-default-64985994d-qm577"]
Sep 12 01:09:58.392180 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.392149    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:58.539469 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.539374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca\") pod \"b27ae05d-0a37-4183-a56b-3f20780e3078\" (UID: \"b27ae05d-0a37-4183-a56b-3f20780e3078\") "
Sep 12 01:09:58.539790 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.539766    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b27ae05d-0a37-4183-a56b-3f20780e3078" (UID: "b27ae05d-0a37-4183-a56b-3f20780e3078"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:09:58.640621 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:58.640584    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b27ae05d-0a37-4183-a56b-3f20780e3078-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:09:59.008796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.008764    2576 scope.go:117] "RemoveContainer" containerID="cc7f5f6ad19c0d76d8ed197a66bb212c39225050b426e6c243732d2455851fce"
Sep 12 01:09:59.018754 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.018729    2576 scope.go:117] "RemoveContainer" containerID="825afb3fdf2142bd608ae93e1007cc0534465f8ca56049eae11e3f9c0bbf14f8"
Sep 12 01:09:59.253333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.253303    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"
Sep 12 01:09:59.253333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.253316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl" event={"ID":"b27ae05d-0a37-4183-a56b-3f20780e3078","Type":"ContainerDied","Data":"3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a"}
Sep 12 01:09:59.253757 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.253368    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ccf50fd336c9be2e210313bb263b0f633a3963c65a2f20127c124678170c20a"
Sep 12 01:09:59.583483 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:09:59.583404    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" path="/var/lib/kubelet/pods/1f157f16-0b9c-44f9-8d95-f650424d22bb/volumes"
Sep 12 01:10:00.072587 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.072542    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:10:00.247185 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.247151    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:10:00.261161 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.261091    2576 generic.go:356] "Generic (PLEG): container finished" podID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerID="21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11" exitCode=0
Sep 12 01:10:00.261161 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.261136    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"
Sep 12 01:10:00.261608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.261173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerDied","Data":"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"}
Sep 12 01:10:00.261608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.261251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7" event={"ID":"84adec16-c7d7-4082-8abe-dfeb770aedd2","Type":"ContainerDied","Data":"7f7cf8e42475076d2f51b1e65cba7296ebb85dc4a096fb09e1c85b40acc3b325"}
Sep 12 01:10:00.261608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.261300    2576 scope.go:117] "RemoveContainer" containerID="21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"
Sep 12 01:10:00.271918 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.271896    2576 scope.go:117] "RemoveContainer" containerID="0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"
Sep 12 01:10:00.284924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.284897    2576 scope.go:117] "RemoveContainer" containerID="21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"
Sep 12 01:10:00.285242 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:10:00.285220    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11\": container with ID starting with 21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11 not found: ID does not exist" containerID="21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"
Sep 12 01:10:00.285307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.285253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11"} err="failed to get container status \"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11\": rpc error: code = NotFound desc = could not find container \"21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11\": container with ID starting with 21fc0f06b0499bf815667585fd849edb260f6214758d5906bc17e98ea6eb1b11 not found: ID does not exist"
Sep 12 01:10:00.285307 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.285298    2576 scope.go:117] "RemoveContainer" containerID="0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"
Sep 12 01:10:00.285619 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:10:00.285601    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494\": container with ID starting with 0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494 not found: ID does not exist" containerID="0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"
Sep 12 01:10:00.285667 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.285625    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494"} err="failed to get container status \"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494\": rpc error: code = NotFound desc = could not find container \"0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494\": container with ID starting with 0c869477ce1f6014369e15938f80631dfe409a36e951dd12f8a6fb24a4af7494 not found: ID does not exist"
Sep 12 01:10:00.356924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.356896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.356924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.356928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.356992    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357071    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357125    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmmdc\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357414 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357153    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357414 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket\") pod \"84adec16-c7d7-4082-8abe-dfeb770aedd2\" (UID: \"84adec16-c7d7-4082-8abe-dfeb770aedd2\") "
Sep 12 01:10:00.357520 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357424    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data" (OuterVolumeSpecName: "istio-data") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:00.357520 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357457    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:00.357520 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357471    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:00.357679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357623    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:10:00.357935 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357868    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:00.358024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357923    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.358024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357957    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.358024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357971    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.358024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.357987    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84adec16-c7d7-4082-8abe-dfeb770aedd2-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.359389 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.359360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token" (OuterVolumeSpecName: "istio-token") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:10:00.359507 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.359436    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:00.359865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.359839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:10:00.359865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.359856    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc" (OuterVolumeSpecName: "kube-api-access-pmmdc") pod "84adec16-c7d7-4082-8abe-dfeb770aedd2" (UID: "84adec16-c7d7-4082-8abe-dfeb770aedd2"). InnerVolumeSpecName "kube-api-access-pmmdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:10:00.459375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.459338    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.459375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.459366    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.459375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.459375    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.459375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.459382    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84adec16-c7d7-4082-8abe-dfeb770aedd2-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.459626 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.459394    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmmdc\" (UniqueName: \"kubernetes.io/projected/84adec16-c7d7-4082-8abe-dfeb770aedd2-kube-api-access-pmmdc\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:00.584955 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.584921    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:10:00.589561 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:00.589533    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8e62c2-openshift-default-5c99458c54-xp8b7"]
Sep 12 01:10:01.583220 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:01.583185    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" path="/var/lib/kubelet/pods/84adec16-c7d7-4082-8abe-dfeb770aedd2/volumes"
Sep 12 01:10:06.124948 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:06.124905    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"]
Sep 12 01:10:06.127793 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:06.127768    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-18b9d7-zp6kl"]
Sep 12 01:10:07.582583 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:07.582548    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27ae05d-0a37-4183-a56b-3f20780e3078" path="/var/lib/kubelet/pods/b27ae05d-0a37-4183-a56b-3f20780e3078/volumes"
Sep 12 01:10:08.077336 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:08.077301    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"]
Sep 12 01:10:08.080472 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:08.080442    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-f19fd1-29819580-kmzxj"]
Sep 12 01:10:09.581621 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:09.581586    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5293255f-4232-4b70-b6b7-9e3c4c184794" path="/var/lib/kubelet/pods/5293255f-4232-4b70-b6b7-9e3c4c184794/volumes"
Sep 12 01:10:15.094768 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.094722    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" podUID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" containerName="main" containerID="cri-o://538562e482a5051f829e0507c41bf3702c8eee372e96057fd7e09d0640cbdd18" gracePeriod=45
Sep 12 01:10:15.360874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.360847    2576 generic.go:356] "Generic (PLEG): container finished" podID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" containerID="538562e482a5051f829e0507c41bf3702c8eee372e96057fd7e09d0640cbdd18" exitCode=0
Sep 12 01:10:15.361024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.360923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" event={"ID":"56fc06bb-39c3-486b-9719-fcb4de8ad7c4","Type":"ContainerDied","Data":"538562e482a5051f829e0507c41bf3702c8eee372e96057fd7e09d0640cbdd18"}
Sep 12 01:10:15.361024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.360964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7" event={"ID":"56fc06bb-39c3-486b-9719-fcb4de8ad7c4","Type":"ContainerDied","Data":"5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215"}
Sep 12 01:10:15.361024 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.360976    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d32efcbbcb5b1401544bbec905910c9500f93cf123c71d8f76e14e9686bb215"
Sep 12 01:10:15.370385 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.370361    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:10:15.409629 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.409629 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409641    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.409891 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409709    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.409891 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsnw4\" (UniqueName: \"kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.409891 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409850    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.409891 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409877    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir\") pod \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\" (UID: \"56fc06bb-39c3-486b-9719-fcb4de8ad7c4\") "
Sep 12 01:10:15.410107 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.409921    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:15.410244 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.410225    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:15.410455 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.410379    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home" (OuterVolumeSpecName: "home") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:15.410660 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.410636    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:15.412149 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.412111    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm" (OuterVolumeSpecName: "dshm") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:10:15.412433 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.412418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:10:15.412663 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.412649    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4" (OuterVolumeSpecName: "kube-api-access-vsnw4") pod "56fc06bb-39c3-486b-9719-fcb4de8ad7c4" (UID: "56fc06bb-39c3-486b-9719-fcb4de8ad7c4"). InnerVolumeSpecName "kube-api-access-vsnw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:10:15.511146 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.511119    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:15.511146 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.511146    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsnw4\" (UniqueName: \"kubernetes.io/projected/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-kube-api-access-vsnw4\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:15.511146 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.511156    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:15.511416 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.511165    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:15.511416 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:15.511179    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56fc06bb-39c3-486b-9719-fcb4de8ad7c4-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:10:16.367065 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:16.367034    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"
Sep 12 01:10:16.384201 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:16.384168    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:10:16.390316 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:16.390248    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-f19fd1/distinct-2-w4-f19fd1-kserve-985c687c-4fwb7"]
Sep 12 01:10:17.585145 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:17.585106    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" path="/var/lib/kubelet/pods/56fc06bb-39c3-486b-9719-fcb4de8ad7c4/volumes"
Sep 12 01:10:18.056884 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:18.056842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:10:33.754999 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:33.754960    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:10:47.068708 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:47.068676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:10:47.544147 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:47.544110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:10:58.159459 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:58.159427    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:10:59.072485 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:10:59.072450    2576 scope.go:117] "RemoveContainer" containerID="3f11ba7d1281ce1c4ba88fe6b7c70aa67ed82d4c7da688c051dde888ae8bc2c8"
Sep 12 01:11:02.565345 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.565259    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" podUID="6609418b-3ac9-4337-970c-3e703bb66c59" containerName="main" containerID="cri-o://876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41" gracePeriod=45
Sep 12 01:11:02.599912 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:11:02.599877    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6609418b_3ac9_4337_970c_3e703bb66c59.slice/crio-876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41.scope\": RecentStats: unable to find data in memory cache]"
Sep 12 01:11:02.828018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.827952    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:11:02.881993 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.881965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882007    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882106    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6rfn\" (UniqueName: \"kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882222    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache" (OuterVolumeSpecName: "model-cache") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:11:02.882371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home\") pod \"6609418b-3ac9-4337-970c-3e703bb66c59\" (UID: \"6609418b-3ac9-4337-970c-3e703bb66c59\") "
Sep 12 01:11:02.882371 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:11:02.882607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882581    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home" (OuterVolumeSpecName: "home") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:11:02.882607 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882599    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:02.882693 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.882618    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:02.884537 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.884507    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm" (OuterVolumeSpecName: "dshm") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:11:02.884647 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.884582    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn" (OuterVolumeSpecName: "kube-api-access-b6rfn") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "kube-api-access-b6rfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:11:02.884692 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.884675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6609418b-3ac9-4337-970c-3e703bb66c59" (UID: "6609418b-3ac9-4337-970c-3e703bb66c59"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:11:02.983163 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.983115    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6609418b-3ac9-4337-970c-3e703bb66c59-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:02.983163 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.983156    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:02.983163 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.983165    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6609418b-3ac9-4337-970c-3e703bb66c59-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:02.983163 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:02.983180    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6rfn\" (UniqueName: \"kubernetes.io/projected/6609418b-3ac9-4337-970c-3e703bb66c59-kube-api-access-b6rfn\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:11:03.674380 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.674344    2576 generic.go:356] "Generic (PLEG): container finished" podID="6609418b-3ac9-4337-970c-3e703bb66c59" containerID="876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41" exitCode=0
Sep 12 01:11:03.674854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.674385    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"
Sep 12 01:11:03.674854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.674429    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" event={"ID":"6609418b-3ac9-4337-970c-3e703bb66c59","Type":"ContainerDied","Data":"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"}
Sep 12 01:11:03.674854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.674481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p" event={"ID":"6609418b-3ac9-4337-970c-3e703bb66c59","Type":"ContainerDied","Data":"7413c9a255d1dcc7959ec0c03a3fd43192910091023b56d1349e4c033cd41399"}
Sep 12 01:11:03.674854 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.674504    2576 scope.go:117] "RemoveContainer" containerID="876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"
Sep 12 01:11:03.684658 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.684642    2576 scope.go:117] "RemoveContainer" containerID="876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"
Sep 12 01:11:03.684941 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:11:03.684919    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41\": container with ID starting with 876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41 not found: ID does not exist" containerID="876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"
Sep 12 01:11:03.684989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.684951    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41"} err="failed to get container status \"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41\": rpc error: code = NotFound desc = could not find container \"876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41\": container with ID starting with 876a341df79f58057dfc1600bf821d676859526e17b8f2f16767dc9d008e1e41 not found: ID does not exist"
Sep 12 01:11:03.692681 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.692659    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:11:03.696510 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:03.696487    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/auth-test-model-ef5997-kserve-57fdb4b69f-jcp6p"]
Sep 12 01:11:05.582206 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:05.582168    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6609418b-3ac9-4337-970c-3e703bb66c59" path="/var/lib/kubelet/pods/6609418b-3ac9-4337-970c-3e703bb66c59/volumes"
Sep 12 01:11:08.364193 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:08.364153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:11:30.873089 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873003    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:11:30.873761 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873717    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" containerName="main"
Sep 12 01:11:30.873761 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873740    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" containerName="main"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873763    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873772    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873786    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873793    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873802    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6609418b-3ac9-4337-970c-3e703bb66c59" containerName="main"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873810    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6609418b-3ac9-4337-970c-3e703bb66c59" containerName="main"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873824    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27ae05d-0a37-4183-a56b-3f20780e3078" containerName="revoke-keys"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873830    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27ae05d-0a37-4183-a56b-3f20780e3078" containerName="revoke-keys"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873850    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873857    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873868    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873876    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873886    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:11:30.873915 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.873893    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51651397-2f9f-466b-9af1-d39b3f939865" containerName="istio-proxy"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874007    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874022    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84adec16-c7d7-4082-8abe-dfeb770aedd2" containerName="istio-proxy"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874031    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6609418b-3ac9-4337-970c-3e703bb66c59" containerName="main"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874039    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fc06bb-39c3-486b-9719-fcb4de8ad7c4" containerName="main"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874051    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874060    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f157f16-0b9c-44f9-8d95-f650424d22bb" containerName="istio-proxy"
Sep 12 01:11:30.874666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.874073    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27ae05d-0a37-4183-a56b-3f20780e3078" containerName="revoke-keys"
Sep 12 01:11:30.877643 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.877623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.880896 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.880877    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"kube-root-ca.crt\""
Sep 12 01:11:30.881009 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.880920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"sub-test-model-ef5997-kserve-self-signed-certs\""
Sep 12 01:11:30.881064 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.881023    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"openshift-service-ca.crt\""
Sep 12 01:11:30.881064 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.881029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-ef5997\"/\"default-dockercfg-fh9nk\""
Sep 12 01:11:30.894888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.894856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:11:30.957395 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.957395 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.957610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.957610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.957610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk92x\" (UniqueName: \"kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:30.957718 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:30.957600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.058886 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.058835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.058886 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.058891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059156 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.058915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059156 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.058943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059156 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.059011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk92x\" (UniqueName: \"kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059156 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.059087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059437 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.059219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059437 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.059325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.059552 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.059508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.061348 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.061331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.061659 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.061643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.067796 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.067770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk92x\" (UniqueName: \"kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x\") pod \"sub-test-model-ef5997-kserve-6c49848f89-vwkpl\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") " pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.186880 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.186845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:31.458890 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.458859    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:11:31.460767 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:11:31.460742    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35ae94bd_dca6_4024_a480_89f8eae8d534.slice/crio-2fd242c7829d49e8ae72087c7d73363342c1be775d4db0dffb2f0838bab825d4 WatchSource:0}: Error finding container 2fd242c7829d49e8ae72087c7d73363342c1be775d4db0dffb2f0838bab825d4: Status 404 returned error can't find the container with id 2fd242c7829d49e8ae72087c7d73363342c1be775d4db0dffb2f0838bab825d4
Sep 12 01:11:31.849252 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.849165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" event={"ID":"35ae94bd-dca6-4024-a480-89f8eae8d534","Type":"ContainerStarted","Data":"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"}
Sep 12 01:11:31.849252 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.849207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" event={"ID":"35ae94bd-dca6-4024-a480-89f8eae8d534","Type":"ContainerStarted","Data":"2fd242c7829d49e8ae72087c7d73363342c1be775d4db0dffb2f0838bab825d4"}
Sep 12 01:11:31.872956 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:31.872900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" podStartSLOduration=1.872879323 podStartE2EDuration="1.872879323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:11:31.872138291 +0000 UTC m=+1714.784817246" watchObservedRunningTime="2026-09-12 01:11:31.872879323 +0000 UTC m=+1714.785558260"
Sep 12 01:11:34.473835 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:34.473793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:11:41.187890 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:41.187854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:41.188435 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:41.187905    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:41.199872 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:41.199848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:41.937954 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:41.937919    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:11:50.463745 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:50.463707    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:11:59.100818 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:11:59.100787    2576 scope.go:117] "RemoveContainer" containerID="ded6d9358b25f48c8c2316027d820f492b16b71c43d13403a2be95b0dd5808d8"
Sep 12 01:12:03.460100 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:03.460065    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:12:14.148583 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:14.148542    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:12:17.779081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:17.779046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:12:29.168972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.168905    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" podUID="35ae94bd-dca6-4024-a480-89f8eae8d534" containerName="main" containerID="cri-o://4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32" gracePeriod=45
Sep 12 01:12:29.424551 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.424494    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:12:29.534775 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.534742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.534960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.534813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.534960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.534888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.535086 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.534999    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk92x\" (UniqueName: \"kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.535154 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.535154 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home" (OuterVolumeSpecName: "home") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:12:29.535270 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535157    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir\") pod \"35ae94bd-dca6-4024-a480-89f8eae8d534\" (UID: \"35ae94bd-dca6-4024-a480-89f8eae8d534\") "
Sep 12 01:12:29.535377 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache" (OuterVolumeSpecName: "model-cache") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:12:29.535561 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535543    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:29.535634 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535559    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:12:29.535634 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.535567    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:29.537119 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.537098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x" (OuterVolumeSpecName: "kube-api-access-xk92x") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "kube-api-access-xk92x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:12:29.537579 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.537563    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:12:29.537626 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.537584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm" (OuterVolumeSpecName: "dshm") pod "35ae94bd-dca6-4024-a480-89f8eae8d534" (UID: "35ae94bd-dca6-4024-a480-89f8eae8d534"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:12:29.636387 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.636352    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk92x\" (UniqueName: \"kubernetes.io/projected/35ae94bd-dca6-4024-a480-89f8eae8d534-kube-api-access-xk92x\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:29.636387 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.636383    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:29.636387 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.636393    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ae94bd-dca6-4024-a480-89f8eae8d534-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:29.636628 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:29.636400    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ae94bd-dca6-4024-a480-89f8eae8d534-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:12:30.220827 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.220795    2576 generic.go:356] "Generic (PLEG): container finished" podID="35ae94bd-dca6-4024-a480-89f8eae8d534" containerID="4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32" exitCode=0
Sep 12 01:12:30.221225 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.220835    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"
Sep 12 01:12:30.221225 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.220878    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" event={"ID":"35ae94bd-dca6-4024-a480-89f8eae8d534","Type":"ContainerDied","Data":"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"}
Sep 12 01:12:30.221225 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.220924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl" event={"ID":"35ae94bd-dca6-4024-a480-89f8eae8d534","Type":"ContainerDied","Data":"2fd242c7829d49e8ae72087c7d73363342c1be775d4db0dffb2f0838bab825d4"}
Sep 12 01:12:30.221225 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.220941    2576 scope.go:117] "RemoveContainer" containerID="4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"
Sep 12 01:12:30.233268 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.233221    2576 scope.go:117] "RemoveContainer" containerID="4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"
Sep 12 01:12:30.233670 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:12:30.233651    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32\": container with ID starting with 4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32 not found: ID does not exist" containerID="4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"
Sep 12 01:12:30.233735 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.233677    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32"} err="failed to get container status \"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32\": rpc error: code = NotFound desc = could not find container \"4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32\": container with ID starting with 4936caf99018be9d89d47a31c7f478131e79bfbf7f71cbddabbae7e2f1587f32 not found: ID does not exist"
Sep 12 01:12:30.238592 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.238570    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:12:30.243198 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:30.243176    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-ef5997/sub-test-model-ef5997-kserve-6c49848f89-vwkpl"]
Sep 12 01:12:31.582509 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:31.582474    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ae94bd-dca6-4024-a480-89f8eae8d534" path="/var/lib/kubelet/pods/35ae94bd-dca6-4024-a480-89f8eae8d534/volumes"
Sep 12 01:12:40.261256 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:40.261217    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:12:59.130006 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:12:59.129972    2576 scope.go:117] "RemoveContainer" containerID="538562e482a5051f829e0507c41bf3702c8eee372e96057fd7e09d0640cbdd18"
Sep 12 01:13:03.555899 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:13:03.555860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:13:17.561424 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:13:17.561387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:13:27.965037 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:13:27.965000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:13:43.369052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:13:43.368999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:14:04.387640 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.387606    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:14:04.388269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.388249    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35ae94bd-dca6-4024-a480-89f8eae8d534" containerName="main"
Sep 12 01:14:04.388391 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.388290    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35ae94bd-dca6-4024-a480-89f8eae8d534" containerName="main"
Sep 12 01:14:04.388452 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.388418    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35ae94bd-dca6-4024-a480-89f8eae8d534" containerName="main"
Sep 12 01:14:04.391634 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.391612    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.393910 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.393888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-57b051-openshift-default-dockercfg-s9mh7\""
Sep 12 01:14:04.404666 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.404643    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:14:04.483228 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483430 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483585 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm249\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483585 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483585 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.483585 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.483564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584326 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm249\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584527 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584956 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.584956 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.584947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.585066 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.585003    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.585066 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.585017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.585431 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.585411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.586821 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.586791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.587071 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.587050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.593489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.593468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.593758 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.593721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm249\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249\") pod \"e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") " pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.703938 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.703655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:04.981193 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.981167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:14:04.982499 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:14:04.982471    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180db66e_cf34_470b_8a14_cd6ff0313ebb.slice/crio-929426800e05fd4a3837431fe1f805961ca21e79feb8564c9ba1f8690c9a51d4 WatchSource:0}: Error finding container 929426800e05fd4a3837431fe1f805961ca21e79feb8564c9ba1f8690c9a51d4: Status 404 returned error can't find the container with id 929426800e05fd4a3837431fe1f805961ca21e79feb8564c9ba1f8690c9a51d4
Sep 12 01:14:04.985169 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.985128    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:04.985243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.985202    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:04.985243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:04.985231    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:05.815878 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:05.815842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerStarted","Data":"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"}
Sep 12 01:14:05.816388 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:05.815911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerStarted","Data":"929426800e05fd4a3837431fe1f805961ca21e79feb8564c9ba1f8690c9a51d4"}
Sep 12 01:14:05.838983 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:05.838925    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podStartSLOduration=1.838905539 podStartE2EDuration="1.838905539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:14:05.835199783 +0000 UTC m=+1868.747878698" watchObservedRunningTime="2026-09-12 01:14:05.838905539 +0000 UTC m=+1868.751584671"
Sep 12 01:14:06.704794 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:06.704752    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:06.710141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:06.710113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:06.821892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:06.821863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:06.822808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:06.822790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:16.076716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:16.076680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:14:26.950153 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.950079    2576 generic.go:356] "Generic (PLEG): container finished" podID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerID="a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561" exitCode=0
Sep 12 01:14:26.950564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.950156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerDied","Data":"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"}
Sep 12 01:14:26.950610 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.950584    2576 scope.go:117] "RemoveContainer" containerID="a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"
Sep 12 01:14:26.951724 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.951695    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:26.951780 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.951765    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:26.951829 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:26.951817    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:14:27.958528 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:27.958485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerStarted","Data":"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"}
Sep 12 01:14:28.704874 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:28.704830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:28.705109 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:28.705082    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused" start-of-body=
Sep 12 01:14:28.705203 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:28.705147    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused"
Sep 12 01:14:29.705455 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:29.705422    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused" start-of-body=
Sep 12 01:14:29.705867 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:29.705485    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused"
Sep 12 01:14:30.704789 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:30.704749    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused" start-of-body=
Sep 12 01:14:30.704971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:30.704812    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused"
Sep 12 01:14:31.705286 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:31.705234    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused" start-of-body=
Sep 12 01:14:31.705693 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:31.705326    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused"
Sep 12 01:14:32.705317 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:32.705261    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused" start-of-body=
Sep 12 01:14:32.705735 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:32.705338    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.105:15021/healthz/ready\": dial tcp 10.133.0.105:15021: connect: connection refused"
Sep 12 01:14:33.709271 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:33.709242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:33.709692 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:33.709509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:33.710196 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:33.710180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:14:50.467240 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:50.467199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:14:59.169975 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:14:59.169936    2576 scope.go:117] "RemoveContainer" containerID="9469f38601d22ddb8d4e5e234fcb3d309d851bf76a2dad966d0d68ac96e17ec4"
Sep 12 01:15:00.133295 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.133247    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"]
Sep 12 01:15:00.137584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.137558    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"]
Sep 12 01:15:00.137753 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.137673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"
Sep 12 01:15:00.140118 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.140098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:15:00.141047 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.141028    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"]
Sep 12 01:15:00.141150 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.141132    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"
Sep 12 01:15:00.144291 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.144260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"
Sep 12 01:15:00.154309 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.150148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"]
Sep 12 01:15:00.154309 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.152174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"
Sep 12 01:15:00.154524 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.154504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"]
Sep 12 01:15:00.159367 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.159343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"]
Sep 12 01:15:00.167446 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.167424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"
Sep 12 01:15:00.208691 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.208576    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"
Sep 12 01:15:00.440093 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.440063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"]
Sep 12 01:15:00.440713 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:15:00.440689    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b37f63_124e_4cee_8a7c_0bcb523b19ca.slice/crio-5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6 WatchSource:0}: Error finding container 5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6: Status 404 returned error can't find the container with id 5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6
Sep 12 01:15:00.460767 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.460737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"]
Sep 12 01:15:00.461395 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:15:00.461372    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d10ea9_52c7_491f_be06_eb03cf44de83.slice/crio-b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22 WatchSource:0}: Error finding container b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22: Status 404 returned error can't find the container with id b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22
Sep 12 01:15:00.509744 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:15:00.509717    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffce8b9_408b_402b_a01d_c09467eab6bb.slice/crio-3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6 WatchSource:0}: Error finding container 3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6: Status 404 returned error can't find the container with id 3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6
Sep 12 01:15:00.512807 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:00.512785    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"]
Sep 12 01:15:01.194293 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.194247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg" event={"ID":"3ffce8b9-408b-402b-a01d-c09467eab6bb","Type":"ContainerStarted","Data":"81dd4d18efa59adfccf129c766b3eee031a97c4f2a3790f88a6266eb378d3093"}
Sep 12 01:15:01.194470 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.194330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg" event={"ID":"3ffce8b9-408b-402b-a01d-c09467eab6bb","Type":"ContainerStarted","Data":"3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6"}
Sep 12 01:15:01.195924 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.195904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2" event={"ID":"68b37f63-124e-4cee-8a7c-0bcb523b19ca","Type":"ContainerStarted","Data":"15b1d4de466d578c22f523764e963a9b6f459e9f54d30b70d928b2dab81c281e"}
Sep 12 01:15:01.196016 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.195948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2" event={"ID":"68b37f63-124e-4cee-8a7c-0bcb523b19ca","Type":"ContainerStarted","Data":"5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6"}
Sep 12 01:15:01.197614 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.197591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6" event={"ID":"b0d10ea9-52c7-491f-be06-eb03cf44de83","Type":"ContainerStarted","Data":"cea127e9f6bb11b740890c8799da198afdd2f5a8285c638be63443b6c8444bcc"}
Sep 12 01:15:01.197694 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.197633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6" event={"ID":"b0d10ea9-52c7-491f-be06-eb03cf44de83","Type":"ContainerStarted","Data":"b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22"}
Sep 12 01:15:01.212099 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.212053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg" podStartSLOduration=1.212040255 podStartE2EDuration="1.212040255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:15:01.210686202 +0000 UTC m=+1924.123365150" watchObservedRunningTime="2026-09-12 01:15:01.212040255 +0000 UTC m=+1924.124719191"
Sep 12 01:15:01.230840 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.230794    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2" podStartSLOduration=1.230781037 podStartE2EDuration="1.230781037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:15:01.22833018 +0000 UTC m=+1924.141009134" watchObservedRunningTime="2026-09-12 01:15:01.230781037 +0000 UTC m=+1924.143459974"
Sep 12 01:15:01.246660 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:01.246621    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6" podStartSLOduration=1.246609423 podStartE2EDuration="1.246609423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:15:01.243565346 +0000 UTC m=+1924.156244282" watchObservedRunningTime="2026-09-12 01:15:01.246609423 +0000 UTC m=+1924.159288360"
Sep 12 01:15:02.206059 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.206023    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ffce8b9-408b-402b-a01d-c09467eab6bb" containerID="81dd4d18efa59adfccf129c766b3eee031a97c4f2a3790f88a6266eb378d3093" exitCode=0
Sep 12 01:15:02.206330 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.206101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg" event={"ID":"3ffce8b9-408b-402b-a01d-c09467eab6bb","Type":"ContainerDied","Data":"81dd4d18efa59adfccf129c766b3eee031a97c4f2a3790f88a6266eb378d3093"}
Sep 12 01:15:02.207715 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.207695    2576 generic.go:356] "Generic (PLEG): container finished" podID="68b37f63-124e-4cee-8a7c-0bcb523b19ca" containerID="15b1d4de466d578c22f523764e963a9b6f459e9f54d30b70d928b2dab81c281e" exitCode=0
Sep 12 01:15:02.207832 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.207758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2" event={"ID":"68b37f63-124e-4cee-8a7c-0bcb523b19ca","Type":"ContainerDied","Data":"15b1d4de466d578c22f523764e963a9b6f459e9f54d30b70d928b2dab81c281e"}
Sep 12 01:15:02.209333 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.209312    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0d10ea9-52c7-491f-be06-eb03cf44de83" containerID="cea127e9f6bb11b740890c8799da198afdd2f5a8285c638be63443b6c8444bcc" exitCode=0
Sep 12 01:15:02.209423 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:02.209389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6" event={"ID":"b0d10ea9-52c7-491f-be06-eb03cf44de83","Type":"ContainerDied","Data":"cea127e9f6bb11b740890c8799da198afdd2f5a8285c638be63443b6c8444bcc"}
Sep 12 01:15:03.368617 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:03.368590    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"
Sep 12 01:15:03.418122 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:03.418094    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"
Sep 12 01:15:03.421299 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:03.421252    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"
Sep 12 01:15:04.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.223216    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"
Sep 12 01:15:04.223243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.223233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg" event={"ID":"3ffce8b9-408b-402b-a01d-c09467eab6bb","Type":"ContainerDied","Data":"3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6"}
Sep 12 01:15:04.223519 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.223314    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bb6f6f55c747d8077329ea6bdfe2651ffcdbd0a2c25415c968a521425364ac6"
Sep 12 01:15:04.224908 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.224884    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"
Sep 12 01:15:04.224908 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.224898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2" event={"ID":"68b37f63-124e-4cee-8a7c-0bcb523b19ca","Type":"ContainerDied","Data":"5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6"}
Sep 12 01:15:04.225108 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.224939    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e35e4f14fb2db4aae9e52ce4522c74fe277bd8d5bf608742d510b27910460a6"
Sep 12 01:15:04.226533 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.226510    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"
Sep 12 01:15:04.226650 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.226533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6" event={"ID":"b0d10ea9-52c7-491f-be06-eb03cf44de83","Type":"ContainerDied","Data":"b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22"}
Sep 12 01:15:04.226650 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:04.226572    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5ebd0b6ddfdf50a82747e580fdda04ad10a5db94f6e61f3a1ad2a7da1a69f22"
Sep 12 01:15:07.665939 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:07.665903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:15:15.883633 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.883595    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:15:15.884066 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884053    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d10ea9-52c7-491f-be06-eb03cf44de83" containerName="cleanup"
Sep 12 01:15:15.884106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884067    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d10ea9-52c7-491f-be06-eb03cf44de83" containerName="cleanup"
Sep 12 01:15:15.884106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884083    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ffce8b9-408b-402b-a01d-c09467eab6bb" containerName="cleanup"
Sep 12 01:15:15.884106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884089    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ffce8b9-408b-402b-a01d-c09467eab6bb" containerName="cleanup"
Sep 12 01:15:15.884106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884097    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68b37f63-124e-4cee-8a7c-0bcb523b19ca" containerName="cleanup"
Sep 12 01:15:15.884106 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884103    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68b37f63-124e-4cee-8a7c-0bcb523b19ca" containerName="cleanup"
Sep 12 01:15:15.884253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884182    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ffce8b9-408b-402b-a01d-c09467eab6bb" containerName="cleanup"
Sep 12 01:15:15.884253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884191    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d10ea9-52c7-491f-be06-eb03cf44de83" containerName="cleanup"
Sep 12 01:15:15.884253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.884200    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68b37f63-124e-4cee-8a7c-0bcb523b19ca" containerName="cleanup"
Sep 12 01:15:15.887509 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.887489    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:15.889967 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.889948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-bfe85d-openshift-default-dockercfg-84tmj\""
Sep 12 01:15:15.898269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:15.898247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:15:16.003668 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.003888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.003888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.003888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.003888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncht9\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.003888 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.004162 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.003970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.004162 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.004066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.004261 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.004156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105338 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105338 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105731 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105731 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105859 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncht9\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.105859 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.105837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.106123 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.106101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.106227 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.106123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.106227 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.106187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.106513 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.106490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.108018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.107996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.108130 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.108117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.117243 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.117214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.117406 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.117370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncht9\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9\") pod \"e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") " pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.199393 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.199357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:16.490805 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.490775    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:15:16.492487 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:15:16.492463    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665ecfbd_e0e1_4a73_a211_786d4a3e87a0.slice/crio-12c073bcf4d989e124b3fe701fa667d3e6fc3dfaf40ddcc33e9f4bad195391c4 WatchSource:0}: Error finding container 12c073bcf4d989e124b3fe701fa667d3e6fc3dfaf40ddcc33e9f4bad195391c4: Status 404 returned error can't find the container with id 12c073bcf4d989e124b3fe701fa667d3e6fc3dfaf40ddcc33e9f4bad195391c4
Sep 12 01:15:16.494849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.494814    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:16.494937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.494885    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:16.494937 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:16.494913    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:17.308519 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:17.308481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerStarted","Data":"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"}
Sep 12 01:15:17.308908 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:17.308543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerStarted","Data":"12c073bcf4d989e124b3fe701fa667d3e6fc3dfaf40ddcc33e9f4bad195391c4"}
Sep 12 01:15:17.331896 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:17.331847    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podStartSLOduration=2.331826888 podStartE2EDuration="2.331826888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:15:17.330232875 +0000 UTC m=+1940.242911824" watchObservedRunningTime="2026-09-12 01:15:17.331826888 +0000 UTC m=+1940.244505824"
Sep 12 01:15:18.200442 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:18.200402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:18.205923 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:18.205895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:18.314793 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:18.314763    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:18.315873 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:18.315848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:27.565824 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:27.565791    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:15:38.453788 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.453751    2576 generic.go:356] "Generic (PLEG): container finished" podID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerID="3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691" exitCode=0
Sep 12 01:15:38.454341 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.453825    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerDied","Data":"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"}
Sep 12 01:15:38.454426 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.454397    2576 scope.go:117] "RemoveContainer" containerID="3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"
Sep 12 01:15:38.455712 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.455676    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:38.455818 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.455749    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:38.455818 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:38.455781    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 12 01:15:39.462757 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:39.462721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerStarted","Data":"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"}
Sep 12 01:15:40.200415 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:40.200378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:40.200730 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:40.200704    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Sep 12 01:15:40.200844 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:40.200764    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Sep 12 01:15:41.200153 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:41.200108    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Sep 12 01:15:41.200690 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:41.200174    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Sep 12 01:15:42.200384 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:42.200350    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Sep 12 01:15:42.200800 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:42.200407    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Sep 12 01:15:43.199984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:43.199941    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Sep 12 01:15:43.200169 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:43.200020    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Sep 12 01:15:44.200236 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:44.200197    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Sep 12 01:15:44.200661 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:44.200259    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Sep 12 01:15:45.204489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:45.204457    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:45.204902 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:45.204723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:45.205375 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:45.205355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:15:50.091136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.091059    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"]
Sep 12 01:15:50.093876 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.093860    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:50.096256 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.096232    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 01:15:50.096256 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.096232    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2rn9k\""
Sep 12 01:15:50.103228 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.103202    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"]
Sep 12 01:15:50.167552 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.167515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv\" (UID: \"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:50.268550 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.268504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv\" (UID: \"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:50.269128 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.269107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv\" (UID: \"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:50.405055 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.405026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:50.679421 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:50.679391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"]
Sep 12 01:15:50.680235 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:15:50.680209    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8644e7f0_b8a4_4e6f_b0b8_60e1b8cb021b.slice/crio-efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c WatchSource:0}: Error finding container efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c: Status 404 returned error can't find the container with id efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c
Sep 12 01:15:51.554573 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:51.554486    2576 generic.go:356] "Generic (PLEG): container finished" podID="8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" containerID="8b027f8c5865a3db2acb06e2ed409723202bf1a1741782fd1a4a9d1e61e597e5" exitCode=0
Sep 12 01:15:51.554927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:51.554573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv" event={"ID":"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b","Type":"ContainerDied","Data":"8b027f8c5865a3db2acb06e2ed409723202bf1a1741782fd1a4a9d1e61e597e5"}
Sep 12 01:15:51.554927 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:51.554633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv" event={"ID":"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b","Type":"ContainerStarted","Data":"efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c"}
Sep 12 01:15:52.703539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:52.703513    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:52.791808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:52.791775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca\") pod \"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b\" (UID: \"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b\") "
Sep 12 01:15:52.792133 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:52.792107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" (UID: "8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:15:52.893705 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:52.893628    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b-maas-api-service-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:15:53.568545 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:53.568514    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"
Sep 12 01:15:53.568743 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:53.568560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv" event={"ID":"8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b","Type":"ContainerDied","Data":"efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c"}
Sep 12 01:15:53.568743 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:53.568608    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efec493d67fa20ea83037eb8266a630c3da24b9f2e4f632b951219b1e82a115c"
Sep 12 01:15:59.195408 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:15:59.195374    2576 scope.go:117] "RemoveContainer" containerID="8a524a139a13b91a9153956be42a8deadd2ae396b3009ffc64686add13c90b58"
Sep 12 01:16:01.265551 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:01.265507    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"]
Sep 12 01:16:01.270322 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:01.270291    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-bfe85d-cdxvv"]
Sep 12 01:16:01.583230 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:01.583143    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" path="/var/lib/kubelet/pods/8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b/volumes"
Sep 12 01:16:05.759112 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:05.759076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:16:07.949806 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:07.949772    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:16:07.950335 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:07.950062    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy" containerID="cri-o://9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e" gracePeriod=30
Sep 12 01:16:13.221495 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.221431    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:16:13.301570 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301734 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301587    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301734 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301822 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301735    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301865 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301832    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301911 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301909    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.301972 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.301967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncht9\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9\") pod \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\" (UID: \"665ecfbd-e0e1-4a73-a211-786d4a3e87a0\") "
Sep 12 01:16:13.302136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:16:13.302193 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302121    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:16:13.302247 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:16:13.302331 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302246    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:16:13.302446 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302427    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:16:13.302507 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302488    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.302564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302510    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.302564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302525    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.302564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.302539    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.304149 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.304122    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:16:13.304308 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.304260    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9" (OuterVolumeSpecName: "kube-api-access-ncht9") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "kube-api-access-ncht9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:16:13.304412 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.304392    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:16:13.304477 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.304413    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "665ecfbd-e0e1-4a73-a211-786d4a3e87a0" (UID: "665ecfbd-e0e1-4a73-a211-786d4a3e87a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:16:13.404001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.403976    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.404001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.403999    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncht9\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-kube-api-access-ncht9\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.404151 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.404010    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.404151 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.404020    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.404151 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.404027    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/665ecfbd-e0e1-4a73-a211-786d4a3e87a0-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:16:13.708850 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.708816    2576 generic.go:356] "Generic (PLEG): container finished" podID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerID="9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e" exitCode=0
Sep 12 01:16:13.709052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.708860    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"
Sep 12 01:16:13.709052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.708904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerDied","Data":"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"}
Sep 12 01:16:13.709052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.708961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk" event={"ID":"665ecfbd-e0e1-4a73-a211-786d4a3e87a0","Type":"ContainerDied","Data":"12c073bcf4d989e124b3fe701fa667d3e6fc3dfaf40ddcc33e9f4bad195391c4"}
Sep 12 01:16:13.709052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.708991    2576 scope.go:117] "RemoveContainer" containerID="9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"
Sep 12 01:16:13.718886 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.718868    2576 scope.go:117] "RemoveContainer" containerID="3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"
Sep 12 01:16:13.726761 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.726737    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:16:13.728850 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.728832    2576 scope.go:117] "RemoveContainer" containerID="9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"
Sep 12 01:16:13.729148 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:16:13.729126    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e\": container with ID starting with 9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e not found: ID does not exist" containerID="9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"
Sep 12 01:16:13.729209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.729159    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e"} err="failed to get container status \"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e\": rpc error: code = NotFound desc = could not find container \"9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e\": container with ID starting with 9ca669c4f9652d00d436927b6eea14f613d2ab757824b304dc1b6662a2ed181e not found: ID does not exist"
Sep 12 01:16:13.729209 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.729183    2576 scope.go:117] "RemoveContainer" containerID="3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"
Sep 12 01:16:13.729504 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:16:13.729484    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691\": container with ID starting with 3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691 not found: ID does not exist" containerID="3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"
Sep 12 01:16:13.729564 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.729512    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691"} err="failed to get container status \"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691\": rpc error: code = NotFound desc = could not find container \"3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691\": container with ID starting with 3e3a0ee71b22fdd1fd7c8678b503aff425a098ba545bffb66c80874d3ecd5691 not found: ID does not exist"
Sep 12 01:16:13.730655 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:13.730637    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-bfe85d-openshift-default-86d854d77b-qsrbk"]
Sep 12 01:16:15.582015 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:15.581981    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" path="/var/lib/kubelet/pods/665ecfbd-e0e1-4a73-a211-786d4a3e87a0/volumes"
Sep 12 01:16:24.761419 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:24.761382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:16:27.178623 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:27.178578    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"]
Sep 12 01:16:27.181290 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:27.181248    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-5fbbcd-29819595-4rtrg"]
Sep 12 01:16:27.582136 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:27.582050    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ffce8b9-408b-402b-a01d-c09467eab6bb" path="/var/lib/kubelet/pods/3ffce8b9-408b-402b-a01d-c09467eab6bb/volumes"
Sep 12 01:16:38.367671 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:16:38.367635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:17:30.163078 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:30.162982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:17:33.638718 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:33.638683    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:17:33.639201 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:33.638883    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" containerID="cri-o://58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef" gracePeriod=30
Sep 12 01:17:33.711632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:33.711594    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:17:33.711790 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:33.711653    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:17:38.907672 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.907642    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:17:38.963292 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963247    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963306    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963348    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963371    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963416    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm249\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963639 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963533    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:38.963639 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963600    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:38.963639 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963805 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963805 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.963805 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.963800    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket\") pod \"180db66e-cf34-470b-8a14-cd6ff0313ebb\" (UID: \"180db66e-cf34-470b-8a14-cd6ff0313ebb\") "
Sep 12 01:17:38.964100 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964073    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:38.964366 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964038    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:17:38.964366 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964233    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data" (OuterVolumeSpecName: "istio-data") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:38.964496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964411    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:38.964496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964433    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:38.964496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964448    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:38.964496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964461    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/180db66e-cf34-470b-8a14-cd6ff0313ebb-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:38.964496 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.964473    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:38.965728 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.965698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:17:38.965858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.965789    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:38.965858 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.965795    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token" (OuterVolumeSpecName: "istio-token") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:17:38.965943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:38.965917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249" (OuterVolumeSpecName: "kube-api-access-jm249") pod "180db66e-cf34-470b-8a14-cd6ff0313ebb" (UID: "180db66e-cf34-470b-8a14-cd6ff0313ebb"). InnerVolumeSpecName "kube-api-access-jm249". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:17:39.065971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.065940    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:39.065971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.065967    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:39.065971 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.065976    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm249\" (UniqueName: \"kubernetes.io/projected/180db66e-cf34-470b-8a14-cd6ff0313ebb-kube-api-access-jm249\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:39.066210 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.065985    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/180db66e-cf34-470b-8a14-cd6ff0313ebb-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:39.261745 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.261651    2576 generic.go:356] "Generic (PLEG): container finished" podID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerID="58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef" exitCode=0
Sep 12 01:17:39.261745 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.261696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"
Sep 12 01:17:39.261745 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.261720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerDied","Data":"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"}
Sep 12 01:17:39.261961 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.261787    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj" event={"ID":"180db66e-cf34-470b-8a14-cd6ff0313ebb","Type":"ContainerDied","Data":"929426800e05fd4a3837431fe1f805961ca21e79feb8564c9ba1f8690c9a51d4"}
Sep 12 01:17:39.261961 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.261808    2576 scope.go:117] "RemoveContainer" containerID="58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"
Sep 12 01:17:39.272493 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.272478    2576 scope.go:117] "RemoveContainer" containerID="a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"
Sep 12 01:17:39.281316 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.281300    2576 scope.go:117] "RemoveContainer" containerID="58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"
Sep 12 01:17:39.281579 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:17:39.281560    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef\": container with ID starting with 58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef not found: ID does not exist" containerID="58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"
Sep 12 01:17:39.281629 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.281587    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef"} err="failed to get container status \"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef\": rpc error: code = NotFound desc = could not find container \"58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef\": container with ID starting with 58a5a2683fec38d9c5ec873fc291dd26d82d0c4b1f4f43a7139fc1b8254debef not found: ID does not exist"
Sep 12 01:17:39.281629 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.281604    2576 scope.go:117] "RemoveContainer" containerID="a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"
Sep 12 01:17:39.281822 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:17:39.281806    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561\": container with ID starting with a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561 not found: ID does not exist" containerID="a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"
Sep 12 01:17:39.281862 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.281826    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561"} err="failed to get container status \"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561\": rpc error: code = NotFound desc = could not find container \"a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561\": container with ID starting with a660761530d802cc8c85cb4df851ac4033a1a9bc5303077ef4b33a654b460561 not found: ID does not exist"
Sep 12 01:17:39.285966 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.285937    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:17:39.289597 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.289574    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-57b051-openshift-default-85c658cb88-j46vj"]
Sep 12 01:17:39.582723 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:39.582641    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" path="/var/lib/kubelet/pods/180db66e-cf34-470b-8a14-cd6ff0313ebb/volumes"
Sep 12 01:17:44.602623 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:44.602587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"]
Sep 12 01:17:44.609870 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:44.609844    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-61f73f-29819595-gbtq6"]
Sep 12 01:17:45.581847 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:45.581802    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d10ea9-52c7-491f-be06-eb03cf44de83" path="/var/lib/kubelet/pods/b0d10ea9-52c7-491f-be06-eb03cf44de83/volumes"
Sep 12 01:17:47.763885 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:47.763851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:17:51.765321 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:51.765258    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:17:51.765782 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:51.765488    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" containerID="cri-o://27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f" gracePeriod=30
Sep 12 01:17:56.596838 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:56.596802    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:17:56.597205 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:56.596872    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:17:57.025245 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.025221    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:17:57.142447 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142447 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vljjm\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142527    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142679 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142556    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:57.142943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142773    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:57.142943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142771    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.142943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142793    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:57.142943 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.142830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs\") pod \"e3b40b72-4da2-4f9c-b3f9-45597df361be\" (UID: \"e3b40b72-4da2-4f9c-b3f9-45597df361be\") "
Sep 12 01:17:57.143405 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143054    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:57.143405 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:17:57.143518 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143500    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.143618 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143522    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.143618 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143537    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.143618 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143552    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3b40b72-4da2-4f9c-b3f9-45597df361be-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.143618 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.143565    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.144892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.144860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm" (OuterVolumeSpecName: "kube-api-access-vljjm") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "kube-api-access-vljjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:17:57.144892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.144883    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:17:57.144892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.144862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:17:57.145543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.145526    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3b40b72-4da2-4f9c-b3f9-45597df361be" (UID: "e3b40b72-4da2-4f9c-b3f9-45597df361be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:17:57.245007 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.244982    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.245007 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.245008    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vljjm\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-kube-api-access-vljjm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.245173 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.245018    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.245173 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.245026    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3b40b72-4da2-4f9c-b3f9-45597df361be-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:17:57.379052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.379016    2576 generic.go:356] "Generic (PLEG): container finished" podID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerID="27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f" exitCode=0
Sep 12 01:17:57.379221 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.379069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"
Sep 12 01:17:57.379221 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.379100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerDied","Data":"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"}
Sep 12 01:17:57.379221 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.379159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8" event={"ID":"e3b40b72-4da2-4f9c-b3f9-45597df361be","Type":"ContainerDied","Data":"aaddec9e9db518d87156083a9361c3749db5e7170893723c3d836e6fdc8a201c"}
Sep 12 01:17:57.379221 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.379200    2576 scope.go:117] "RemoveContainer" containerID="27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"
Sep 12 01:17:57.390086 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.390070    2576 scope.go:117] "RemoveContainer" containerID="a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"
Sep 12 01:17:57.399417 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.399398    2576 scope.go:117] "RemoveContainer" containerID="27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"
Sep 12 01:17:57.399668 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:17:57.399652    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f\": container with ID starting with 27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f not found: ID does not exist" containerID="27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"
Sep 12 01:17:57.399709 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.399676    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f"} err="failed to get container status \"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f\": rpc error: code = NotFound desc = could not find container \"27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f\": container with ID starting with 27f51c4c002e5dc8cf451c45664216055ecb21146754a4dccc2d9e55cb40522f not found: ID does not exist"
Sep 12 01:17:57.399709 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.399691    2576 scope.go:117] "RemoveContainer" containerID="a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"
Sep 12 01:17:57.399949 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:17:57.399929    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9\": container with ID starting with a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9 not found: ID does not exist" containerID="a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"
Sep 12 01:17:57.399999 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.399954    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9"} err="failed to get container status \"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9\": rpc error: code = NotFound desc = could not find container \"a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9\": container with ID starting with a6a9a4a7fa5ca21fd63286bb3a33fca8cd393c4dfa2e23408d40d0653811e9a9 not found: ID does not exist"
Sep 12 01:17:57.413613 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.413587    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:17:57.416224 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.416198    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-61f73f-openshift-default-59b6b98df4-jqlh8"]
Sep 12 01:17:57.582579 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:17:57.582548    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" path="/var/lib/kubelet/pods/e3b40b72-4da2-4f9c-b3f9-45597df361be/volumes"
Sep 12 01:18:02.635842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:02.635808    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"]
Sep 12 01:18:02.638249 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:02.638225    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-ef5997-29819595-kqdf2"]
Sep 12 01:18:02.666364 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:02.666335    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:18:02.666578 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:02.666546    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" podUID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" containerName="payload-processing" containerID="cri-o://9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e" gracePeriod=30
Sep 12 01:18:02.931600 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:02.931577    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:18:03.099072 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.099045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrmqc\" (UniqueName: \"kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc\") pod \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") "
Sep 12 01:18:03.099287 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.099128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume\") pod \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\" (UID: \"c3a0185f-afaf-4a3b-b03f-49ad22b868b3\") "
Sep 12 01:18:03.099503 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.099479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3a0185f-afaf-4a3b-b03f-49ad22b868b3" (UID: "c3a0185f-afaf-4a3b-b03f-49ad22b868b3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:18:03.101463 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.101439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc" (OuterVolumeSpecName: "kube-api-access-vrmqc") pod "c3a0185f-afaf-4a3b-b03f-49ad22b868b3" (UID: "c3a0185f-afaf-4a3b-b03f-49ad22b868b3"). InnerVolumeSpecName "kube-api-access-vrmqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:18:03.200018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.199933    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrmqc\" (UniqueName: \"kubernetes.io/projected/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-kube-api-access-vrmqc\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:03.200018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.199967    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a0185f-afaf-4a3b-b03f-49ad22b868b3-plugins-config-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:03.415664 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.415632    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" containerID="9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e" exitCode=0
Sep 12 01:18:03.415842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.415672    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"
Sep 12 01:18:03.415842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.415711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" event={"ID":"c3a0185f-afaf-4a3b-b03f-49ad22b868b3","Type":"ContainerDied","Data":"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"}
Sep 12 01:18:03.415842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.415762    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8" event={"ID":"c3a0185f-afaf-4a3b-b03f-49ad22b868b3","Type":"ContainerDied","Data":"15ef9df182adafd582c2fc5b2effafe102cc9f89b91702366235cf7f75031d33"}
Sep 12 01:18:03.415842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.415787    2576 scope.go:117] "RemoveContainer" containerID="9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"
Sep 12 01:18:03.426473 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.426455    2576 scope.go:117] "RemoveContainer" containerID="9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"
Sep 12 01:18:03.426755 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:18:03.426730    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e\": container with ID starting with 9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e not found: ID does not exist" containerID="9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"
Sep 12 01:18:03.426834 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.426762    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e"} err="failed to get container status \"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e\": rpc error: code = NotFound desc = could not find container \"9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e\": container with ID starting with 9acf076c2dea6fd46a208fa77527735774916fa5d365147cc07a365249485c3e not found: ID does not exist"
Sep 12 01:18:03.446752 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.444257    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:18:03.449926 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.449900    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ef5997-694bf45db7-rfvz8"]
Sep 12 01:18:03.581970 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.581887    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68b37f63-124e-4cee-8a7c-0bcb523b19ca" path="/var/lib/kubelet/pods/68b37f63-124e-4cee-8a7c-0bcb523b19ca/volumes"
Sep 12 01:18:03.582244 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:03.582230    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" path="/var/lib/kubelet/pods/c3a0185f-afaf-4a3b-b03f-49ad22b868b3/volumes"
Sep 12 01:18:05.455018 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:05.454989    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:18:09.322363 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:09.322326    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:18:09.322861 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:09.322551    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" containerID="cri-o://1ecf521ea0fab5ee03a8eb7feb47282ff0477369f8900a9868874f989c68f999" gracePeriod=30
Sep 12 01:18:11.179037 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:11.178997    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 01:18:11.179543 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:11.179073    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 01:18:13.560433 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:13.560400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:18:14.492023 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.491994    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc07d692-673d-4128-b76c-98aa4322e666" containerID="1ecf521ea0fab5ee03a8eb7feb47282ff0477369f8900a9868874f989c68f999" exitCode=0
Sep 12 01:18:14.492177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.492081    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerDied","Data":"1ecf521ea0fab5ee03a8eb7feb47282ff0477369f8900a9868874f989c68f999"}
Sep 12 01:18:14.492177 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.492148    2576 scope.go:117] "RemoveContainer" containerID="03270c67e2d456d55d95cb33466e136ea39e3f518055a7b1c524eb4ce109ed47"
Sep 12 01:18:14.582144 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.582121    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:18:14.610909 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxq7w\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.610909 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.610909 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.610978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611057    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611139    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy\") pod \"dc07d692-673d-4128-b76c-98aa4322e666\" (UID: \"dc07d692-673d-4128-b76c-98aa4322e666\") "
Sep 12 01:18:14.611258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611187    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611265    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611524    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611689    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.611716 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611707    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.612052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611721    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc07d692-673d-4128-b76c-98aa4322e666-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.612052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611735    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.612052 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.611746    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.613741 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.613709    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 01:18:14.613866 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.613745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:18:14.614198 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.614172    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w" (OuterVolumeSpecName: "kube-api-access-cxq7w") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "kube-api-access-cxq7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:18:14.614338 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.614173    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc07d692-673d-4128-b76c-98aa4322e666" (UID: "dc07d692-673d-4128-b76c-98aa4322e666"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:18:14.713075 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.713037    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc07d692-673d-4128-b76c-98aa4322e666-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.713075 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.713066    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxq7w\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-kube-api-access-cxq7w\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.713075 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.713077    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc07d692-673d-4128-b76c-98aa4322e666-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:14.713075 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:14.713086    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc07d692-673d-4128-b76c-98aa4322e666-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:18:15.498919 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.498892    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"
Sep 12 01:18:15.499119 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.498936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht" event={"ID":"dc07d692-673d-4128-b76c-98aa4322e666","Type":"ContainerDied","Data":"255d70f190782b985aede0cf64ca874b2510e438bb921a8bcf7bfbcc6fddf2c6"}
Sep 12 01:18:15.499119 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.498994    2576 scope.go:117] "RemoveContainer" containerID="1ecf521ea0fab5ee03a8eb7feb47282ff0477369f8900a9868874f989c68f999"
Sep 12 01:18:15.520363 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.520337    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:18:15.526014 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.525988    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-ef5997-openshift-default-c745f8c4d-22rht"]
Sep 12 01:18:15.582444 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:18:15.582411    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc07d692-673d-4128-b76c-98aa4322e666" path="/var/lib/kubelet/pods/dc07d692-673d-4128-b76c-98aa4322e666/volumes"
Sep 12 01:19:34.170054 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:19:34.170014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:20:01.357017 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:20:01.356977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:20:09.163253 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:20:09.163218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:20:17.464218 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:20:17.464183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:20:35.563526 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:20:35.563490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:20:41.567473 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:20:41.567433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:21:59.298319 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:21:59.298233    2576 scope.go:117] "RemoveContainer" containerID="8b027f8c5865a3db2acb06e2ed409723202bf1a1741782fd1a4a9d1e61e597e5"
Sep 12 01:21:59.307321 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:21:59.307293    2576 scope.go:117] "RemoveContainer" containerID="81dd4d18efa59adfccf129c766b3eee031a97c4f2a3790f88a6266eb378d3093"
Sep 12 01:21:59.317262 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:21:59.317243    2576 scope.go:117] "RemoveContainer" containerID="15b1d4de466d578c22f523764e963a9b6f459e9f54d30b70d928b2dab81c281e"
Sep 12 01:21:59.326166 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:21:59.326145    2576 scope.go:117] "RemoveContainer" containerID="cea127e9f6bb11b740890c8799da198afdd2f5a8285c638be63443b6c8444bcc"
Sep 12 01:22:07.267190 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:07.267142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:22:15.170351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:15.170321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:22:24.533269 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533234    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:22:24.533910 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533889    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.533960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533917    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.533960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533931    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.533960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533940    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.533960 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533951    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533960    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533973    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533981    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.533991    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" containerName="revoke-keys"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534000    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" containerName="revoke-keys"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534008    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534017    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534025    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" containerName="payload-processing"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534035    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" containerName="payload-processing"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534052    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:24.534085 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534100    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534210    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534221    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534231    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534242    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="180db66e-cf34-470b-8a14-cd6ff0313ebb" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534252    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a0185f-afaf-4a3b-b03f-49ad22b868b3" containerName="payload-processing"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534260    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534290    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534302    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b40b72-4da2-4f9c-b3f9-45597df361be" containerName="istio-proxy"
Sep 12 01:22:24.534440 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.534311    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8644e7f0-b8a4-4e6f-b0b8-60e1b8cb021b" containerName="revoke-keys"
Sep 12 01:22:24.538114 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.538091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.541511 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.541490    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4080702c-kserve-self-signed-certs\""
Sep 12 01:22:24.544489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.544469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:22:24.640897 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.640859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.641069 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.640965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq9sb\" (UniqueName: \"kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.641069 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.640994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.641069 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.641050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.641174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.641069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.641174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.641140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742183 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742183 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742441 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq9sb\" (UniqueName: \"kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742441 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742441 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742441 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742669 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742726 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.742837 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.742802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.744818 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.744800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.744906 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.744889    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.754805 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.754780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq9sb\" (UniqueName: \"kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb\") pod \"e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") " pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:24.849422 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:24.849340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:25.123062 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:25.123036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:22:25.124181 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:22:25.124161    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cff053a_8f8a_409d_99f1_18a12788c144.slice/crio-c580aaad6ff12a5b67eeb2a96e6f4d6d66551b4577974ef36e3b70f3990d714d WatchSource:0}: Error finding container c580aaad6ff12a5b67eeb2a96e6f4d6d66551b4577974ef36e3b70f3990d714d: Status 404 returned error can't find the container with id c580aaad6ff12a5b67eeb2a96e6f4d6d66551b4577974ef36e3b70f3990d714d
Sep 12 01:22:25.988546 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:25.988511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" event={"ID":"5cff053a-8f8a-409d-99f1-18a12788c144","Type":"ContainerStarted","Data":"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"}
Sep 12 01:22:25.988546 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:25.988549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" event={"ID":"5cff053a-8f8a-409d-99f1-18a12788c144","Type":"ContainerStarted","Data":"c580aaad6ff12a5b67eeb2a96e6f4d6d66551b4577974ef36e3b70f3990d714d"}
Sep 12 01:22:26.007215 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:26.007151    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" podStartSLOduration=2.007135245 podStartE2EDuration="2.007135245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:22:26.004344459 +0000 UTC m=+2368.917023407" watchObservedRunningTime="2026-09-12 01:22:26.007135245 +0000 UTC m=+2368.919814181"
Sep 12 01:22:27.163863 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:27.163816    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:22:34.850153 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:34.850121    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:34.850584 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:34.850188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:34.862857 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:34.862831    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:35.053489 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:35.053465    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:22:42.344100 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.344055    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:22:42.345330 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.345301    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:42.345330 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.345330    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="665ecfbd-e0e1-4a73-a211-786d4a3e87a0" containerName="istio-proxy"
Sep 12 01:22:42.345599 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.345581    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc07d692-673d-4128-b76c-98aa4322e666" containerName="istio-proxy"
Sep 12 01:22:42.349999 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.349974    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.353336 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.353310    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4080702c-kserve-self-signed-certs\""
Sep 12 01:22:42.355207 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.355174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:22:42.405875 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.405838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.405875 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.405877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.406067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.405898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.406067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.405983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.406067 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.406012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.406168 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.406075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tfr\" (UniqueName: \"kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507064 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.506915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507064 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.506956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507064 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tfr\" (UniqueName: \"kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507484 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.507746 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.507508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.509892 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.509867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.510037 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.510022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.515231 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.515211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tfr\" (UniqueName: \"kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr\") pod \"e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") " pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.661707 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.661675    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:42.937358 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:42.937331    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:22:42.938875 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:22:42.938838    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod045752b9_49c7_49c3_b353_dad5c29326d7.slice/crio-c4948cf5d0f87d1f48cde6f44d887b157f621796441a1d79039e48bbd9fd9ad6 WatchSource:0}: Error finding container c4948cf5d0f87d1f48cde6f44d887b157f621796441a1d79039e48bbd9fd9ad6: Status 404 returned error can't find the container with id c4948cf5d0f87d1f48cde6f44d887b157f621796441a1d79039e48bbd9fd9ad6
Sep 12 01:22:43.092786 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:43.092750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" event={"ID":"045752b9-49c7-49c3-b353-dad5c29326d7","Type":"ContainerStarted","Data":"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"}
Sep 12 01:22:43.092786 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:43.092794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" event={"ID":"045752b9-49c7-49c3-b353-dad5c29326d7","Type":"ContainerStarted","Data":"c4948cf5d0f87d1f48cde6f44d887b157f621796441a1d79039e48bbd9fd9ad6"}
Sep 12 01:22:43.111658 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:43.111612    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" podStartSLOduration=1.111597225 podStartE2EDuration="1.111597225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:22:43.10957791 +0000 UTC m=+2386.022256872" watchObservedRunningTime="2026-09-12 01:22:43.111597225 +0000 UTC m=+2386.024276161"
Sep 12 01:22:45.363499 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:45.363457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:22:52.662166 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:52.662123    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:52.662994 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:52.662178    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:52.675077 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:52.675053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:22:53.162608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:22:53.162581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:23:10.727403 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:10.727372    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:23:12.244539 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:12.244502    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:23:13.162833 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:13.162793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:19.761376 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:19.761289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:25.747948 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:25.747904    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" podUID="5cff053a-8f8a-409d-99f1-18a12788c144" containerName="main" containerID="cri-o://6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2" gracePeriod=45
Sep 12 01:23:26.000817 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.000757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:23:26.032465 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032436    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032478    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032521    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032632 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq9sb\" (UniqueName: \"kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032809 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032809 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032693    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache" (OuterVolumeSpecName: "model-cache") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:26.032809 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir\") pod \"5cff053a-8f8a-409d-99f1-18a12788c144\" (UID: \"5cff053a-8f8a-409d-99f1-18a12788c144\") "
Sep 12 01:23:26.032809 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032773    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home" (OuterVolumeSpecName: "home") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:26.033017 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.032929    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:26.033141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.033125    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.033192 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.033147    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.033192 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.033159    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.035115 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.035092    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb" (OuterVolumeSpecName: "kube-api-access-dq9sb") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "kube-api-access-dq9sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:23:26.035390 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.035370    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm" (OuterVolumeSpecName: "dshm") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:26.035486 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.035395    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5cff053a-8f8a-409d-99f1-18a12788c144" (UID: "5cff053a-8f8a-409d-99f1-18a12788c144"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:23:26.133826 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.133791    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cff053a-8f8a-409d-99f1-18a12788c144-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.133826 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.133820    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq9sb\" (UniqueName: \"kubernetes.io/projected/5cff053a-8f8a-409d-99f1-18a12788c144-kube-api-access-dq9sb\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.133826 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.133831    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cff053a-8f8a-409d-99f1-18a12788c144-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:26.354428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.354334    2576 generic.go:356] "Generic (PLEG): container finished" podID="5cff053a-8f8a-409d-99f1-18a12788c144" containerID="6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2" exitCode=0
Sep 12 01:23:26.354428 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.354379    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"
Sep 12 01:23:26.354644 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.354377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" event={"ID":"5cff053a-8f8a-409d-99f1-18a12788c144","Type":"ContainerDied","Data":"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"}
Sep 12 01:23:26.354644 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.354501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p" event={"ID":"5cff053a-8f8a-409d-99f1-18a12788c144","Type":"ContainerDied","Data":"c580aaad6ff12a5b67eeb2a96e6f4d6d66551b4577974ef36e3b70f3990d714d"}
Sep 12 01:23:26.354644 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.354523    2576 scope.go:117] "RemoveContainer" containerID="6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"
Sep 12 01:23:26.364342 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.364321    2576 scope.go:117] "RemoveContainer" containerID="6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"
Sep 12 01:23:26.364605 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:23:26.364586    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2\": container with ID starting with 6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2 not found: ID does not exist" containerID="6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"
Sep 12 01:23:26.364667 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.364614    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2"} err="failed to get container status \"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2\": rpc error: code = NotFound desc = could not find container \"6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2\": container with ID starting with 6147df1096e1980811ffca53f9dbd541b843f3d40235707cb2cf50fdd8e623c2 not found: ID does not exist"
Sep 12 01:23:26.377646 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.377620    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:23:26.385452 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:26.385432    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4080702c-kserve-bb4b67987-rzk4p"]
Sep 12 01:23:27.265310 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.265257    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" podUID="045752b9-49c7-49c3-b353-dad5c29326d7" containerName="main" containerID="cri-o://2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa" gracePeriod=45
Sep 12 01:23:27.507906 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.507883    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:23:27.547836 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.547769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.547836 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.547827    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.548032 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.547933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.548032 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.547996    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2tfr\" (UniqueName: \"kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.548141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home" (OuterVolumeSpecName: "home") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:27.548141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.548141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548112    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm\") pod \"045752b9-49c7-49c3-b353-dad5c29326d7\" (UID: \"045752b9-49c7-49c3-b353-dad5c29326d7\") "
Sep 12 01:23:27.548141 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548123    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:27.548365 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548313    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:27.548493 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548477    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-home\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:27.548560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548495    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-tmp-dir\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:27.548560 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.548508    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-model-cache\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:27.550029 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.550002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 01:23:27.550208 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.550188    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm" (OuterVolumeSpecName: "dshm") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 01:23:27.550356 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.550337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr" (OuterVolumeSpecName: "kube-api-access-x2tfr") pod "045752b9-49c7-49c3-b353-dad5c29326d7" (UID: "045752b9-49c7-49c3-b353-dad5c29326d7"). InnerVolumeSpecName "kube-api-access-x2tfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 01:23:27.587714 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.587681    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cff053a-8f8a-409d-99f1-18a12788c144" path="/var/lib/kubelet/pods/5cff053a-8f8a-409d-99f1-18a12788c144/volumes"
Sep 12 01:23:27.648918 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.648888    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/045752b9-49c7-49c3-b353-dad5c29326d7-dshm\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:27.649028 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.648930    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/045752b9-49c7-49c3-b353-dad5c29326d7-tls-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:27.649028 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:27.648940    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2tfr\" (UniqueName: \"kubernetes.io/projected/045752b9-49c7-49c3-b353-dad5c29326d7-kube-api-access-x2tfr\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\""
Sep 12 01:23:28.369179 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.369142    2576 generic.go:356] "Generic (PLEG): container finished" podID="045752b9-49c7-49c3-b353-dad5c29326d7" containerID="2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa" exitCode=0
Sep 12 01:23:28.369670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.369203    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"
Sep 12 01:23:28.369670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.369239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" event={"ID":"045752b9-49c7-49c3-b353-dad5c29326d7","Type":"ContainerDied","Data":"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"}
Sep 12 01:23:28.369670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.369302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb" event={"ID":"045752b9-49c7-49c3-b353-dad5c29326d7","Type":"ContainerDied","Data":"c4948cf5d0f87d1f48cde6f44d887b157f621796441a1d79039e48bbd9fd9ad6"}
Sep 12 01:23:28.369670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.369322    2576 scope.go:117] "RemoveContainer" containerID="2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"
Sep 12 01:23:28.378622 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.378599    2576 scope.go:117] "RemoveContainer" containerID="2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"
Sep 12 01:23:28.378911 ip-10-0-142-242 kubenswrapper[2576]: E0912 01:23:28.378891    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa\": container with ID starting with 2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa not found: ID does not exist" containerID="2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"
Sep 12 01:23:28.378954 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.378926    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa"} err="failed to get container status \"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa\": rpc error: code = NotFound desc = could not find container \"2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa\": container with ID starting with 2357984c2f55bb3dc6cddaba0fba32e6da2faed9d43d823faa726706c412b0aa not found: ID does not exist"
Sep 12 01:23:28.389608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.389581    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:23:28.393855 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:28.393830    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4080702c-kserve-5cfd468d79-rnzxb"]
Sep 12 01:23:29.366743 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:29.366708    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:29.582643 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:29.582608    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="045752b9-49c7-49c3-b353-dad5c29326d7" path="/var/lib/kubelet/pods/045752b9-49c7-49c3-b353-dad5c29326d7/volumes"
Sep 12 01:23:36.964651 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:36.964611    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:43.859811 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:43.859776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:50.164738 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:50.164699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:56.358746 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:56.358709    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7d5xk"]
Sep 12 01:23:59.388974 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:23:59.388953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d7f4c6787-pnf8q_06f69dcf-2f01-4074-8b75-d5f4a72cc2ae/authorino/0.log"
Sep 12 01:24:04.954190 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:04.954161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s7s9p_b95b9711-95af-40d4-be92-df8cc1359ce6/manager/0.log"
Sep 12 01:24:05.201557 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:05.201526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zsf74_bcf4d0a8-cc1a-4542-b2db-263c681a0745/server/0.log"
Sep 12 01:24:05.319983 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:05.319914    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-82bz4_5a8578c2-ce1d-439c-974e-a0e8d4af677d/manager/0.log"
Sep 12 01:24:05.577787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:05.577710    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694bbb96f5-pmr49_3ca1bf9c-de02-48cd-8efe-73c348c878ae/copy-manifests/0.log"
Sep 12 01:24:05.585762 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:05.585740    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694bbb96f5-pmr49_3ca1bf9c-de02-48cd-8efe-73c348c878ae/manager/0.log"
Sep 12 01:24:07.351868 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:07.351835    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d7f4c6787-pnf8q_06f69dcf-2f01-4074-8b75-d5f4a72cc2ae/authorino/0.log"
Sep 12 01:24:07.587755 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:07.587726    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-22w5x_b15809bf-3772-45e0-8f54-23a3b57cb554/manager/0.log"
Sep 12 01:24:07.970035 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:07.970009    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-7d5xk_d11a8496-f25b-47a0-83e5-a5c741dfc1f2/limitador/0.log"
Sep 12 01:24:08.099368 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:08.099339    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dhkbb_4c26e328-b03a-44b7-b5a1-e3c88941baa1/manager/0.log"
Sep 12 01:24:08.469427 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:08.469401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq_fb08478b-c8b0-4b33-8ec7-472cd6a59dbe/istio-proxy/0.log"
Sep 12 01:24:09.326132 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:09.326099    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-764c597d88-hvw2x_9ac9dbd8-da68-47cd-87a5-b886ffc5ad84/router/0.log"
Sep 12 01:24:09.917984 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:09.917952    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-dn2b4_84ab849a-147e-4167-9e39-cc75264859e0/main/0.log"
Sep 12 01:24:10.261494 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:10.261415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-56dq2_d949b6a1-7a9b-4beb-b92d-cc1c08d778c9/main/0.log"
Sep 12 01:24:16.333182 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333142    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hgbmv/must-gather-wtbpr"]
Sep 12 01:24:16.333609 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333595    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cff053a-8f8a-409d-99f1-18a12788c144" containerName="main"
Sep 12 01:24:16.333675 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333611    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cff053a-8f8a-409d-99f1-18a12788c144" containerName="main"
Sep 12 01:24:16.333675 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333619    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="045752b9-49c7-49c3-b353-dad5c29326d7" containerName="main"
Sep 12 01:24:16.333675 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333624    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="045752b9-49c7-49c3-b353-dad5c29326d7" containerName="main"
Sep 12 01:24:16.333787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333696    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="045752b9-49c7-49c3-b353-dad5c29326d7" containerName="main"
Sep 12 01:24:16.333787 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.333707    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cff053a-8f8a-409d-99f1-18a12788c144" containerName="main"
Sep 12 01:24:16.336996 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.336976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.339593 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.339574    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgbmv\"/\"kube-root-ca.crt\""
Sep 12 01:24:16.339706 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.339576    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgbmv\"/\"openshift-service-ca.crt\""
Sep 12 01:24:16.351047 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.351022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbmv/must-gather-wtbpr"]
Sep 12 01:24:16.409533 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.409499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngs62\" (UniqueName: \"kubernetes.io/projected/2ad53865-5fdf-46ce-9c57-2c084fa15397-kube-api-access-ngs62\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.409660 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.409614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ad53865-5fdf-46ce-9c57-2c084fa15397-must-gather-output\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.510831 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.510789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ad53865-5fdf-46ce-9c57-2c084fa15397-must-gather-output\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.511001 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.510865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngs62\" (UniqueName: \"kubernetes.io/projected/2ad53865-5fdf-46ce-9c57-2c084fa15397-kube-api-access-ngs62\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.511151 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.511130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2ad53865-5fdf-46ce-9c57-2c084fa15397-must-gather-output\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.520608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.520582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngs62\" (UniqueName: \"kubernetes.io/projected/2ad53865-5fdf-46ce-9c57-2c084fa15397-kube-api-access-ngs62\") pod \"must-gather-wtbpr\" (UID: \"2ad53865-5fdf-46ce-9c57-2c084fa15397\") " pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.646623 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.646543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbmv/must-gather-wtbpr"
Sep 12 01:24:16.923725 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.923698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbmv/must-gather-wtbpr"]
Sep 12 01:24:16.925122 ip-10-0-142-242 kubenswrapper[2576]: W0912 01:24:16.925092    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ad53865_5fdf_46ce_9c57_2c084fa15397.slice/crio-2b784dd388e639692619210f84ec07f107197916180d865af01b6d3e15cb7876 WatchSource:0}: Error finding container 2b784dd388e639692619210f84ec07f107197916180d865af01b6d3e15cb7876: Status 404 returned error can't find the container with id 2b784dd388e639692619210f84ec07f107197916180d865af01b6d3e15cb7876
Sep 12 01:24:16.926846 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:16.926828    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 01:24:17.664462 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:17.664424    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbmv/must-gather-wtbpr" event={"ID":"2ad53865-5fdf-46ce-9c57-2c084fa15397","Type":"ContainerStarted","Data":"2b784dd388e639692619210f84ec07f107197916180d865af01b6d3e15cb7876"}
Sep 12 01:24:18.673648 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:18.673159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbmv/must-gather-wtbpr" event={"ID":"2ad53865-5fdf-46ce-9c57-2c084fa15397","Type":"ContainerStarted","Data":"2311e7fa07a13f23e9b6700d382335b8ade263c2dcbf016c17678024f9d6e075"}
Sep 12 01:24:18.673648 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:18.673218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbmv/must-gather-wtbpr" event={"ID":"2ad53865-5fdf-46ce-9c57-2c084fa15397","Type":"ContainerStarted","Data":"d653371dcf85b945439c556073f85129eb3a7fd26c5dff59f13270417742a86f"}
Sep 12 01:24:18.693374 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:18.693320    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hgbmv/must-gather-wtbpr" podStartSLOduration=1.9368164239999999 podStartE2EDuration="2.693304841s" totalImagesPullingTime="756.488417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 01:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:24:18.69211725 +0000 UTC m=+2481.604796190" watchObservedRunningTime="2026-09-12 01:24:18.693304841 +0000 UTC m=+2481.605983803"
Sep 12 01:24:19.393257 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:19.393232    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bbjbr_49bf96b8-2254-4b8f-ba5a-7e1dde0f3bb5/global-pull-secret-syncer/0.log"
Sep 12 01:24:19.562985 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:19.562957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-swcwd_4de9de51-ffe2-453c-bc99-b83a4ff81254/konnectivity-agent/0.log"
Sep 12 01:24:19.634475 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:19.634442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-242.ec2.internal_427abdc7e2784c3c5f6bbe0ee342a5b6/haproxy/0.log"
Sep 12 01:24:24.701849 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:24.701814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d7f4c6787-pnf8q_06f69dcf-2f01-4074-8b75-d5f4a72cc2ae/authorino/0.log"
Sep 12 01:24:24.762301 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:24.759502    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-22w5x_b15809bf-3772-45e0-8f54-23a3b57cb554/manager/0.log"
Sep 12 01:24:24.872313 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:24.872263    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-7d5xk_d11a8496-f25b-47a0-83e5-a5c741dfc1f2/limitador/0.log"
Sep 12 01:24:24.936744 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:24.936709    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-dhkbb_4c26e328-b03a-44b7-b5a1-e3c88941baa1/manager/0.log"
Sep 12 01:24:26.228349 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.228320    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/alertmanager/0.log"
Sep 12 01:24:26.251502 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.251476    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/config-reloader/0.log"
Sep 12 01:24:26.276715 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.276692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/kube-rbac-proxy-web/0.log"
Sep 12 01:24:26.299081 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.299056    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/kube-rbac-proxy/0.log"
Sep 12 01:24:26.336928 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.336896    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/kube-rbac-proxy-metric/0.log"
Sep 12 01:24:26.358659 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.358619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/prom-label-proxy/0.log"
Sep 12 01:24:26.380975 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.380939    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9365273e-4d07-4523-a60d-532fbb2c3117/init-config-reloader/0.log"
Sep 12 01:24:26.442567 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.442326    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-nxvrk_16c3a802-de7d-43c6-a877-d659790ad92e/cluster-monitoring-operator/0.log"
Sep 12 01:24:26.473708 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.473652    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6ckbr_b1c8f5b3-6961-41b2-b431-1dd0144504a7/kube-state-metrics/0.log"
Sep 12 01:24:26.499608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.499507    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6ckbr_b1c8f5b3-6961-41b2-b431-1dd0144504a7/kube-rbac-proxy-main/0.log"
Sep 12 01:24:26.528295 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.528226    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-6ckbr_b1c8f5b3-6961-41b2-b431-1dd0144504a7/kube-rbac-proxy-self/0.log"
Sep 12 01:24:26.605314 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.602942    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-gm7zl_796c1688-f516-4876-9a21-505ec1e34f2e/monitoring-plugin/0.log"
Sep 12 01:24:26.744127 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.743765    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvcb5_e6a728c4-5006-4443-8129-3cf84ab32499/node-exporter/0.log"
Sep 12 01:24:26.773811 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.772212    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvcb5_e6a728c4-5006-4443-8129-3cf84ab32499/kube-rbac-proxy/0.log"
Sep 12 01:24:26.800033 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.799835    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vvcb5_e6a728c4-5006-4443-8129-3cf84ab32499/init-textfile/0.log"
Sep 12 01:24:26.916852 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.916819    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-4lqnh_ac750cc6-e520-46e6-805d-81f7ec60bbc5/kube-rbac-proxy-main/0.log"
Sep 12 01:24:26.939713 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.939670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-4lqnh_ac750cc6-e520-46e6-805d-81f7ec60bbc5/kube-rbac-proxy-self/0.log"
Sep 12 01:24:26.961099 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:26.961060    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-4lqnh_ac750cc6-e520-46e6-805d-81f7ec60bbc5/openshift-state-metrics/0.log"
Sep 12 01:24:27.184112 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.184065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wnwgx_2bd24b4d-c284-44ae-8728-73e252083631/prometheus-operator/0.log"
Sep 12 01:24:27.201682 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.201657    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-wnwgx_2bd24b4d-c284-44ae-8728-73e252083631/kube-rbac-proxy/0.log"
Sep 12 01:24:27.232755 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.232724    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-fxgpn_d21b87d6-da75-4a79-a3ea-815f3904da52/prometheus-operator-admission-webhook/0.log"
Sep 12 01:24:27.267203 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.267170    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fd47c8b86-s2dg6_23b48a3a-d5bc-4f92-87e2-68538d9d802e/telemeter-client/0.log"
Sep 12 01:24:27.301301 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.301084    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fd47c8b86-s2dg6_23b48a3a-d5bc-4f92-87e2-68538d9d802e/reload/0.log"
Sep 12 01:24:27.337633 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.337606    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7fd47c8b86-s2dg6_23b48a3a-d5bc-4f92-87e2-68538d9d802e/kube-rbac-proxy/0.log"
Sep 12 01:24:27.374166 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.374131    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/thanos-query/0.log"
Sep 12 01:24:27.405670 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.405644    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/kube-rbac-proxy-web/0.log"
Sep 12 01:24:27.427667 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.427620    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/kube-rbac-proxy/0.log"
Sep 12 01:24:27.452174 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.452087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/prom-label-proxy/0.log"
Sep 12 01:24:27.475328 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.475293    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/kube-rbac-proxy-rules/0.log"
Sep 12 01:24:27.496989 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:27.496963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6759b5f5cc-gdhf7_6b3f30a0-8c63-4663-a455-074c34baf1f6/kube-rbac-proxy-metrics/0.log"
Sep 12 01:24:29.535551 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.535506    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"]
Sep 12 01:24:29.542608 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.542562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.545015 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.544983    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hgbmv\"/\"default-dockercfg-dwdhd\""
Sep 12 01:24:29.546842 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.546810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"]
Sep 12 01:24:29.673438 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.673397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-podres\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.673631 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.673456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-lib-modules\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.673631 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.673502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxc5\" (UniqueName: \"kubernetes.io/projected/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-kube-api-access-ksxc5\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.673631 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.673552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-sys\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.673808 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.673661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-proc\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.775567 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-podres\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.775772 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-lib-modules\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.775772 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxc5\" (UniqueName: \"kubernetes.io/projected/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-kube-api-access-ksxc5\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.775772 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-sys\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.775962 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-proc\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.776022 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-proc\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.776022 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.775380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-podres\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.776130 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.776117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-lib-modules\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.776352 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.776323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-sys\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.785970 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.785893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxc5\" (UniqueName: \"kubernetes.io/projected/cc3f9195-ef73-43d9-bc51-4dacab53e2a7-kube-api-access-ksxc5\") pod \"perf-node-gather-daemonset-wg77f\" (UID: \"cc3f9195-ef73-43d9-bc51-4dacab53e2a7\") " pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:29.866575 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:29.866313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:30.156386 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.156339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"]
Sep 12 01:24:30.277517 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.277484    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57f4b47cfd-dtstj_aaae82eb-e450-4f68-acbc-acb88f006ba2/console/0.log"
Sep 12 01:24:30.793771 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.793734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f" event={"ID":"cc3f9195-ef73-43d9-bc51-4dacab53e2a7","Type":"ContainerStarted","Data":"fc9161763d5e8c8df363bb2e74c81e0594c7577f0efd123b529726ddbca68871"}
Sep 12 01:24:30.794223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.793802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f" event={"ID":"cc3f9195-ef73-43d9-bc51-4dacab53e2a7","Type":"ContainerStarted","Data":"0dadca4324dc390eab2e9eda70430c54a14491be08209b4d8a2569dad2763743"}
Sep 12 01:24:30.794223 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.793833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:30.810491 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:30.810431    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f" podStartSLOduration=1.810410383 podStartE2EDuration="1.810410383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 01:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 01:24:30.808969262 +0000 UTC m=+2493.721648221" watchObservedRunningTime="2026-09-12 01:24:30.810410383 +0000 UTC m=+2493.723089320"
Sep 12 01:24:32.138641 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:32.138615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c6t79_1af5db43-0ae2-40bb-beaf-96395ad3362a/dns/0.log"
Sep 12 01:24:32.159351 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:32.159332    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c6t79_1af5db43-0ae2-40bb-beaf-96395ad3362a/kube-rbac-proxy/0.log"
Sep 12 01:24:32.337599 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:32.337556    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2fbp_d8888e2b-d074-4641-bca9-a021cd277d1d/dns-node-resolver/0.log"
Sep 12 01:24:32.948717 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:32.948680    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fftc4_c58d5c08-0d10-4987-b725-33a543ec05b3/node-ca/0.log"
Sep 12 01:24:33.958169 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:33.958133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq_fb08478b-c8b0-4b33-8ec7-472cd6a59dbe/istio-proxy/0.log"
Sep 12 01:24:34.974739 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:34.974707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-764c597d88-hvw2x_9ac9dbd8-da68-47cd-87a5-b886ffc5ad84/router/0.log"
Sep 12 01:24:35.926398 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:35.926368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s887l_483496b4-b0fe-4213-80fc-6c5e2a4d9b19/serve-healthcheck-canary/0.log"
Sep 12 01:24:36.558409 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:36.558380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbfdv_2a92f45a-1a82-4176-a084-7cb18f5d8a88/kube-rbac-proxy/0.log"
Sep 12 01:24:36.580729 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:36.580706    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbfdv_2a92f45a-1a82-4176-a084-7cb18f5d8a88/exporter/0.log"
Sep 12 01:24:36.604090 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:36.604064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbfdv_2a92f45a-1a82-4176-a084-7cb18f5d8a88/extractor/0.log"
Sep 12 01:24:36.815350 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:36.815241    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hgbmv/perf-node-gather-daemonset-wg77f"
Sep 12 01:24:39.347049 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:39.346966    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s7s9p_b95b9711-95af-40d4-be92-df8cc1359ce6/manager/0.log"
Sep 12 01:24:39.439644 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:39.439604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zsf74_bcf4d0a8-cc1a-4542-b2db-263c681a0745/server/0.log"
Sep 12 01:24:39.557262 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:39.557231    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-82bz4_5a8578c2-ce1d-439c-974e-a0e8d4af677d/manager/0.log"
Sep 12 01:24:39.676007 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:39.675970    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694bbb96f5-pmr49_3ca1bf9c-de02-48cd-8efe-73c348c878ae/manager/0.log"
Sep 12 01:24:39.697466 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:39.697435    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694bbb96f5-pmr49_3ca1bf9c-de02-48cd-8efe-73c348c878ae/copy-manifests/0.log"
Sep 12 01:24:40.304898 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:40.304783    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq_fb08478b-c8b0-4b33-8ec7-472cd6a59dbe/istio-proxy/0.log"
Sep 12 01:24:40.956200 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:40.956174    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ccd6666c9-w2knm_3eb3776e-ead4-4848-b3c1-733c83d97b8c/manager/0.log"
Sep 12 01:24:40.981697 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:40.981658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-px74h_836a1e74-61a6-4f47-8133-2b6fa944de55/openshift-lws-operator/0.log"
Sep 12 01:24:41.235559 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:41.235448    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-764c597d88-hvw2x_9ac9dbd8-da68-47cd-87a5-b886ffc5ad84/router/0.log"
Sep 12 01:24:42.684060 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:42.684028    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lf8zq_fb08478b-c8b0-4b33-8ec7-472cd6a59dbe/istio-proxy/0.log"
Sep 12 01:24:43.645258 ip-10-0-142-242 kubenswrapper[2576]: I0912 01:24:43.645228    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-764c597d88-hvw2x_9ac9dbd8-da68-47cd-87a5-b886ffc5ad84/router/0.log"