Jul 23 15:00:24.445387 ip-10-0-133-217 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.759612    2523 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764079    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764091    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764096    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764099    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764102    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764104    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764107    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:24.786976 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764111    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764115    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764120    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764127    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764132    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764136    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764139    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764142    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764145    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764149    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764154    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764157    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764160    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764163    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764166    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764170    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764174    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764178    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764181    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:24.790048 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764184    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764187    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764191    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764195    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764198    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764201    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764203    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764206    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764210    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764214    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764216    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764220    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764224    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764226    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764229    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764232    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764234    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764238    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764241    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764244    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:24.793475 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764248    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764251    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764254    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764258    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764261    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764264    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764266    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764269    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764272    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764274    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764278    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764281    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764285    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764288    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764291    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764294    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764296    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764299    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764302    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764306    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:24.796360 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764309    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764311    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764314    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764317    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764322    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764326    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764329    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764331    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764334    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764336    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764340    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764343    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764347    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764350    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764353    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764355    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764358    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764362    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764366    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:24.800375 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764369    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764373    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764377    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764380    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764382    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764385    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764387    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764392    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764395    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764398    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764401    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764403    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764406    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.764409    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765167    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765176    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765179    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765182    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765185    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:24.803080 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765189    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765193    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765196    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765199    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765202    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765206    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765209    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765212    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765215    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765217    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765220    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765223    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765227    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765230    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765233    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765236    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765238    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765242    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765245    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765248    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:24.806708 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765251    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765254    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765257    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765260    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765263    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765266    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765271    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765276    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765279    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765282    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765285    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765290    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765294    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765298    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765301    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765304    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765308    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765311    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765314    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765316    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:24.809685 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765319    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765322    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765324    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765328    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765331    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765335    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765339    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765342    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765346    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765350    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765353    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765355    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765358    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765361    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765364    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765366    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765369    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765374    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765378    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765381    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:24.813248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765384    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765388    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765391    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765393    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765396    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765399    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765402    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765405    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765407    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765412    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765416    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765420    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765423    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765426    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765431    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765435    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765438    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765441    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765444    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:24.815693 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765449    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765452    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765455    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765458    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765461    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765464    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765466    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765470    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765473    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765476    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765481    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765483    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765486    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765490    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765493    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765891    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765897    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765901    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765904    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:24.819390 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765906    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765909    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765911    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765914    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765916    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765919    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765923    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765927    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765929    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765932    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765937    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765940    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765945    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765949    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765952    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765955    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765958    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765961    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765965    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:24.822097 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765968    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765971    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765973    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765975    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765981    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765985    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765988    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765990    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765993    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765996    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.765999    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766001    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766004    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766008    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766012    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766015    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766018    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766021    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766023    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766026    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:24.825389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766029    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766032    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766052    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766057    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766060    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766062    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766065    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766068    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766071    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766075    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766078    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766081    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766083    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766086    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766088    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766093    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766099    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766103    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766106    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:24.828301 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766109    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:24.827909 ip-10-0-133-217 systemd[1]: Started Kubernetes Kubelet.
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766112    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766117    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766121    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766124    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766127    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766130    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766135    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766138    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766140    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766143    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766145    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766148    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766151    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766155    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766158    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766161    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766164    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766168    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766171    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:24.832591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766175    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766178    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766181    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766184    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766186    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766189    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766191    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766194    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766200    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766204    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766207    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766210    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766212    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766216    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766219    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766222    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766224    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766289    2523 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766296    2523 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766303    2523 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766309    2523 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 15:00:24.834508 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766313    2523 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766317    2523 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766321    2523 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766325    2523 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766329    2523 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766334    2523 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766337    2523 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766342    2523 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766346    2523 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766351    2523 flags.go:64] FLAG: --cgroup-root=""
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766354    2523 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766357    2523 flags.go:64] FLAG: --client-ca-file=""
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766360    2523 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766363    2523 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766367    2523 flags.go:64] FLAG: --cluster-domain=""
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766370    2523 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766373    2523 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766377    2523 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766382    2523 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766386    2523 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766393    2523 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766396    2523 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766399    2523 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766402    2523 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 15:00:24.840847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766405    2523 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766408    2523 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766412    2523 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766416    2523 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766420    2523 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766423    2523 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766426    2523 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766431    2523 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766435    2523 flags.go:64] FLAG: --enable-server="true"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766439    2523 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766444    2523 flags.go:64] FLAG: --event-burst="100"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766448    2523 flags.go:64] FLAG: --event-qps="50"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766452    2523 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766456    2523 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766459    2523 flags.go:64] FLAG: --eviction-hard=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766465    2523 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766468    2523 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766471    2523 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766475    2523 flags.go:64] FLAG: --eviction-soft=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766479    2523 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766482    2523 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766485    2523 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766488    2523 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766491    2523 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766495    2523 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 15:00:24.844190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766499    2523 flags.go:64] FLAG: --feature-gates=""
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766503    2523 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766506    2523 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766511    2523 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766516    2523 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766519    2523 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766523    2523 flags.go:64] FLAG: --help="false"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766526    2523 flags.go:64] FLAG: --hostname-override="ip-10-0-133-217.ec2.internal"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766529    2523 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766533    2523 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766537    2523 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766540    2523 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766544    2523 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766547    2523 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766549    2523 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766554    2523 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766558    2523 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766561    2523 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766565    2523 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766568    2523 flags.go:64] FLAG: --kube-reserved=""
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766571    2523 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766575    2523 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766581    2523 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766583    2523 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 15:00:24.848746 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766586    2523 flags.go:64] FLAG: --lock-file=""
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766589    2523 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766592    2523 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766597    2523 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766602    2523 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766605    2523 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766608    2523 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766610    2523 flags.go:64] FLAG: --logging-format="text"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766614    2523 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766619    2523 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766622    2523 flags.go:64] FLAG: --manifest-url=""
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766627    2523 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766631    2523 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766635    2523 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766641    2523 flags.go:64] FLAG: --max-pods="110"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766645    2523 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766648    2523 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766651    2523 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766655    2523 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766659    2523 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766662    2523 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766665    2523 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766672    2523 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766676    2523 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766681    2523 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 15:00:25.045758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766684    2523 flags.go:64] FLAG: --pod-cidr=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766687    2523 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766693    2523 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766697    2523 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766700    2523 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766703    2523 flags.go:64] FLAG: --port="10250"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766708    2523 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766711    2523 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-029271a9158b41173"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766714    2523 flags.go:64] FLAG: --qos-reserved=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766717    2523 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766720    2523 flags.go:64] FLAG: --register-node="true"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766724    2523 flags.go:64] FLAG: --register-with-taints=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766728    2523 flags.go:64] FLAG: --registry-burst="10"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766731    2523 flags.go:64] FLAG: --registry-qps="5"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766734    2523 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766738    2523 flags.go:64] FLAG: --reserved-memory=""
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766742    2523 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766745    2523 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766749    2523 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766752    2523 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766755    2523 flags.go:64] FLAG: --runonce="false"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766757    2523 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766761    2523 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766765    2523 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766768    2523 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 15:00:25.046942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766771    2523 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766775    2523 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766778    2523 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766782    2523 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766785    2523 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766787    2523 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766790    2523 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766799    2523 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766804    2523 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766807    2523 flags.go:64] FLAG: --system-cgroups=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766811    2523 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766817    2523 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766820    2523 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766824    2523 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766827    2523 flags.go:64] FLAG: --tls-min-version=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766830    2523 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766834    2523 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766838    2523 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766841    2523 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766844    2523 flags.go:64] FLAG: --v="2"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766848    2523 flags.go:64] FLAG: --version="false"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766852    2523 flags.go:64] FLAG: --vmodule=""
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766856    2523 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.766861    2523 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 15:00:25.053660 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766987    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766992    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766996    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.766998    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767001    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767004    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767006    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767009    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767012    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767014    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767017    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767020    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767022    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767025    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767027    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767030    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767033    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767060    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767064    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:25.054451 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767067    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767071    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767075    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767079    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767083    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767086    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767089    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767093    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767096    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767098    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767101    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767104    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767106    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767109    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767114    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767118    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767120    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767123    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767127    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:25.055064 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767129    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767134    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767137    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767140    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767143    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767146    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767149    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767154    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767157    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767159    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767163    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767166    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767170    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767174    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767177    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767182    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767186    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767189    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767192    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767194    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:25.055679 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767197    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767199    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767202    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767205    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767208    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767212    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767215    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767220    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767224    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767227    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767231    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767234    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767237    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767240    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767243    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767245    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767249    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767253    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767255    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767258    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:25.056297 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767261    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767263    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767266    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767270    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767274    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767277    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767279    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767283    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767286    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767290    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767293    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767296    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767299    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767301    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767304    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767308    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767311    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767315    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767317    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767322    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:25.056882 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.767324    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.767843    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.775591    2523 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.775606    2523 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.775625    2523 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.775631    2523 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775685    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775690    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775694    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775697    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775700    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775703    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775706    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775709    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:25.057438 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775711    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775716    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775719    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775722    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775725    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775729    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775732    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775735    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775738    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775741    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775744    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775747    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775749    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775752    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775754    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775758    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775761    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775764    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775767    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:25.057874 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775770    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775773    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775776    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775778    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775781    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775783    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775786    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775788    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775791    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775793    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775796    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775799    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775802    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775804    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775807    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775810    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775813    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775815    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775818    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775820    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:25.058410 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775823    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775826    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775828    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775832    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775836    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775839    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775842    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775845    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775847    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775850    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775853    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775856    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775858    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775861    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775864    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775866    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775869    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775871    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775874    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775876    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:25.058970 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775879    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775881    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775884    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775887    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775889    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775892    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775894    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775897    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775899    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775902    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775905    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775908    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775917    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775920    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775923    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775925    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775928    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775931    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775933    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:25.059528 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775936    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775940    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775943    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775946    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775949    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775952    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775955    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775958    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775960    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775963    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775966    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775969    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.775971    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.775976    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776103    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:00:25.060125 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776109    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776113    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776116    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776118    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776121    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776124    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776127    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776129    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776134    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776137    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776139    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776150    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776154    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776157    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776160    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776163    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776166    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776168    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776171    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776174    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:00:25.060539 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776176    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776179    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776181    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776184    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776187    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776189    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776192    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776194    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776197    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776199    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776201    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776204    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776207    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776210    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776212    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776215    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776217    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776220    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776222    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776225    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:00:25.061176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776229    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776232    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776234    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776238    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776242    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776244    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776247    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776250    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776252    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776255    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776257    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776260    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776262    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776265    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776267    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776270    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776272    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776275    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776277    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776280    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:00:25.061712 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776283    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776285    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776288    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776291    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776293    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776296    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776298    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776301    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776304    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776307    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776310    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776313    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776317    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776320    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776323    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776327    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776329    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776333    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776335    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:00:25.062337 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776338    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776341    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776343    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776346    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776349    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776352    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776355    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776357    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776360    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776363    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776365    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776368    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776370    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776373    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776375    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776378    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776381    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776384    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:00:25.062869 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:24.776386    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.776391    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.776486    2523 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.779631    2523 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.780852    2523 server.go:1019] "Starting client certificate rotation"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.780950    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.780984    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.782914    2523 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.785548    2523 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.793951    2523 log.go:25] "Validated CRI v1 runtime API"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.799122    2523 log.go:25] "Validated CRI v1 image API"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.800075    2523 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 15:00:25.191161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.802115    2523 fs.go:135] Filesystem UUIDs: map[1475d002-ebb7-4b6e-ba76-e229776dd807:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 84c3c126-1213-4145-9e3c-fbdcf97992b5:/dev/nvme0n1p4]
Jul 23 15:00:25.191664 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.802129    2523 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.807494    2523 manager.go:216] Machine: {Timestamp:2026-07-23 15:00:24.806439518 +0000 UTC m=+0.267625883 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100117 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20a8b3a15d805124545385f2c79374 SystemUUID:ec20a8b3-a15d-8051-2454-5385f2c79374 BootID:64746c53-f6f6-4c4f-9cfa-4389ebe4f210 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:db:bb:9d:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:db:bb:9d:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:51:57:eb:50:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.807588    2523 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.807657    2523 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.810489    2523 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.810717    2523 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.811762    2523 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:00:25.191860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.811847    2523 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.811860    2523 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.811867    2523 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.812446    2523 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.813652    2523 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817593    2523 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817712    2523 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817739    2523 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817748    2523 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817758    2523 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817767    2523 kubelet.go:398] "Adding apiserver pod source"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.817775    2523 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.818106    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.818130    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.819799    2523 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.821604    2523 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.821631    2523 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822612    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822626    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822635    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822642    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822652    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822658    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822665    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822671    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822677    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822683    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822691    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.822696    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.823818    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.823824    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.827164    2523 server.go:1268] "Started kubelet"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.827273    2523 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.827268    2523 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.827338    2523 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.828846    2523 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.829749    2523 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.831114    2523 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.831158    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 15:00:25.194324 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.831188    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.831101    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-217.ec2.internal.18c4f343ca3e0489  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-217.ec2.internal,UID:ip-10-0-133-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-217.ec2.internal,},FirstTimestamp:2026-07-23 15:00:24.826979465 +0000 UTC m=+0.288165830,LastTimestamp:2026-07-23 15:00:24.826979465 +0000 UTC m=+0.288165830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-217.ec2.internal,}"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.833214    2523 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.834876    2523 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.834887    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.835081    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.835407    2523 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.835408    2523 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.835427    2523 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.835542    2523 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.835551    2523 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836380    2523 factory.go:55] Registering systemd factory
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836395    2523 factory.go:223] Registration of the systemd container factory successfully
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836572    2523 factory.go:153] Registering CRI-O factory
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836582    2523 factory.go:223] Registration of the crio container factory successfully
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836621    2523 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836637    2523 factory.go:103] Registering Raw factory
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.836647    2523 manager.go:1196] Started watching for new ooms in manager
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.837006    2523 manager.go:349] Starting recovery of all containers
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.837833    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.844419    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmfrz"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.853575    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmfrz"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.858107    2523 manager.go:354] Recovery completed
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.859375    2523 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.862765    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.863507    2523 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.864533    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.864569    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.864585    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.865256    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.865315    2523 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.865326    2523 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 15:00:25.195430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.865345    2523 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.866054    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.866086    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.866103    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.867537    2523 policy_none.go:49] "None policy: Start"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.867550    2523 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.867559    2523 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.869532    2523 policy_none.go:47] "Start"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.908643    2523 manager.go:337] "Starting Device Plugin manager"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.908733    2523 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.908743    2523 server.go:87] "Starting device plugin registration server"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.909003    2523 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.909018    2523 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.909164    2523 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.909246    2523 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.909256    2523 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.909629    2523 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.909679    2523 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.957766    2523 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.958894    2523 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.958939    2523 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.958970    2523 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:24.959007    2523 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:24.961747    2523 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.009380    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.010235    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.010259    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.010268    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.010289    2523 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.019625    2523 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.019642    2523 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-217.ec2.internal\": node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.036717    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.059603    2523 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"]
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.059667    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.060930    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.060954    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.060962    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063114    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.284060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063241    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063268    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063735    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063760    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.063771    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.064225    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.064253    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.064276    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.066340    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.066365    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.067006    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.067032    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.067060    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.093539    2523 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-217.ec2.internal\" not found" node="ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.107010    2523 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-217.ec2.internal\" not found" node="ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.136866    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.136942    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.136963    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.136980    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cc9923be72664a1d868fb9f3e40b0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-217.ec2.internal\" (UID: \"6cc9923be72664a1d868fb9f3e40b0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.237032    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237088    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237127    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237152    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cc9923be72664a1d868fb9f3e40b0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-217.ec2.internal\" (UID: \"6cc9923be72664a1d868fb9f3e40b0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237176    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237191    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec9a3f92dd842ef4b6a8d819b3ae9033-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal\" (UID: \"ec9a3f92dd842ef4b6a8d819b3ae9033\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.285851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.237236    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6cc9923be72664a1d868fb9f3e40b0d0-config\") pod \"kube-apiserver-proxy-ip-10-0-133-217.ec2.internal\" (UID: \"6cc9923be72664a1d868fb9f3e40b0d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.383751 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.338098    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.493376 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.396253    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.493376 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:25.409948    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:25.493376 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.439067    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:25.636459 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.539482    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:26.947588 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:25.639860    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:26.947588 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:26.906812    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:26.947588 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:26.946965    2523 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 15:00:26.947588 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:26.947098    2523 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:00:27.076444 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.006959    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.076444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.033013    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 14:55:26 +0000 UTC" deadline="2028-01-26 14:42:25.319970492 +0000 UTC"
Jul 23 15:00:27.076444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.033042    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13247h41m58.286931677s"
Jul 23 15:00:27.183857 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.107372    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.183857 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.124161    2523 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:27.291176 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.208041    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.291176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.243311    2523 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:27.291176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:27.266218    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9a3f92dd842ef4b6a8d819b3ae9033.slice/crio-418746e0714433cbd1729b21f73613a5a06cf9e6bf41ba9f3c1a7c1cd004d0ab WatchSource:0}: Error finding container 418746e0714433cbd1729b21f73613a5a06cf9e6bf41ba9f3c1a7c1cd004d0ab: Status 404 returned error can't find the container with id 418746e0714433cbd1729b21f73613a5a06cf9e6bf41ba9f3c1a7c1cd004d0ab
Jul 23 15:00:27.291176 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:27.266759    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc9923be72664a1d868fb9f3e40b0d0.slice/crio-6aded34cbbff220f44dde264b448a97de399bfb3cfa4a826b726e1431a29f072 WatchSource:0}: Error finding container 6aded34cbbff220f44dde264b448a97de399bfb3cfa4a826b726e1431a29f072: Status 404 returned error can't find the container with id 6aded34cbbff220f44dde264b448a97de399bfb3cfa4a826b726e1431a29f072
Jul 23 15:00:27.291176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.279231    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:00:27.382804 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.308606    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.501691 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.408973    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.510257 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:27.509816    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-217.ec2.internal\" not found"
Jul 23 15:00:27.706931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.572533    2523 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:27.706931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.602458    2523 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:27.706931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.617711    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:00:27.706931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.618501    2523 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal"
Jul 23 15:00:27.706931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.629250    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:00:27.985595 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.985518    2523 apiserver.go:52] "Watching apiserver"
Jul 23 15:00:27.993671 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.993647    2523 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 15:00:27.994075 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.994042    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fqs4c","kube-system/konnectivity-agent-khjpc","kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l","openshift-cluster-node-tuning-operator/tuned-s9rkm","openshift-dns/node-resolver-nd6dn","openshift-image-registry/node-ca-k97lp","openshift-multus/network-metrics-daemon-vsppp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal","openshift-multus/multus-additional-cni-plugins-8prkm","openshift-multus/multus-qbv4w","openshift-network-diagnostics/network-check-target-fqlgc","openshift-network-operator/iptables-alerter-twdlx","openshift-ovn-kubernetes/ovnkube-node-gh4q9"]
Jul 23 15:00:27.996776 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.996757    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:27.999292 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:27.999274    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.001864 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.001840    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.002082 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.002059    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 15:00:28.002213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.002199    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 15:00:28.002394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.002375    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.002460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.002440    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z5gs5\""
Jul 23 15:00:28.003095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.003077    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.004361 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.004342    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.005594 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.005465    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 15:00:28.005594 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.005540    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.005742 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.005649    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 15:00:28.005899 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.005879    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 15:00:28.006010 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.005995    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.006069 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006017    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsfvk\""
Jul 23 15:00:28.006122 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006016    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.006122 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006100    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 15:00:28.006218 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006144    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.006544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006524    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.006865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006847    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 15:00:28.007012 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.006996    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smvq6\""
Jul 23 15:00:28.007602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.007282    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.007602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.007386    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 15:00:28.007602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.007398    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.008316 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.008295    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lbhqk\""
Jul 23 15:00:28.009218 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.008874    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.009379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.009358    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.010589 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.010571    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.010681 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.010628    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nhw5p\""
Jul 23 15:00:28.011619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.011202    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.011619 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.011284    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:28.012717 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.012695    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.012802 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.012744    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7phl2\""
Jul 23 15:00:28.012975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.012955    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.013694 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013671    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-host-slash\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.013778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013716    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.013894 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013860    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-node-log\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.013934 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013904    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.013934 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013915    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.013990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013931    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-netd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.013990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.013957    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-device-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014071 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.013994    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:28.014071 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014002    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-slash\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014071    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-script-lib\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014100    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014132    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr5wj\" (UniqueName: \"kubernetes.io/projected/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kube-api-access-tr5wj\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014160    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-log-socket\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014209    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-netns\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014256    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014289    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-env-overrides\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014323    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-serviceca\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.014543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014375    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hbp9\" (UniqueName: \"kubernetes.io/projected/4dd46a0d-385a-4531-9657-7b3aaca8e01e-kube-api-access-9hbp9\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014407    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-etc-selinux\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014438    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-host\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.014543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014512    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-registration-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014547    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-systemd-units\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014598    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-var-lib-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014657    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovn-node-metrics-cert\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014755 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014713    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgvsl\" (UniqueName: \"kubernetes.io/projected/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-kube-api-access-wgvsl\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.014800 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014782    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-kubelet\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014821    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-systemd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014874 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014856    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-socket-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.014911 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014895    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-ovn\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014953 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014937    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-etc-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.014986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.014971    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-bin\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.015060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.015046    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-config\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.015092 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.015075    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-sys-fs\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.015130 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.015108    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmlq2\" (UniqueName: \"kubernetes.io/projected/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-kube-api-access-jmlq2\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.015160 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.015147    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-iptables-alerter-script\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.016988 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.016968    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.019206 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.019186    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 15:00:28.019499 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.019469    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 15:00:28.019722 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.019705    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5s4x4\""
Jul 23 15:00:28.019811 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.019792    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.020639 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.020619    2523 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:00:28.021729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.021711    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.022745 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.022728    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 15:00:28.023024 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.023008    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 15:00:28.023239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.023220    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 15:00:28.023500 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.023467    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 15:00:28.023644 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.023621    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ndmjg\""
Jul 23 15:00:28.024037 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.024017    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:28.024120 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.024076    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:28.024303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.024285    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 15:00:28.024303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.024297    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bqxb6\""
Jul 23 15:00:28.024632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.024618    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 15:00:28.052597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.052570    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zzdh"
Jul 23 15:00:28.062723 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.062701    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zzdh"
Jul 23 15:00:28.103027 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.102994    2523 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 15:00:28.115678 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115652    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115688    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115715    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-log-socket\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115733    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-serviceca\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115747    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-run\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115763    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-tmp\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115783    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.115807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115806    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115822    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2s5g\" (UniqueName: \"kubernetes.io/projected/a8d7a2eb-d25e-4edb-8217-ff970458541e-kube-api-access-m2s5g\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115838    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-etc-selinux\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115856    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-log-socket\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115863    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-tmp-dir\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115907    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-hostroot\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115938    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-multus-certs\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115961    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fctv9\" (UniqueName: \"kubernetes.io/projected/b96bc61d-0254-49f5-b82f-3d6cb779d334-kube-api-access-fctv9\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.115997    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-etc-selinux\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116011    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-systemd-units\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116037    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgvsl\" (UniqueName: \"kubernetes.io/projected/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-kube-api-access-wgvsl\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.116151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116113    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-systemd-units\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116154    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km7bb\" (UniqueName: \"kubernetes.io/projected/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-kube-api-access-km7bb\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116185    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prk8w\" (UniqueName: \"kubernetes.io/projected/14ed8da3-d298-4724-ab4e-0ec0913769ed-kube-api-access-prk8w\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116209    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-kubelet-config\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116232    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-system-cni-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116264    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-os-release\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116299    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-kubelet\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116324    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-systemd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116365    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-lib-modules\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116367    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-serviceca\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116382    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-kubelet\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116398    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-systemd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116390    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-ovn\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116434    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-ovn\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.116620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116447    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-etc-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116474    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-bin\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116526    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-config\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116529    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-etc-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116573    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-bin\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116581    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-sys-fs\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116609    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-iptables-alerter-script\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116632    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-host-slash\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116675    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-var-lib-kubelet\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116701    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116714    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-host-slash\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116724    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-netd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116756    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-device-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116788    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nps7p\" (UniqueName: \"kubernetes.io/projected/2e831648-9a5d-49ae-a102-bfb3355f7c8d-kube-api-access-nps7p\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.117319 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116793    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116812    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-dbus\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116852    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-cni-netd\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116860    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-multus\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116886    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-kubelet\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116900    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-device-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116910    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-conf-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116936    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-slash\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116954    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-sys-fs\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116960    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-script-lib\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.116998    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117019    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-tuned\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117052    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117074    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:28.117986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117088    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-config\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117099    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-kubernetes\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117115    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-sys\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117158    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117161    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117199    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0b7248-1943-448d-a504-5d22539e15ae-agent-certs\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117192    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-iptables-alerter-script\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117216    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-slash\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117218    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0b7248-1943-448d-a504-5d22539e15ae-konnectivity-ca\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117254    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-etc-kubernetes\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117282    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-netns\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117319    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117337    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-run-netns\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117363    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.118632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117387    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-env-overrides\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117424    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-system-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117472    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-netns\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117519    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hbp9\" (UniqueName: \"kubernetes.io/projected/4dd46a0d-385a-4531-9657-7b3aaca8e01e-kube-api-access-9hbp9\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117548    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovnkube-script-lib\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117554    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-host\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117597    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-modprobe-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117639    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-host\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117640    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-systemd\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117690    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-os-release\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117719    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117747    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-cni-binary-copy\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117750    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4dd46a0d-385a-4531-9657-7b3aaca8e01e-env-overrides\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117773    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-registration-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.119310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117832    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-var-lib-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117850    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovn-node-metrics-cert\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117860    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-registration-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117869    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysconfig\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117883    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-var-lib-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117966    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-hosts-file\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.117985    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-cnibin\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118000    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-socket-dir-parent\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118017    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-socket-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118037    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-conf\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118063    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-host\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118096    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmlq2\" (UniqueName: \"kubernetes.io/projected/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-kube-api-access-jmlq2\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118149    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a0cb701-b194-4b14-88cb-d2fd0b440f38-socket-dir\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118153    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-bin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.119982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118185    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118201    2523 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118227    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-run-openvswitch\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118254    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-node-log\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118285    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118330    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4dd46a0d-385a-4531-9657-7b3aaca8e01e-node-log\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118365    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-cnibin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118390    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-daemon-config\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118423    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr5wj\" (UniqueName: \"kubernetes.io/projected/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kube-api-access-tr5wj\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.120641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.118453    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-k8s-cni-cncf-io\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.121963 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.121944    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dd46a0d-385a-4531-9657-7b3aaca8e01e-ovn-node-metrics-cert\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.127141 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.127096    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgvsl\" (UniqueName: \"kubernetes.io/projected/33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa-kube-api-access-wgvsl\") pod \"iptables-alerter-twdlx\" (UID: \"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa\") " pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.130398 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.130352    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal" event={"ID":"ec9a3f92dd842ef4b6a8d819b3ae9033","Type":"ContainerStarted","Data":"418746e0714433cbd1729b21f73613a5a06cf9e6bf41ba9f3c1a7c1cd004d0ab"}
Jul 23 15:00:28.130630 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.130609    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hbp9\" (UniqueName: \"kubernetes.io/projected/4dd46a0d-385a-4531-9657-7b3aaca8e01e-kube-api-access-9hbp9\") pod \"ovnkube-node-gh4q9\" (UID: \"4dd46a0d-385a-4531-9657-7b3aaca8e01e\") " pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.131504 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.131471    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr5wj\" (UniqueName: \"kubernetes.io/projected/6a0cb701-b194-4b14-88cb-d2fd0b440f38-kube-api-access-tr5wj\") pod \"aws-ebs-csi-driver-node-6552l\" (UID: \"6a0cb701-b194-4b14-88cb-d2fd0b440f38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.131911 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.131877    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmlq2\" (UniqueName: \"kubernetes.io/projected/7d3c1d29-521f-491e-a4d7-ef091d6e40d6-kube-api-access-jmlq2\") pod \"node-ca-k97lp\" (UID: \"7d3c1d29-521f-491e-a4d7-ef091d6e40d6\") " pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.134544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.132368    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal" event={"ID":"6cc9923be72664a1d868fb9f3e40b0d0","Type":"ContainerStarted","Data":"6aded34cbbff220f44dde264b448a97de399bfb3cfa4a826b726e1431a29f072"}
Jul 23 15:00:28.219370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219330    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-run\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.219370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219367    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-tmp\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219468    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219529    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219535    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-run\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219555    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2s5g\" (UniqueName: \"kubernetes.io/projected/a8d7a2eb-d25e-4edb-8217-ff970458541e-kube-api-access-m2s5g\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219584    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-tmp-dir\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219606    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-hostroot\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.219628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219627    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-multus-certs\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.219645    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219650    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fctv9\" (UniqueName: \"kubernetes.io/projected/b96bc61d-0254-49f5-b82f-3d6cb779d334-kube-api-access-fctv9\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219679    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km7bb\" (UniqueName: \"kubernetes.io/projected/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-kube-api-access-km7bb\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.219728    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:28.719689467 +0000 UTC m=+3.014426939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219749    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prk8w\" (UniqueName: \"kubernetes.io/projected/14ed8da3-d298-4724-ab4e-0ec0913769ed-kube-api-access-prk8w\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219776    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-kubelet-config\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219800    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-system-cni-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219822    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-os-release\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219848    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-lib-modules\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.219906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219878    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-var-lib-kubelet\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219906    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-multus-certs\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219928    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-kubelet-config\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219948    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-tmp-dir\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219944    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-hostroot\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220002    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-system-cni-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.219917    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nps7p\" (UniqueName: \"kubernetes.io/projected/2e831648-9a5d-49ae-a102-bfb3355f7c8d-kube-api-access-nps7p\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220058    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220063    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-os-release\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220129    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-var-lib-kubelet\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220217    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-lib-modules\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220217    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-dbus\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220262    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-multus\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220287    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-kubelet\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.220333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220329    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-kubelet\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220337    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-multus\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220354    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec40c980-8f31-4ffd-890d-bdfcd871c998-dbus\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220377    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-conf-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220411    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-tuned\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220438    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-conf-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220436    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220505    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220531    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-kubernetes\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220553    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-sys\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220577    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220600    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0b7248-1943-448d-a504-5d22539e15ae-agent-certs\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220623    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0b7248-1943-448d-a504-5d22539e15ae-konnectivity-ca\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220624    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-kubernetes\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220646    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-etc-kubernetes\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220680    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-system-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220707    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-netns\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220718    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-sys\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220732    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-modprobe-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220753    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-systemd\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220772    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-os-release\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.220793    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220794    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220818    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-cni-binary-copy\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220841    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysconfig\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.220871    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:28.720852896 +0000 UTC m=+3.015590365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220890    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysconfig\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220891    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-hosts-file\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220916    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-cnibin\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.221710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220933    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-hosts-file\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220938    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-socket-dir-parent\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220969    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-conf\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220979    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-socket-dir-parent\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220994    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-host\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221020    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221032    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-host\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221044    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-systemd\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221027    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-bin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221095    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221101    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-netns\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221112    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-os-release\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221128    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-cnibin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221153    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-daemon-config\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221158    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.222348 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221159    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-conf\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221063    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-var-lib-cni-bin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.220681    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-etc-kubernetes\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221197    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-system-cni-dir\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221261    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-modprobe-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221333    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-k8s-cni-cncf-io\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221359    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221385    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221467    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-cnibin\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221634    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221691    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b96bc61d-0254-49f5-b82f-3d6cb779d334-host-run-k8s-cni-cncf-io\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221757    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-multus-daemon-config\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221783    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f0b7248-1943-448d-a504-5d22539e15ae-konnectivity-ca\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221804    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8d7a2eb-d25e-4edb-8217-ff970458541e-cnibin\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221840    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-sysctl-d\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.223057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.221907    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b96bc61d-0254-49f5-b82f-3d6cb779d334-cni-binary-copy\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.223804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.222136    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8d7a2eb-d25e-4edb-8217-ff970458541e-cni-binary-copy\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.223804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.222707    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-tmp\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.223804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.223694    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e831648-9a5d-49ae-a102-bfb3355f7c8d-etc-tuned\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.224320 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.224293    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f0b7248-1943-448d-a504-5d22539e15ae-agent-certs\") pod \"konnectivity-agent-khjpc\" (UID: \"8f0b7248-1943-448d-a504-5d22539e15ae\") " pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.229166 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.229124    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km7bb\" (UniqueName: \"kubernetes.io/projected/98ba62c1-586b-47ae-a2d4-4c82d9045ac6-kube-api-access-km7bb\") pod \"node-resolver-nd6dn\" (UID: \"98ba62c1-586b-47ae-a2d4-4c82d9045ac6\") " pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.231100 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.231079    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:28.231100 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.231102    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:28.231270 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.231113    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:28.231270 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.231181    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:28.731166425 +0000 UTC m=+3.025903895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:28.233604 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.233565    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prk8w\" (UniqueName: \"kubernetes.io/projected/14ed8da3-d298-4724-ab4e-0ec0913769ed-kube-api-access-prk8w\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.233723 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.233654    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nps7p\" (UniqueName: \"kubernetes.io/projected/2e831648-9a5d-49ae-a102-bfb3355f7c8d-kube-api-access-nps7p\") pod \"tuned-s9rkm\" (UID: \"2e831648-9a5d-49ae-a102-bfb3355f7c8d\") " pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.233781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.233758    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2s5g\" (UniqueName: \"kubernetes.io/projected/a8d7a2eb-d25e-4edb-8217-ff970458541e-kube-api-access-m2s5g\") pod \"multus-additional-cni-plugins-8prkm\" (UID: \"a8d7a2eb-d25e-4edb-8217-ff970458541e\") " pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.233865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.233848    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fctv9\" (UniqueName: \"kubernetes.io/projected/b96bc61d-0254-49f5-b82f-3d6cb779d334-kube-api-access-fctv9\") pod \"multus-qbv4w\" (UID: \"b96bc61d-0254-49f5-b82f-3d6cb779d334\") " pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.300547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.300457    2523 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:00:28.314753 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.314726    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k97lp"
Jul 23 15:00:28.323321 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.323301    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l"
Jul 23 15:00:28.333909 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.333893    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twdlx"
Jul 23 15:00:28.341706 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.341687    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:28.349365 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.349348    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9rkm"
Jul 23 15:00:28.355951 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.355933    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nd6dn"
Jul 23 15:00:28.363607 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.363587    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:28.370247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.370230    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8prkm"
Jul 23 15:00:28.374828 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.374811    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbv4w"
Jul 23 15:00:28.497692 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.497648    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd46a0d_385a_4531_9657_7b3aaca8e01e.slice/crio-c046436a3ebf48fda188858f1aba77da6ec230a6e86a9397d761b911ce07164d WatchSource:0}: Error finding container c046436a3ebf48fda188858f1aba77da6ec230a6e86a9397d761b911ce07164d: Status 404 returned error can't find the container with id c046436a3ebf48fda188858f1aba77da6ec230a6e86a9397d761b911ce07164d
Jul 23 15:00:28.498670 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.498552    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0cb701_b194_4b14_88cb_d2fd0b440f38.slice/crio-5cce4126e9b200cfc21a118709a7130929487cec56e62f9dc5264de27f25b01f WatchSource:0}: Error finding container 5cce4126e9b200cfc21a118709a7130929487cec56e62f9dc5264de27f25b01f: Status 404 returned error can't find the container with id 5cce4126e9b200cfc21a118709a7130929487cec56e62f9dc5264de27f25b01f
Jul 23 15:00:28.501979 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.501926    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c8121e_5787_4fe2_8bf1_7c5ef1ccb0aa.slice/crio-1966a5c71d87f7ceeb133f5e2a43ebc993c03b120ed11ac7fbc0e18a1b2b93f3 WatchSource:0}: Error finding container 1966a5c71d87f7ceeb133f5e2a43ebc993c03b120ed11ac7fbc0e18a1b2b93f3: Status 404 returned error can't find the container with id 1966a5c71d87f7ceeb133f5e2a43ebc993c03b120ed11ac7fbc0e18a1b2b93f3
Jul 23 15:00:28.505248 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.505225    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3c1d29_521f_491e_a4d7_ef091d6e40d6.slice/crio-fde3527085a6a1c8202848d35c38b9490857840bf3581d0a0d5390c7dcc49ca9 WatchSource:0}: Error finding container fde3527085a6a1c8202848d35c38b9490857840bf3581d0a0d5390c7dcc49ca9: Status 404 returned error can't find the container with id fde3527085a6a1c8202848d35c38b9490857840bf3581d0a0d5390c7dcc49ca9
Jul 23 15:00:28.505594 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.505477    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ba62c1_586b_47ae_a2d4_4c82d9045ac6.slice/crio-8f6270c9bc25dd9a015b2e242ea5be1b32e433e689256907b5688cd11a25440b WatchSource:0}: Error finding container 8f6270c9bc25dd9a015b2e242ea5be1b32e433e689256907b5688cd11a25440b: Status 404 returned error can't find the container with id 8f6270c9bc25dd9a015b2e242ea5be1b32e433e689256907b5688cd11a25440b
Jul 23 15:00:28.506466 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.506397    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d7a2eb_d25e_4edb_8217_ff970458541e.slice/crio-bc74e0ee2c9dcc0546ac746a11d8e9d8e320b641b67f7f1b81cfd8c212c42ae7 WatchSource:0}: Error finding container bc74e0ee2c9dcc0546ac746a11d8e9d8e320b641b67f7f1b81cfd8c212c42ae7: Status 404 returned error can't find the container with id bc74e0ee2c9dcc0546ac746a11d8e9d8e320b641b67f7f1b81cfd8c212c42ae7
Jul 23 15:00:28.507016 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.506987    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e831648_9a5d_49ae_a102_bfb3355f7c8d.slice/crio-684d736fcf1a7654879774a737305a43658badc3af7c646aee24075f09b0df41 WatchSource:0}: Error finding container 684d736fcf1a7654879774a737305a43658badc3af7c646aee24075f09b0df41: Status 404 returned error can't find the container with id 684d736fcf1a7654879774a737305a43658badc3af7c646aee24075f09b0df41
Jul 23 15:00:28.508775 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.508660    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0b7248_1943_448d_a504_5d22539e15ae.slice/crio-1055be25cb2f00cec6abbd41f0aa71caf502c22c8e013b588df584f15a04a202 WatchSource:0}: Error finding container 1055be25cb2f00cec6abbd41f0aa71caf502c22c8e013b588df584f15a04a202: Status 404 returned error can't find the container with id 1055be25cb2f00cec6abbd41f0aa71caf502c22c8e013b588df584f15a04a202
Jul 23 15:00:28.509049 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:00:28.509002    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96bc61d_0254_49f5_b82f_3d6cb779d334.slice/crio-3c635d982c9e133ace3769e5f790be8d2869737ea9d6b5aadd85e221b5280df5 WatchSource:0}: Error finding container 3c635d982c9e133ace3769e5f790be8d2869737ea9d6b5aadd85e221b5280df5: Status 404 returned error can't find the container with id 3c635d982c9e133ace3769e5f790be8d2869737ea9d6b5aadd85e221b5280df5
Jul 23 15:00:28.724830 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.724730    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:28.724830 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.724795    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:28.725067 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.724895    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:28.725067 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.724907    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:28.725067 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.724964    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:29.724947124 +0000 UTC m=+4.019684585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:28.725067 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.724982    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:29.724972759 +0000 UTC m=+4.019710222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:28.826291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:28.826037    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:28.826390 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.826199    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:28.826390 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.826340    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:28.826390 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.826355    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:28.826544 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:28.826418    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:29.826399 +0000 UTC m=+4.121136469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:29.066327 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.066213    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:55:28 +0000 UTC" deadline="2028-04-11 04:10:54.316321434 +0000 UTC"
Jul 23 15:00:29.066327 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.066274    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15061h10m25.250051999s"
Jul 23 15:00:29.126505 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.125945    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:29.126505 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.126082    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:29.140653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.140619    2523 generic.go:356] "Generic (PLEG): container finished" podID="ec9a3f92dd842ef4b6a8d819b3ae9033" containerID="1d34dd382d3e508c484c4a2921f8c4d05b64caecae251a498d3916286e5aeb51" exitCode=0
Jul 23 15:00:29.140787 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.140723    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal" event={"ID":"ec9a3f92dd842ef4b6a8d819b3ae9033","Type":"ContainerDied","Data":"1d34dd382d3e508c484c4a2921f8c4d05b64caecae251a498d3916286e5aeb51"}
Jul 23 15:00:29.145830 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.145779    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbv4w" event={"ID":"b96bc61d-0254-49f5-b82f-3d6cb779d334","Type":"ContainerStarted","Data":"3c635d982c9e133ace3769e5f790be8d2869737ea9d6b5aadd85e221b5280df5"}
Jul 23 15:00:29.149103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.149042    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khjpc" event={"ID":"8f0b7248-1943-448d-a504-5d22539e15ae","Type":"ContainerStarted","Data":"1055be25cb2f00cec6abbd41f0aa71caf502c22c8e013b588df584f15a04a202"}
Jul 23 15:00:29.151710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.151645    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9rkm" event={"ID":"2e831648-9a5d-49ae-a102-bfb3355f7c8d","Type":"ContainerStarted","Data":"684d736fcf1a7654879774a737305a43658badc3af7c646aee24075f09b0df41"}
Jul 23 15:00:29.155291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.155214    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k97lp" event={"ID":"7d3c1d29-521f-491e-a4d7-ef091d6e40d6","Type":"ContainerStarted","Data":"fde3527085a6a1c8202848d35c38b9490857840bf3581d0a0d5390c7dcc49ca9"}
Jul 23 15:00:29.158699 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.158647    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twdlx" event={"ID":"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa","Type":"ContainerStarted","Data":"1966a5c71d87f7ceeb133f5e2a43ebc993c03b120ed11ac7fbc0e18a1b2b93f3"}
Jul 23 15:00:29.161943 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.161917    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nd6dn" event={"ID":"98ba62c1-586b-47ae-a2d4-4c82d9045ac6","Type":"ContainerStarted","Data":"8f6270c9bc25dd9a015b2e242ea5be1b32e433e689256907b5688cd11a25440b"}
Jul 23 15:00:29.164871 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.164848    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerStarted","Data":"bc74e0ee2c9dcc0546ac746a11d8e9d8e320b641b67f7f1b81cfd8c212c42ae7"}
Jul 23 15:00:29.166339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.166317    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l" event={"ID":"6a0cb701-b194-4b14-88cb-d2fd0b440f38","Type":"ContainerStarted","Data":"5cce4126e9b200cfc21a118709a7130929487cec56e62f9dc5264de27f25b01f"}
Jul 23 15:00:29.168833 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.168809    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"c046436a3ebf48fda188858f1aba77da6ec230a6e86a9397d761b911ce07164d"}
Jul 23 15:00:29.733299 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.733260    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:29.733478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.733333    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:29.733478 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.733456    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:29.733611 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.733538    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:31.733516967 +0000 UTC m=+6.028254444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:29.733611 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.733603    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:29.733714 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.733638    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:31.733626659 +0000 UTC m=+6.028364129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:29.834136 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:29.834095    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:29.834340 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.834316    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:29.834431 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.834343    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:29.834431 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.834356    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:29.834431 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:29.834414    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:31.834395018 +0000 UTC m=+6.129132488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:30.067158 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:30.067070    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 14:55:28 +0000 UTC" deadline="2028-02-08 19:38:08.468220259 +0000 UTC"
Jul 23 15:00:30.067158 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:30.067108    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13564h37m38.401117001s"
Jul 23 15:00:30.127732 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:30.127697    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:30.128149 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:30.127835    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:30.128427 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:30.128291    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:30.128427 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:30.128385    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:31.126355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:31.126275    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:31.126533 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.126425    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:31.751587    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:31.751669    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.751800    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.751860    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:35.751841908 +0000 UTC m=+10.046579371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.752315    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:31.752397 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.752364    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:35.752348765 +0000 UTC m=+10.047086227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:31.853150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:31.852480    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:31.853150 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.852672    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:31.853150 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.852695    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:31.853150 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.852708    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:31.853150 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:31.852764    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:35.852746212 +0000 UTC m=+10.147483683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:32.128799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:32.128719    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:32.128940 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:32.128849    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:32.129262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:32.129241    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:32.129356 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:32.129333    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:33.125703 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:33.125666    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:33.126170 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:33.125814    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:34.128248 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:34.127595    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:34.128248 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:34.127720    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:34.128248 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:34.128071    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:34.128248 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:34.128162    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:35.126209 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:35.126177    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:35.126394 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.126328    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:35.787168    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:35.787240    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.787359    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.787417    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:43.787399019 +0000 UTC m=+18.082136526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.787801    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:35.787883 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.787851    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:43.78783632 +0000 UTC m=+18.082573780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:35.888110 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:35.888034    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:35.888285 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.888188    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:35.888285 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.888213    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:35.888285 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.888226    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:35.888447 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:35.888290    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:43.888269392 +0000 UTC m=+18.183006865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:36.127468 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:36.126920    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:36.127468 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:36.127047    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:36.127468 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:36.127096    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:36.127468 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:36.127217    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:37.125879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:37.125842    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:37.126301 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:37.125992    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:38.126261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:38.126097    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:38.126261 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:38.126219    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:38.126814 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:38.126415    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:38.126814 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:38.126577    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:39.125954 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:39.125916    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:39.126105 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:39.126028    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:40.125917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:40.125882    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:40.125917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:40.125922    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:40.126371 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:40.126024    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:40.126371 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:40.126161    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:41.126500 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:41.126451    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:41.126946 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:41.126594    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:42.125954 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:42.125917    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:42.126120 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:42.126049    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:42.126178 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:42.126111    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:42.126241 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:42.126226    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:43.126026 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:43.125993    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:43.126449 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.126134    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:43.848996 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:43.848962    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:43.849179 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:43.849029    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:43.849179 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.849132    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:43.849329 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.849211    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.849191857 +0000 UTC m=+34.143929316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:43.849329 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.849132    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:43.849329 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.849297    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.849280852 +0000 UTC m=+34.144018320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:43.949697 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:43.949653    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:43.949875 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.949806    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:43.949875 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.949836    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:43.949875 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.949851    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:43.950025 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:43.949917    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:00:59.949897549 +0000 UTC m=+34.244635009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:44.126446 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:44.126369    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:44.126887 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:44.126519    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:44.126887 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:44.126576    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:44.126887 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:44.126663    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:45.125873 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:45.125838    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:45.126030 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:45.125971    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:46.126777 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:46.126745    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:46.127198 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:46.126816    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:46.127198 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:46.126831    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:46.127198 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:46.126901    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:47.126176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.126015    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:47.126281 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:47.126263    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:47.205394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.205367    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nd6dn" event={"ID":"98ba62c1-586b-47ae-a2d4-4c82d9045ac6","Type":"ContainerStarted","Data":"ca48b369e8022d67574c21dd53d6a4fc0d229faef12f8f051464e9d65a887602"}
Jul 23 15:00:47.206972 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.206950    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="fe72e69652bc7b8d0dacf4639206ade04b48344114df95ae4d2b969197f36e63" exitCode=0
Jul 23 15:00:47.207060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.207019    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"fe72e69652bc7b8d0dacf4639206ade04b48344114df95ae4d2b969197f36e63"}
Jul 23 15:00:47.208549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.208524    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l" event={"ID":"6a0cb701-b194-4b14-88cb-d2fd0b440f38","Type":"ContainerStarted","Data":"e33a97bebcbdb7b3afd567dd254f2faec628369b71791f0736ee1cf77f364bba"}
Jul 23 15:00:47.211103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.211007    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"0246778fae4d86b05ea01148069ec2e081b000e513963aa8f443041369a865c4"}
Jul 23 15:00:47.211103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.211079    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"019ed8041eb84a6036005d3f3ddef5c2095fc230b0fdac0f69ec46e36fd0c803"}
Jul 23 15:00:47.211229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.211117    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"2668b7528b3fdc28ee57c822c82e5da02878d13c577030ef1033b0db08873b54"}
Jul 23 15:00:47.211229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.211150    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"e41b7def19e6b526b3ad20b17cab0ef4c83bd2afe77329d8c0f0d12364b03bd6"}
Jul 23 15:00:47.212796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.212773    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal" event={"ID":"ec9a3f92dd842ef4b6a8d819b3ae9033","Type":"ContainerStarted","Data":"88795a2e9d61e201cb8b14a1ee6171ae448fb37de54061147f62adee340d008e"}
Jul 23 15:00:47.213999 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.213982    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal" event={"ID":"6cc9923be72664a1d868fb9f3e40b0d0","Type":"ContainerStarted","Data":"4a50d6934fe6b2374cad5fc485bcbe0b9c63a6c82fc6061584f7c2a48b4fbdca"}
Jul 23 15:00:47.215438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.215417    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbv4w" event={"ID":"b96bc61d-0254-49f5-b82f-3d6cb779d334","Type":"ContainerStarted","Data":"2c16eccd54c6e188c71cabf51dab7bce9a7c3185df888de793b44d0a4c30c420"}
Jul 23 15:00:47.216873 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.216856    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khjpc" event={"ID":"8f0b7248-1943-448d-a504-5d22539e15ae","Type":"ContainerStarted","Data":"7b2cae2724ef573651dc68d29b45cea159b0adb0359b611d6e4bc4821803fd41"}
Jul 23 15:00:47.218259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.218230    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9rkm" event={"ID":"2e831648-9a5d-49ae-a102-bfb3355f7c8d","Type":"ContainerStarted","Data":"7acc64c15ddba3645ae3bf141a885fb018914db79b0bc7a8476f81eaaa6bb971"}
Jul 23 15:00:47.219588 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.219560    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k97lp" event={"ID":"7d3c1d29-521f-491e-a4d7-ef091d6e40d6","Type":"ContainerStarted","Data":"ad04a11cdd6ffec5e3954e2f906bbe04e0ebe715f4efcfe5391f51ac2fcbe2be"}
Jul 23 15:00:47.255221 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.255183    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s9rkm" podStartSLOduration=3.070239198 podStartE2EDuration="21.255171807s" totalImagesPullingTime="18.184932609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.254741627 +0000 UTC m=+21.549479104" watchObservedRunningTime="2026-07-23 15:00:47.255171807 +0000 UTC m=+21.549909284"
Jul 23 15:00:47.255311 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.255278    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nd6dn" podStartSLOduration=12.810206921 podStartE2EDuration="21.255275114s" totalImagesPullingTime="8.445068193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.233286172 +0000 UTC m=+21.528023650" watchObservedRunningTime="2026-07-23 15:00:47.255275114 +0000 UTC m=+21.550012591"
Jul 23 15:00:47.271503 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.271450    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-khjpc" podStartSLOduration=12.85006949 podStartE2EDuration="21.271438263s" totalImagesPullingTime="8.421368773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.271395867 +0000 UTC m=+21.566133346" watchObservedRunningTime="2026-07-23 15:00:47.271438263 +0000 UTC m=+21.566175740"
Jul 23 15:00:47.316112 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.316077    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qbv4w" podStartSLOduration=3.075396921 podStartE2EDuration="21.316063276s" totalImagesPullingTime="18.240666355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.315996406 +0000 UTC m=+21.610733885" watchObservedRunningTime="2026-07-23 15:00:47.316063276 +0000 UTC m=+21.610800754"
Jul 23 15:00:47.334660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.334618    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-217.ec2.internal" podStartSLOduration=20.334603855 podStartE2EDuration="20.334603855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.334524441 +0000 UTC m=+21.629261920" watchObservedRunningTime="2026-07-23 15:00:47.334603855 +0000 UTC m=+21.629341335"
Jul 23 15:00:47.352381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.352349    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-217.ec2.internal" podStartSLOduration=20.35233816 podStartE2EDuration="20.35233816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.352200316 +0000 UTC m=+21.646937776" watchObservedRunningTime="2026-07-23 15:00:47.35233816 +0000 UTC m=+21.647075638"
Jul 23 15:00:47.368392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:47.368352    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k97lp" podStartSLOduration=3.152413757 podStartE2EDuration="21.368341429s" totalImagesPullingTime="18.215927672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:47.367964292 +0000 UTC m=+21.662701771" watchObservedRunningTime="2026-07-23 15:00:47.368341429 +0000 UTC m=+21.663078906"
Jul 23 15:00:48.126339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.126313    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:48.126460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.126313    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:48.126460 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:48.126412    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:48.126580 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:48.126477    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:48.223852 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.223822    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"74f4517bbfbf46bbfb783d9892b353e3c1c45e73b961e99983feb35ce7e8e3e3"}
Jul 23 15:00:48.224155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.223897    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"c5f270219018e552e8730a0f12ace6d94e0a50a556a67a1d64d539df76324ea4"}
Jul 23 15:00:48.225162 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.225136    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twdlx" event={"ID":"33c8121e-5787-4fe2-8bf1-7c5ef1ccb0aa","Type":"ContainerStarted","Data":"20157e2b4c514e29c2b0420acfa30678ef428f702e07c37bbc5663f5f73f21c7"}
Jul 23 15:00:48.249673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.249626    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twdlx" podStartSLOduration=4.038310182 podStartE2EDuration="22.24960698s" totalImagesPullingTime="18.211296798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:48.249282174 +0000 UTC m=+22.544019673" watchObservedRunningTime="2026-07-23 15:00:48.24960698 +0000 UTC m=+22.544344458"
Jul 23 15:00:48.257570 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:48.257548    2523 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 15:00:49.088909 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:49.088665    2523 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:00:48.257564445Z","UUID":"30b553bb-e7c1-46d1-b182-ad31e9a5095d","Handler":null,"Name":"","Endpoint":""}
Jul 23 15:00:49.090280 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:49.090259    2523 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 15:00:49.090380 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:49.090296    2523 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 15:00:49.125917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:49.125889    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:49.126030 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:49.125999    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:49.229108 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:49.229078    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l" event={"ID":"6a0cb701-b194-4b14-88cb-d2fd0b440f38","Type":"ContainerStarted","Data":"0f030dacee4c4e12f4fe49d7de3838c08dc855318740db9cc433d4f7a42a5054"}
Jul 23 15:00:50.092745 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.092662    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:50.093283 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.093257    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:50.126371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.126342    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:50.126525 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:50.126455    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:50.126605 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.126549    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:50.126684 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:50.126658    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:50.237612 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.237579    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"83cf0c467547d3fc9984ca3ecb2b7681af442932760e3a6d6bce75ecd24c0c24"}
Jul 23 15:00:50.242734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.242704    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l" event={"ID":"6a0cb701-b194-4b14-88cb-d2fd0b440f38","Type":"ContainerStarted","Data":"3a9422e075bb836ec47bdadfbca61fb508be6173dec8ef3a3e3da7a00c1218a4"}
Jul 23 15:00:50.267035 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:50.266984    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6552l" podStartSLOduration=3.942298424 podStartE2EDuration="24.266970358s" totalImagesPullingTime="20.324671934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:50.266656462 +0000 UTC m=+24.561393941" watchObservedRunningTime="2026-07-23 15:00:50.266970358 +0000 UTC m=+24.561707882"
Jul 23 15:00:51.125940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:51.125754    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:51.126101 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:51.126036    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:52.126609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:52.126571    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:52.127038 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:52.126703    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:52.127038 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:52.126755    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:52.127038 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:52.126885    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:53.079394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.079155    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:53.079553 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.079397    2523 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:00:53.080243 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.080225    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-khjpc"
Jul 23 15:00:53.126585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.126556    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:53.126695 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:53.126672    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:53.251205 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.251170    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="b4bdc52a0eed795d079cdf1e6e743bbd0e7fdf7e7ab3d106969ee1e0cd82bdad" exitCode=0
Jul 23 15:00:53.251375 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.251252    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"b4bdc52a0eed795d079cdf1e6e743bbd0e7fdf7e7ab3d106969ee1e0cd82bdad"}
Jul 23 15:00:53.255126 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.255093    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" event={"ID":"4dd46a0d-385a-4531-9657-7b3aaca8e01e","Type":"ContainerStarted","Data":"8725e85934faefe296bf3b9cf0acf9a58096d3a547c7b9b2880047034f40506c"}
Jul 23 15:00:53.255379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.255349    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:53.255506 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.255417    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:53.270614 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.270594    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:53.270760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:53.270744    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:54.126084 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.126052    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:54.126345 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.126088    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:54.126345 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:54.126166    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:54.126345 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:54.126292    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:54.257460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.257434    2523 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 15:00:54.327087 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.327063    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:00:54.409333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.409225    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9" podStartSLOduration=10.091494196 podStartE2EDuration="28.40920967s" totalImagesPullingTime="18.317715474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:00:53.339432855 +0000 UTC m=+27.634170333" watchObservedRunningTime="2026-07-23 15:00:54.40920967 +0000 UTC m=+28.703947201"
Jul 23 15:00:54.409576 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.409558    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqs4c"]
Jul 23 15:00:54.409663 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.409649    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:54.409769 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:54.409750    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:54.412230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.412210    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqlgc"]
Jul 23 15:00:54.412351 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.412281    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:54.412412 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:54.412355    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:54.412865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.412847    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vsppp"]
Jul 23 15:00:54.412961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:54.412947    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:54.413067 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:54.413050    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:56.128022    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:56.128390    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:56.128860    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:56.128972    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:56.129025    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:56.129148 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:56.129111    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:56.263267 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:56.263197    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="19f179b48cd350c938ecf36fb43b354526f8f99c60c9d237d2791b1300b02095" exitCode=0
Jul 23 15:00:56.263392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:56.263271    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"19f179b48cd350c938ecf36fb43b354526f8f99c60c9d237d2791b1300b02095"}
Jul 23 15:00:58.125732 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:58.125705    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:58.126173 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:58.125740    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:58.126173 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:58.125705    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:58.126173 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:58.125831    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fqs4c" podUID="ec40c980-8f31-4ffd-890d-bdfcd871c998"
Jul 23 15:00:58.126173 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:58.125927    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqlgc" podUID="eb525ff0-c596-4095-8c99-51bb0671c9cf"
Jul 23 15:00:58.126173 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:58.126007    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vsppp" podUID="14ed8da3-d298-4724-ab4e-0ec0913769ed"
Jul 23 15:00:58.272632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:58.272592    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="a166e5268c4e81bb3fa46e40ed1106123a6dbfcba094fdf02690f935648d3a72" exitCode=0
Jul 23 15:00:58.272813 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:58.272649    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"a166e5268c4e81bb3fa46e40ed1106123a6dbfcba094fdf02690f935648d3a72"}
Jul 23 15:00:59.545936 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.545904    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-217.ec2.internal" event="NodeReady"
Jul 23 15:00:59.546479 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.546078    2523 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 15:00:59.643621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.643586    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82kvd"]
Jul 23 15:00:59.646276 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.646252    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.649444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.649423    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 15:00:59.649967 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.649934    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 15:00:59.650083 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.649980    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 15:00:59.650417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.650398    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4gdwl\""
Jul 23 15:00:59.666910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.666889    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82kvd"]
Jul 23 15:00:59.675815 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.675796    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l97lp"]
Jul 23 15:00:59.678572 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.678556    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.681650 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.681628    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 15:00:59.681993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.681863    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-msfpg\""
Jul 23 15:00:59.682263 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.682243    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 15:00:59.682754 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.682736    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c9vpk"]
Jul 23 15:00:59.685776 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.685749    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.688801 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.688765    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 15:00:59.688801 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.688788    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5f6ms\""
Jul 23 15:00:59.688956 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.688771    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 15:00:59.689090 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.689074    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 15:00:59.689188 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.689170    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 15:00:59.701545 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.701523    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l97lp"]
Jul 23 15:00:59.710396 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.710373    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c9vpk"]
Jul 23 15:00:59.771320 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771295    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.771443 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771326    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-crio-socket\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.771443 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771368    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.771443 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771398    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfm2g\" (UniqueName: \"kubernetes.io/projected/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-api-access-kfm2g\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.771443 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771417    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-data-volume\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.771443 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771439    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-config-volume\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.771695 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771464    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-tmp-dir\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.771695 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771531    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shtg\" (UniqueName: \"kubernetes.io/projected/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-kube-api-access-2shtg\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.771695 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771552    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274fh\" (UniqueName: \"kubernetes.io/projected/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-kube-api-access-274fh\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.771695 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771571    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.771695 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.771601    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-cert\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.872674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872599    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.872674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872639    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:00:59.872674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872668    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfm2g\" (UniqueName: \"kubernetes.io/projected/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-api-access-kfm2g\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872695    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-data-volume\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872711    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-config-volume\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872736    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-tmp-dir\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872767    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shtg\" (UniqueName: \"kubernetes.io/projected/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-kube-api-access-2shtg\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872773    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872789    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-274fh\" (UniqueName: \"kubernetes.io/projected/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-kube-api-access-274fh\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872811    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872843    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret podName:ec40c980-8f31-4ffd-890d-bdfcd871c998 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:31.872829067 +0000 UTC m=+66.167566523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret") pod "global-pull-secret-syncer-fqs4c" (UID: "ec40c980-8f31-4ffd-890d-bdfcd871c998") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872875    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872884    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.372864317 +0000 UTC m=+34.667601775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872813    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.872929 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.872924    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls podName:74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.372911595 +0000 UTC m=+34.667649067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls") pod "dns-default-l97lp" (UID: "74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65") : secret "dns-default-metrics-tls" not found
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872949    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-cert\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.872980    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873010    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873046    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-crio-socket\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873249    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-crio-socket\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873285    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-tmp-dir\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.873328    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.873366    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs podName:14ed8da3-d298-4724-ab4e-0ec0913769ed nodeName:}" failed. No retries permitted until 2026-07-23 15:01:31.873352749 +0000 UTC m=+66.168090218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs") pod "network-metrics-daemon-vsppp" (UID: "14ed8da3-d298-4724-ab4e-0ec0913769ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:00:59.873413 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.873407    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:00:59.873771 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.873445    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:00.373434607 +0000 UTC m=+34.668172077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : configmap "kube-rbac-proxy" not found
Jul 23 15:00:59.873771 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873607    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-data-volume\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.873771 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.873730    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-config-volume\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.877530 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.877510    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-cert\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.896256 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.896232    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shtg\" (UniqueName: \"kubernetes.io/projected/3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74-kube-api-access-2shtg\") pod \"ingress-canary-82kvd\" (UID: \"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74\") " pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.898349 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.898307    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-274fh\" (UniqueName: \"kubernetes.io/projected/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-kube-api-access-274fh\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:00:59.898533 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.898513    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfm2g\" (UniqueName: \"kubernetes.io/projected/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-api-access-kfm2g\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:00:59.957611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.957585    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82kvd"
Jul 23 15:00:59.973770 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:00:59.973746    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:00:59.973920 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.973903    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:00:59.973964 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.973923    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:00:59.973964 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.973934    2523 projected.go:196] Error preparing data for projected volume kube-api-access-9bzkw for pod openshift-network-diagnostics/network-check-target-fqlgc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:00:59.974032 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:00:59.973994    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw podName:eb525ff0-c596-4095-8c99-51bb0671c9cf nodeName:}" failed. No retries permitted until 2026-07-23 15:01:31.973979837 +0000 UTC m=+66.268717294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bzkw" (UniqueName: "kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw") pod "network-check-target-fqlgc" (UID: "eb525ff0-c596-4095-8c99-51bb0671c9cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:01:00.097134 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.097100    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82kvd"]
Jul 23 15:01:00.101101 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:00.101073    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba3f3e4_cfca_47ea_87dd_d5453fe3bb74.slice/crio-69f53b5fef20a87cbaf66507b05715fef89bc74ec8067ac07ac306007a4c005a WatchSource:0}: Error finding container 69f53b5fef20a87cbaf66507b05715fef89bc74ec8067ac07ac306007a4c005a: Status 404 returned error can't find the container with id 69f53b5fef20a87cbaf66507b05715fef89bc74ec8067ac07ac306007a4c005a
Jul 23 15:01:00.111392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.111372    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"]
Jul 23 15:01:00.115527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.115509    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"
Jul 23 15:01:00.117875 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.117855    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 15:01:00.118235 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.118210    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b8xsl\""
Jul 23 15:01:00.118340 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.118212    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 15:01:00.123791 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.123769    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"]
Jul 23 15:01:00.125674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.125651    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:01:00.125788 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.125651    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:01:00.126216 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.125772    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:01:00.127972 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.127955    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbp9q\""
Jul 23 15:01:00.128205 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.128176    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:01:00.128339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.128295    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:01:00.128613 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.128596    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v5f82\""
Jul 23 15:01:00.128714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.128628    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:01:00.128980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.128961    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:01:00.276122 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.276087    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvklb\" (UniqueName: \"kubernetes.io/projected/26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f-kube-api-access-wvklb\") pod \"migrator-7cc9c7ffd7-xr8ck\" (UID: \"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"
Jul 23 15:01:00.278464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.278424    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82kvd" event={"ID":"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74","Type":"ContainerStarted","Data":"69f53b5fef20a87cbaf66507b05715fef89bc74ec8067ac07ac306007a4c005a"}
Jul 23 15:01:00.377230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.377166    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:00.377230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.377221    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:00.377420 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377298    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:00.377420 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377309    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:00.377420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.377358    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:00.377420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.377386    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvklb\" (UniqueName: \"kubernetes.io/projected/26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f-kube-api-access-wvklb\") pod \"migrator-7cc9c7ffd7-xr8ck\" (UID: \"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"
Jul 23 15:01:00.377420 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377403    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:01.377382527 +0000 UTC m=+35.672119983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:00.377669 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377430    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:01.377420695 +0000 UTC m=+35.672158152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:00.377669 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377531    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:01:00.377669 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:00.377584    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls podName:74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:01.377568767 +0000 UTC m=+35.672306223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls") pod "dns-default-l97lp" (UID: "74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65") : secret "dns-default-metrics-tls" not found
Jul 23 15:01:00.386927 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.386903    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvklb\" (UniqueName: \"kubernetes.io/projected/26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f-kube-api-access-wvklb\") pod \"migrator-7cc9c7ffd7-xr8ck\" (UID: \"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"
Jul 23 15:01:00.427234 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.427197    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"
Jul 23 15:01:00.497654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.496654    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wl7vd"]
Jul 23 15:01:00.500455 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.500430    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.503739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.503712    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 15:01:00.503843 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.503712    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 15:01:00.505102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.504433    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mmzgp\""
Jul 23 15:01:00.505102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.504709    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 15:01:00.505102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.504884    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 15:01:00.515303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.515246    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wl7vd"]
Jul 23 15:01:00.577921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.577888    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck"]
Jul 23 15:01:00.587542 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:00.587516    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ebc79d_a1dc_4a79_8a46_7e35ab2ade7f.slice/crio-b88fb6b3a0a8cfc2f3721afb1628a092d1732feaef96674455fc5cf14ab8bcd1 WatchSource:0}: Error finding container b88fb6b3a0a8cfc2f3721afb1628a092d1732feaef96674455fc5cf14ab8bcd1: Status 404 returned error can't find the container with id b88fb6b3a0a8cfc2f3721afb1628a092d1732feaef96674455fc5cf14ab8bcd1
Jul 23 15:01:00.684240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.684150    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-cabundle\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.684240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.684212    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-key\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.684451 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.684244    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mjrw\" (UniqueName: \"kubernetes.io/projected/687806a2-8c37-41b4-b591-1e7dca7d670a-kube-api-access-2mjrw\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.785357 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.784895    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-cabundle\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.785357 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.784964    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-key\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.785357 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.784989    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mjrw\" (UniqueName: \"kubernetes.io/projected/687806a2-8c37-41b4-b591-1e7dca7d670a-kube-api-access-2mjrw\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.785739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.785708    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-cabundle\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.788587 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.788563    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/687806a2-8c37-41b4-b591-1e7dca7d670a-signing-key\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.794945 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.794920    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mjrw\" (UniqueName: \"kubernetes.io/projected/687806a2-8c37-41b4-b591-1e7dca7d670a-kube-api-access-2mjrw\") pod \"service-ca-58598695f7-wl7vd\" (UID: \"687806a2-8c37-41b4-b591-1e7dca7d670a\") " pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.814800 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.814773    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-wl7vd"
Jul 23 15:01:00.962028 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:00.961960    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-wl7vd"]
Jul 23 15:01:00.965741 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:00.965708    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687806a2_8c37_41b4_b591_1e7dca7d670a.slice/crio-684f213a806c6aad43423cf32a8007b8e3aceb3f9a16f5fbd2e7925058f5dad7 WatchSource:0}: Error finding container 684f213a806c6aad43423cf32a8007b8e3aceb3f9a16f5fbd2e7925058f5dad7: Status 404 returned error can't find the container with id 684f213a806c6aad43423cf32a8007b8e3aceb3f9a16f5fbd2e7925058f5dad7
Jul 23 15:01:01.283550 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.282916    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wl7vd" event={"ID":"687806a2-8c37-41b4-b591-1e7dca7d670a","Type":"ContainerStarted","Data":"684f213a806c6aad43423cf32a8007b8e3aceb3f9a16f5fbd2e7925058f5dad7"}
Jul 23 15:01:01.284517 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.284358    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck" event={"ID":"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f","Type":"ContainerStarted","Data":"b88fb6b3a0a8cfc2f3721afb1628a092d1732feaef96674455fc5cf14ab8bcd1"}
Jul 23 15:01:01.390735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.390693    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:01.390895 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.390844    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:01.390895 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.390854    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:01:01.390977 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.390905    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:01.390977 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.390929    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls podName:74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:03.390907683 +0000 UTC m=+37.685645159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls") pod "dns-default-l97lp" (UID: "74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65") : secret "dns-default-metrics-tls" not found
Jul 23 15:01:01.391052 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.390999    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:01.391052 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.391048    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:03.391033184 +0000 UTC m=+37.685770641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:01.391156 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.391094    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:01.391156 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:01.391127    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:03.391119612 +0000 UTC m=+37.685857068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:01.633028 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:01.632910    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nd6dn_98ba62c1-586b-47ae-a2d4-4c82d9045ac6/dns-node-resolver/0.log"
Jul 23 15:01:02.432159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:02.432129    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k97lp_7d3c1d29-521f-491e-a4d7-ef091d6e40d6/node-ca/0.log"
Jul 23 15:01:03.408928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:03.408886    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:03.408975    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:03.409029    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409043    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409115    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.409094836 +0000 UTC m=+41.703832296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409129    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409184    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.409168379 +0000 UTC m=+41.703905843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : configmap "kube-rbac-proxy" not found
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409196    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:01:03.409411 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:03.409257    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls podName:74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:07.409241426 +0000 UTC m=+41.703978881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls") pod "dns-default-l97lp" (UID: "74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65") : secret "dns-default-metrics-tls" not found
Jul 23 15:01:04.295540 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.295481    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="0c44821dff911d35672a9583b4ff6cfedb2f26d943865dd86bb144f747097847" exitCode=0
Jul 23 15:01:04.295540 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.295531    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"0c44821dff911d35672a9583b4ff6cfedb2f26d943865dd86bb144f747097847"}
Jul 23 15:01:04.297295 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.297269    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82kvd" event={"ID":"3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74","Type":"ContainerStarted","Data":"0ee6f9df7b8540004076fc89974962545b945c27122072f093547efd3322ab80"}
Jul 23 15:01:04.299408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.299296    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck" event={"ID":"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f","Type":"ContainerStarted","Data":"ffe5499259f384e850ab1f2e737a79b9781dcecdf068b51c895b68331e772818"}
Jul 23 15:01:04.299408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.299329    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck" event={"ID":"26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f","Type":"ContainerStarted","Data":"98e2fd8d8c804d741a3caf22369340ea8c6f38020a3fcf98381f18656bba4f88"}
Jul 23 15:01:04.342178 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.342125    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82kvd" podStartSLOduration=1.639483537 podStartE2EDuration="5.342109947s" totalImagesPullingTime="3.70262641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:04.340609427 +0000 UTC m=+38.635346919" watchObservedRunningTime="2026-07-23 15:01:04.342109947 +0000 UTC m=+38.636847426"
Jul 23 15:01:04.357616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:04.357569    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xr8ck" podStartSLOduration=1.14960953 podStartE2EDuration="4.357551373s" totalImagesPullingTime="3.207941843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:04.357092623 +0000 UTC m=+38.651830103" watchObservedRunningTime="2026-07-23 15:01:04.357551373 +0000 UTC m=+38.652288851"
Jul 23 15:01:05.305924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:05.305888    2523 generic.go:356] "Generic (PLEG): container finished" podID="a8d7a2eb-d25e-4edb-8217-ff970458541e" containerID="9bb4598eaf904773e1a5f1381bd722e17410ebf32c828229a2fab270e78cb2e0" exitCode=0
Jul 23 15:01:05.306409 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:05.306004    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerDied","Data":"9bb4598eaf904773e1a5f1381bd722e17410ebf32c828229a2fab270e78cb2e0"}
Jul 23 15:01:06.312230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:06.312191    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8prkm" event={"ID":"a8d7a2eb-d25e-4edb-8217-ff970458541e","Type":"ContainerStarted","Data":"92354b77f889444df910ba4e1528c399250040359c61d1a35c23d24a3b36033e"}
Jul 23 15:01:06.313662 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:06.313636    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-wl7vd" event={"ID":"687806a2-8c37-41b4-b591-1e7dca7d670a","Type":"ContainerStarted","Data":"a58e13b2b7269201904e92cb84fc903c444f20d50016c53b1f18849655f81268"}
Jul 23 15:01:06.379370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:06.379318    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8prkm" podStartSLOduration=7.932152636 podStartE2EDuration="40.379304285s" totalImagesPullingTime="32.447151649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:06.377885048 +0000 UTC m=+40.672622529" watchObservedRunningTime="2026-07-23 15:01:06.379304285 +0000 UTC m=+40.674041775"
Jul 23 15:01:06.403976 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:06.403925    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-wl7vd" podStartSLOduration=1.518624103 podStartE2EDuration="6.403907762s" totalImagesPullingTime="4.885283659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:06.403245361 +0000 UTC m=+40.697982840" watchObservedRunningTime="2026-07-23 15:01:06.403907762 +0000 UTC m=+40.698645240"
Jul 23 15:01:07.443779 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:07.443738    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:07.443839    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:07.443888    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:07.443925    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:07.443960    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls podName:74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65 nodeName:}" failed. No retries permitted until 2026-07-23 15:01:15.443940556 +0000 UTC m=+49.738678026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls") pod "dns-default-l97lp" (UID: "74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65") : secret "dns-default-metrics-tls" not found
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:07.444022    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:07.444201 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:01:07.444075    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls podName:597dd3de-d57f-4e38-b6df-e5abc9dddc2a nodeName:}" failed. No retries permitted until 2026-07-23 15:01:15.444060337 +0000 UTC m=+49.738797806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c9vpk" (UID: "597dd3de-d57f-4e38-b6df-e5abc9dddc2a") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:01:07.444565 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:07.444510    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:15.499676 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.499631    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:15.500240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.499694    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:15.502813 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.502780    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65-metrics-tls\") pod \"dns-default-l97lp\" (UID: \"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65\") " pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:15.502813 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.502803    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597dd3de-d57f-4e38-b6df-e5abc9dddc2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c9vpk\" (UID: \"597dd3de-d57f-4e38-b6df-e5abc9dddc2a\") " pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:15.590993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.590961    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:15.599535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.599503    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c9vpk"
Jul 23 15:01:15.772910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.772881    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l97lp"]
Jul 23 15:01:15.776935 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:15.776909    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a3dde8_a6bf_452f_a7c7_a77d0c2e9c65.slice/crio-0ec626d8bde339c9c099ba7bee6f486049d686d3d4dbac443987b2577aa78c7c WatchSource:0}: Error finding container 0ec626d8bde339c9c099ba7bee6f486049d686d3d4dbac443987b2577aa78c7c: Status 404 returned error can't find the container with id 0ec626d8bde339c9c099ba7bee6f486049d686d3d4dbac443987b2577aa78c7c
Jul 23 15:01:15.792697 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:15.792676    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c9vpk"]
Jul 23 15:01:15.794847 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:15.794825    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597dd3de_d57f_4e38_b6df_e5abc9dddc2a.slice/crio-fe706aea0d66c93f5cae77c881b02eb85352133a0c211ec62fd401495815f552 WatchSource:0}: Error finding container fe706aea0d66c93f5cae77c881b02eb85352133a0c211ec62fd401495815f552: Status 404 returned error can't find the container with id fe706aea0d66c93f5cae77c881b02eb85352133a0c211ec62fd401495815f552
Jul 23 15:01:16.338599 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:16.338560    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9vpk" event={"ID":"597dd3de-d57f-4e38-b6df-e5abc9dddc2a","Type":"ContainerStarted","Data":"fe706aea0d66c93f5cae77c881b02eb85352133a0c211ec62fd401495815f552"}
Jul 23 15:01:16.339576 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:16.339550    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l97lp" event={"ID":"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65","Type":"ContainerStarted","Data":"0ec626d8bde339c9c099ba7bee6f486049d686d3d4dbac443987b2577aa78c7c"}
Jul 23 15:01:19.354834 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.354793    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l97lp" event={"ID":"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65","Type":"ContainerStarted","Data":"3920f300e7a47386ca875679a564d44b3a25491999df3a7253dada5325ce7c8a"}
Jul 23 15:01:19.355266 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.354887    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l97lp" event={"ID":"74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65","Type":"ContainerStarted","Data":"ff42eade785c5098e8032d2a88f89fc1ae3c8f626e6520e384a19510bd5150f4"}
Jul 23 15:01:19.355266 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.354952    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:19.374672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.374624    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l97lp" podStartSLOduration=17.660595238 podStartE2EDuration="20.374610061s" totalImagesPullingTime="2.714014823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:19.37372159 +0000 UTC m=+53.668459068" watchObservedRunningTime="2026-07-23 15:01:19.374610061 +0000 UTC m=+53.669347538"
Jul 23 15:01:19.774708 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.774673    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"]
Jul 23 15:01:19.776633 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.776610    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.780376 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.780350    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"]
Jul 23 15:01:19.782430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.782408    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.786890 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.786871    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 15:01:19.787439 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.787416    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 15:01:19.787745 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.787724    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 15:01:19.787823 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.787776    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 15:01:19.787878 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.787841    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 15:01:19.790378 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.790344    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qwz2r\""
Jul 23 15:01:19.790516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.790437    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 15:01:19.791349 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.791332    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 15:01:19.795990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.795973    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"]
Jul 23 15:01:19.800199 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.800178    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 15:01:19.816889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.816859    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"]
Jul 23 15:01:19.833680 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833646    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.833806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833683    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6065ee9f-120d-4dd9-9dad-9045e1b6f047-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.833806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833709    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.833806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833740    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.833806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833764    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wk8h\" (UniqueName: \"kubernetes.io/projected/6065ee9f-120d-4dd9-9dad-9045e1b6f047-kube-api-access-6wk8h\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.833806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833786    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mhtt\" (UniqueName: \"kubernetes.io/projected/954a0c23-7b40-459e-b25c-3ef4963b1bb1-kube-api-access-6mhtt\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.834025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833833    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.834025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.833915    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/954a0c23-7b40-459e-b25c-3ef4963b1bb1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.935155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935105    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935169    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/954a0c23-7b40-459e-b25c-3ef4963b1bb1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.935329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935236    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935257    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6065ee9f-120d-4dd9-9dad-9045e1b6f047-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935281    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935481    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935546    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wk8h\" (UniqueName: \"kubernetes.io/projected/6065ee9f-120d-4dd9-9dad-9045e1b6f047-kube-api-access-6wk8h\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.935606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.935577    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mhtt\" (UniqueName: \"kubernetes.io/projected/954a0c23-7b40-459e-b25c-3ef4963b1bb1-kube-api-access-6mhtt\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.936079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.936051    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6065ee9f-120d-4dd9-9dad-9045e1b6f047-additional-service-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.938386 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.938353    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-ca\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.938541 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.938482    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/954a0c23-7b40-459e-b25c-3ef4963b1bb1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:19.938541 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.938521    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.938896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.938874    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.939197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.939175    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6065ee9f-120d-4dd9-9dad-9045e1b6f047-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.962241 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.962215    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wk8h\" (UniqueName: \"kubernetes.io/projected/6065ee9f-120d-4dd9-9dad-9045e1b6f047-kube-api-access-6wk8h\") pod \"cluster-proxy-proxy-agent-844f998589-tmk62\" (UID: \"6065ee9f-120d-4dd9-9dad-9045e1b6f047\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:19.973946 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:19.973842    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mhtt\" (UniqueName: \"kubernetes.io/projected/954a0c23-7b40-459e-b25c-3ef4963b1bb1-kube-api-access-6mhtt\") pod \"managed-serviceaccount-addon-agent-759cc9568b-7lwjj\" (UID: \"954a0c23-7b40-459e-b25c-3ef4963b1bb1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:20.095928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.095837    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"
Jul 23 15:01:20.103481 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.103454    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"
Jul 23 15:01:20.249218 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.249162    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj"]
Jul 23 15:01:20.251990 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:20.251959    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod954a0c23_7b40_459e_b25c_3ef4963b1bb1.slice/crio-cbe6b0944555922b9b79466b3426b77338360118cfdeef32d61a79576ca132d8 WatchSource:0}: Error finding container cbe6b0944555922b9b79466b3426b77338360118cfdeef32d61a79576ca132d8: Status 404 returned error can't find the container with id cbe6b0944555922b9b79466b3426b77338360118cfdeef32d61a79576ca132d8
Jul 23 15:01:20.276011 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.275987    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62"]
Jul 23 15:01:20.281119 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:20.281086    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6065ee9f_120d_4dd9_9dad_9045e1b6f047.slice/crio-b5acd08f95f62ea1330de7758849d9c257acac6b08f30a965f373ecf800c0f82 WatchSource:0}: Error finding container b5acd08f95f62ea1330de7758849d9c257acac6b08f30a965f373ecf800c0f82: Status 404 returned error can't find the container with id b5acd08f95f62ea1330de7758849d9c257acac6b08f30a965f373ecf800c0f82
Jul 23 15:01:20.360471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.360390    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62" event={"ID":"6065ee9f-120d-4dd9-9dad-9045e1b6f047","Type":"ContainerStarted","Data":"b5acd08f95f62ea1330de7758849d9c257acac6b08f30a965f373ecf800c0f82"}
Jul 23 15:01:20.361711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:20.361665    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj" event={"ID":"954a0c23-7b40-459e-b25c-3ef4963b1bb1","Type":"ContainerStarted","Data":"cbe6b0944555922b9b79466b3426b77338360118cfdeef32d61a79576ca132d8"}
Jul 23 15:01:23.377086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:23.376946    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9vpk" event={"ID":"597dd3de-d57f-4e38-b6df-e5abc9dddc2a","Type":"ContainerStarted","Data":"92ef40cbcd170cebf2d97407666f0be9a28f204f633cc867a1a03ab22d408e8e"}
Jul 23 15:01:26.274363 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:26.274321    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gh4q9"
Jul 23 15:01:29.364577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.364540    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l97lp"
Jul 23 15:01:29.402352 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.402292    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62" event={"ID":"6065ee9f-120d-4dd9-9dad-9045e1b6f047","Type":"ContainerStarted","Data":"4b26a31539daffa9d9ad8ba0fad25b39a28f14308fdeeee42d8ba91e06db0eee"}
Jul 23 15:01:29.402352 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.402341    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62" event={"ID":"6065ee9f-120d-4dd9-9dad-9045e1b6f047","Type":"ContainerStarted","Data":"5e2ceda172116b91f4dce8dd51aaa524fb46879b9deae9243ec309301c8be87f"}
Jul 23 15:01:29.402352 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.402360    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62" event={"ID":"6065ee9f-120d-4dd9-9dad-9045e1b6f047","Type":"ContainerStarted","Data":"27fd96278f2e295534dc36b30c55f18ef16eb0676a28df3f904683a44d457f4b"}
Jul 23 15:01:29.404793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.404760    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj" event={"ID":"954a0c23-7b40-459e-b25c-3ef4963b1bb1","Type":"ContainerStarted","Data":"bbdb71021546cd23acb896c66750a08231beff7d1f95016d13dce9e7bfe2d642"}
Jul 23 15:01:29.407460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.407431    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9vpk" event={"ID":"597dd3de-d57f-4e38-b6df-e5abc9dddc2a","Type":"ContainerStarted","Data":"5787f8038519315f86339208e2bd9552b8568f773ce42faaeeff83b9e4a7fabc"}
Jul 23 15:01:29.428411 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:29.428357    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-844f998589-tmk62" podStartSLOduration=2.147600002 podStartE2EDuration="10.428339284s" totalImagesPullingTime="8.280739282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:29.427315619 +0000 UTC m=+63.722053102" watchObservedRunningTime="2026-07-23 15:01:29.428339284 +0000 UTC m=+63.723076764"
Jul 23 15:01:31.937420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.937376    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:01:31.937845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.937441    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:01:31.940168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.940137    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:01:31.940795 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.940771    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:01:31.949961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.949934    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14ed8da3-d298-4724-ab4e-0ec0913769ed-metrics-certs\") pod \"network-metrics-daemon-vsppp\" (UID: \"14ed8da3-d298-4724-ab4e-0ec0913769ed\") " pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:01:31.950053 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.950005    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec40c980-8f31-4ffd-890d-bdfcd871c998-original-pull-secret\") pod \"global-pull-secret-syncer-fqs4c\" (UID: \"ec40c980-8f31-4ffd-890d-bdfcd871c998\") " pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:01:31.950874 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:31.950858    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fqs4c"
Jul 23 15:01:32.038551 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.038520    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:01:32.043619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.043555    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:01:32.052385 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.052360    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:01:32.062567 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.062462    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bzkw\" (UniqueName: \"kubernetes.io/projected/eb525ff0-c596-4095-8c99-51bb0671c9cf-kube-api-access-9bzkw\") pod \"network-check-target-fqlgc\" (UID: \"eb525ff0-c596-4095-8c99-51bb0671c9cf\") " pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:01:32.116788 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.116741    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-759cc9568b-7lwjj" podStartSLOduration=4.807045788 podStartE2EDuration="13.116725116s" totalImagesPullingTime="8.309679328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:29.4453346 +0000 UTC m=+63.740072080" watchObservedRunningTime="2026-07-23 15:01:32.116725116 +0000 UTC m=+66.411462594"
Jul 23 15:01:32.117001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.116989    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fqs4c"]
Jul 23 15:01:32.120146 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:32.120123    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec40c980_8f31_4ffd_890d_bdfcd871c998.slice/crio-7d518b3adf26924e3820a2ac6fab37569c80e822f6592e8cf3154a7e733be6db WatchSource:0}: Error finding container 7d518b3adf26924e3820a2ac6fab37569c80e822f6592e8cf3154a7e733be6db: Status 404 returned error can't find the container with id 7d518b3adf26924e3820a2ac6fab37569c80e822f6592e8cf3154a7e733be6db
Jul 23 15:01:32.241464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.241383    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbp9q\""
Jul 23 15:01:32.248085 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.248063    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vsppp"
Jul 23 15:01:32.248410 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.248393    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v5f82\""
Jul 23 15:01:32.256205 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.256182    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:01:32.388002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.387973    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vsppp"]
Jul 23 15:01:32.392234 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:32.392204    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ed8da3_d298_4724_ab4e_0ec0913769ed.slice/crio-5ee2b226aa31488634580798667f48e5475b2893650f31caefcaaed4e4c1d74f WatchSource:0}: Error finding container 5ee2b226aa31488634580798667f48e5475b2893650f31caefcaaed4e4c1d74f: Status 404 returned error can't find the container with id 5ee2b226aa31488634580798667f48e5475b2893650f31caefcaaed4e4c1d74f
Jul 23 15:01:32.415879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.415853    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqlgc"]
Jul 23 15:01:32.417826 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.417798    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqs4c" event={"ID":"ec40c980-8f31-4ffd-890d-bdfcd871c998","Type":"ContainerStarted","Data":"7d518b3adf26924e3820a2ac6fab37569c80e822f6592e8cf3154a7e733be6db"}
Jul 23 15:01:32.418977 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.418953    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vsppp" event={"ID":"14ed8da3-d298-4724-ab4e-0ec0913769ed","Type":"ContainerStarted","Data":"5ee2b226aa31488634580798667f48e5475b2893650f31caefcaaed4e4c1d74f"}
Jul 23 15:01:32.419385 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:32.419360    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb525ff0_c596_4095_8c99_51bb0671c9cf.slice/crio-c569a7b16d6f6375607ea09dd83295e84505f552b7d261f57a66c0a5de26a255 WatchSource:0}: Error finding container c569a7b16d6f6375607ea09dd83295e84505f552b7d261f57a66c0a5de26a255: Status 404 returned error can't find the container with id c569a7b16d6f6375607ea09dd83295e84505f552b7d261f57a66c0a5de26a255
Jul 23 15:01:32.421114 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.421092    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c9vpk" event={"ID":"597dd3de-d57f-4e38-b6df-e5abc9dddc2a","Type":"ContainerStarted","Data":"7a484ce14ba734bd1ef5d646623e670c51924184b55136f9c289594e1fe7bb6e"}
Jul 23 15:01:32.461627 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:32.461571    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c9vpk" podStartSLOduration=17.377937615 podStartE2EDuration="33.461555431s" totalImagesPullingTime="16.083617816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:32.461129458 +0000 UTC m=+66.755866935" watchObservedRunningTime="2026-07-23 15:01:32.461555431 +0000 UTC m=+66.756292887"
Jul 23 15:01:33.433923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:33.433885    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqlgc" event={"ID":"eb525ff0-c596-4095-8c99-51bb0671c9cf","Type":"ContainerStarted","Data":"c569a7b16d6f6375607ea09dd83295e84505f552b7d261f57a66c0a5de26a255"}
Jul 23 15:01:34.439905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:34.439868    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vsppp" event={"ID":"14ed8da3-d298-4724-ab4e-0ec0913769ed","Type":"ContainerStarted","Data":"99d9b7b1d39760022a3d0bd6f9f87620f9fd69fdf30e0e1bb854fdc83e90fb78"}
Jul 23 15:01:34.440368 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:34.439930    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vsppp" event={"ID":"14ed8da3-d298-4724-ab4e-0ec0913769ed","Type":"ContainerStarted","Data":"3e8c608614fc31355b60dbcebe934befef96787459aebc47cf69d378577152f4"}
Jul 23 15:01:34.459321 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:34.459256    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vsppp" podStartSLOduration=67.447644095 podStartE2EDuration="1m8.459233132s" totalImagesPullingTime="1.011589037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:34.457934738 +0000 UTC m=+68.752672216" watchObservedRunningTime="2026-07-23 15:01:34.459233132 +0000 UTC m=+68.753970611"
Jul 23 15:01:37.455429 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:37.455390    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fqs4c" event={"ID":"ec40c980-8f31-4ffd-890d-bdfcd871c998","Type":"ContainerStarted","Data":"c6b2127ec1c63dec783f3fe0ed9db92cdcb721fbe27c463bc317bdb75224a80c"}
Jul 23 15:01:37.456851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:37.456822    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqlgc" event={"ID":"eb525ff0-c596-4095-8c99-51bb0671c9cf","Type":"ContainerStarted","Data":"ae4d24e5dd1d11dcad5c90aaa255185d6177d14e88a3ebbfded632b1025eb6c1"}
Jul 23 15:01:37.456973 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:37.456934    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:01:37.477513 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:37.477442    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fqs4c" podStartSLOduration=66.340143138 podStartE2EDuration="1m11.477425558s" totalImagesPullingTime="5.13728242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:37.477407399 +0000 UTC m=+71.772144902" watchObservedRunningTime="2026-07-23 15:01:37.477425558 +0000 UTC m=+71.772163038"
Jul 23 15:01:37.497825 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:37.497730    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqlgc" podStartSLOduration=66.670542813 podStartE2EDuration="1m11.497716723s" totalImagesPullingTime="4.82717391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:37.496570817 +0000 UTC m=+71.791308297" watchObservedRunningTime="2026-07-23 15:01:37.497716723 +0000 UTC m=+71.792454202"
Jul 23 15:01:53.475908 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.475774    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95jbc"]
Jul 23 15:01:53.632031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.632001    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.635648 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.635607    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 15:01:53.635859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.635843    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 15:01:53.636033 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.636015    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 15:01:53.636556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.636534    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 15:01:53.636556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.636550    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 15:01:53.636929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.636898    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wskx6\""
Jul 23 15:01:53.636929 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.636925    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 15:01:53.783211 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783182    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-node-exporter-wtmp\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783229    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vb5t\" (UniqueName: \"kubernetes.io/projected/118778e3-23a6-424d-b179-36e526175992-kube-api-access-8vb5t\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783264    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783315    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/118778e3-23a6-424d-b179-36e526175992-node-exporter-textfile\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783343    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-node-exporter-accelerators-collector-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783381    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-sys\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783665 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783402    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-root\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783665 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783433    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-metrics-client-ca\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.783665 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.783457    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-tls\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884282 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884249    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-metrics-client-ca\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884282 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884278    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-tls\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884302    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-node-exporter-wtmp\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884322    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vb5t\" (UniqueName: \"kubernetes.io/projected/118778e3-23a6-424d-b179-36e526175992-kube-api-access-8vb5t\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884346    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884375    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/118778e3-23a6-424d-b179-36e526175992-node-exporter-textfile\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884399    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-node-exporter-accelerators-collector-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884444    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-sys\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884457    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-node-exporter-wtmp\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884510 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884467    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-root\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884539    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-root\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884754    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/118778e3-23a6-424d-b179-36e526175992-sys\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.884906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884850    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/118778e3-23a6-424d-b179-36e526175992-node-exporter-textfile\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.885051 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.884999    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-metrics-client-ca\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.885051 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.885009    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/118778e3-23a6-424d-b179-36e526175992-node-exporter-accelerators-collector-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.886656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.886630    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.886761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.886734    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/118778e3-23a6-424d-b179-36e526175992-node-exporter-tls\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.892749 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.892725    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vb5t\" (UniqueName: \"kubernetes.io/projected/118778e3-23a6-424d-b179-36e526175992-kube-api-access-8vb5t\") pod \"node-exporter-95jbc\" (UID: \"118778e3-23a6-424d-b179-36e526175992\") " pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.941662 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:53.941634    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95jbc"
Jul 23 15:01:53.985864 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:01:53.985836    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118778e3_23a6_424d_b179_36e526175992.slice/crio-e514a1a7c3a6f819e2f3d7d48ab69a30e761820bbacf49df09b36f78a6a5c7ca WatchSource:0}: Error finding container e514a1a7c3a6f819e2f3d7d48ab69a30e761820bbacf49df09b36f78a6a5c7ca: Status 404 returned error can't find the container with id e514a1a7c3a6f819e2f3d7d48ab69a30e761820bbacf49df09b36f78a6a5c7ca
Jul 23 15:01:54.514357 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:54.514329    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95jbc" event={"ID":"118778e3-23a6-424d-b179-36e526175992","Type":"ContainerStarted","Data":"e514a1a7c3a6f819e2f3d7d48ab69a30e761820bbacf49df09b36f78a6a5c7ca"}
Jul 23 15:01:55.519066 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:55.518978    2523 generic.go:356] "Generic (PLEG): container finished" podID="118778e3-23a6-424d-b179-36e526175992" containerID="6688c1d8813c0750662ed5c3103640c2c623fa7a256fdd26f270f1f92dfc2585" exitCode=0
Jul 23 15:01:55.519555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:55.519064    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95jbc" event={"ID":"118778e3-23a6-424d-b179-36e526175992","Type":"ContainerDied","Data":"6688c1d8813c0750662ed5c3103640c2c623fa7a256fdd26f270f1f92dfc2585"}
Jul 23 15:01:56.524532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:56.524475    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95jbc" event={"ID":"118778e3-23a6-424d-b179-36e526175992","Type":"ContainerStarted","Data":"a9444c96a31c6c121efa4da9665a35f200fac919eb799ec8021be6c1b87524e5"}
Jul 23 15:01:56.524971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:56.524584    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95jbc" event={"ID":"118778e3-23a6-424d-b179-36e526175992","Type":"ContainerStarted","Data":"c9590d00359ab0a1601dec5dd40b945c7fbe10b3b31bee12513c273ba8ed6e86"}
Jul 23 15:01:56.549810 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:56.549756    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95jbc" podStartSLOduration=2.299856039 podStartE2EDuration="3.549741774s" totalImagesPullingTime="1.187951185s" totalInitContainerRuntime="61.93455ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:01:56.548062002 +0000 UTC m=+90.842799481" watchObservedRunningTime="2026-07-23 15:01:56.549741774 +0000 UTC m=+90.844479252"
Jul 23 15:01:59.754540 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.754507    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:01:59.758181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.758164    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.760960 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.760933    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 15:01:59.761094 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761059    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 15:01:59.761161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761095    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fdi06529oent3\""
Jul 23 15:01:59.761161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761074    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 15:01:59.761260 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761157    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 15:01:59.761260 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761183    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 15:01:59.761361 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761302    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t6jzt\""
Jul 23 15:01:59.761778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.761763    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 15:01:59.762084 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762069    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 15:01:59.762084 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762078    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 15:01:59.762194 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762126    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 15:01:59.762194 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762080    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 15:01:59.762370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762350    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 15:01:59.762665 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.762643    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 15:01:59.765051 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.765032    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 15:01:59.768798 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.768736    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 15:01:59.771249 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.771229    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 15:01:59.777610 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.777590    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:01:59.926166 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926126    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926166 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926169    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926186    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926209    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926262    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926281    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926309    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926326    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926340    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926362    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926440    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926510    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926534    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926555    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926571    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzfpn\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926603    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926626    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926653    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926682    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:01:59.926926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:01:59.926703    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027720 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027686    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027867 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027724    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027867 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027744    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027944 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027922    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027954    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzfpn\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.027990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.027974    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028080 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028002    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028080 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028043    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028080 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028073    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028104    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028132    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028154    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028174    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028205    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028230    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028253    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028284    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028305    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028326    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028357    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.028855 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.028689    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.029279 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.029248    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.029806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.029438    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.029806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.029674    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.031143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.031121    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.031931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.031756    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.032029 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.031926    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.032750 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.032721    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.032879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.032855    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033034    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033137 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033061    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033137 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033081    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033312 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033291    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033343    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033545 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033456    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.033661 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.033604    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.034599 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.034578    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.035108 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.035080    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.035239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.035217    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.036328 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.036312    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzfpn\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn\") pod \"prometheus-k8s-0\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.071890 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.071862    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:02:00.216914 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.216880    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:02:00.219783 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:02:00.219755    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf611e2c1_2baf_4bf7_89bb_171a952d65de.slice/crio-2638235d4ab4f3d5deaa70ededd79ac9750f657c3582dff6ce1a5cc180e6719f WatchSource:0}: Error finding container 2638235d4ab4f3d5deaa70ededd79ac9750f657c3582dff6ce1a5cc180e6719f: Status 404 returned error can't find the container with id 2638235d4ab4f3d5deaa70ededd79ac9750f657c3582dff6ce1a5cc180e6719f
Jul 23 15:02:00.539660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:00.539631    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"2638235d4ab4f3d5deaa70ededd79ac9750f657c3582dff6ce1a5cc180e6719f"}
Jul 23 15:02:02.548597 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:02.548563    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64" exitCode=0
Jul 23 15:02:02.548955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:02.548603    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"}
Jul 23 15:02:06.567068 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:06.567038    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"}
Jul 23 15:02:06.567418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:06.567102    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"}
Jul 23 15:02:08.463287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:08.463258    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqlgc"
Jul 23 15:02:09.581039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:09.581004    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"}
Jul 23 15:02:09.581402 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:09.581097    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"}
Jul 23 15:02:09.581402 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:09.581123    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"}
Jul 23 15:02:09.581402 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:09.581147    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerStarted","Data":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"}
Jul 23 15:02:09.618137 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:09.618093    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.135035041 podStartE2EDuration="10.618078302s" totalImagesPullingTime="7.458115351s" totalInitContainerRuntime="24.92791ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:01:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:02:09.616102269 +0000 UTC m=+103.910839747" watchObservedRunningTime="2026-07-23 15:02:09.618078302 +0000 UTC m=+103.912815779"
Jul 23 15:02:10.072821 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:02:10.072788    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:00.072047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:00.071997    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:00.090046 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:00.090022    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:00.768083 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:00.768057    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.321802 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.321765    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322057    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="prometheus" containerID="cri-o://b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2" gracePeriod=600
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322088    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="thanos-sidecar" containerID="cri-o://d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea" gracePeriod=600
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322076    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy" containerID="cri-o://e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0" gracePeriod=600
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322099    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="config-reloader" containerID="cri-o://4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37" gracePeriod=600
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322149    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-web" containerID="cri-o://b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b" gracePeriod=600
Jul 23 15:03:18.322212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.322183    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-thanos" containerID="cri-o://87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025" gracePeriod=600
Jul 23 15:03:18.563743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.563719    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.623609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623539    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623579    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623608    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623635    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623665    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623702    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623729    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623756    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623788    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzfpn\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623816    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.623847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623841    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623879    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623910    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623942    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.623971    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624001    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624028    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624069    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624095    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624230 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624125    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs\") pod \"f611e2c1-2baf-4bf7-89bb-171a952d65de\" (UID: \"f611e2c1-2baf-4bf7-89bb-171a952d65de\") "
Jul 23 15:03:18.624702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624481    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.624702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624507    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.624702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624613    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.624863 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624799    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.625172 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.624988    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:03:18.626032 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.625308    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.626382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.626355    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.627222 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.627192    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.627339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.627275    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.627407 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.627342    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.627759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.627734    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:03:18.628274 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.628247    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.628705 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.628682    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn" (OuterVolumeSpecName: "kube-api-access-rzfpn") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "kube-api-access-rzfpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:03:18.628852 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.628827    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config" (OuterVolumeSpecName: "config") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.629003 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.628968    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.629106 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.629083    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out" (OuterVolumeSpecName: "config-out") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:03:18.629797 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.629768    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.629949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.629929    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.630015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.629997    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:03:18.637887 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.637865    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config" (OuterVolumeSpecName: "web-config") pod "f611e2c1-2baf-4bf7-89bb-171a952d65de" (UID: "f611e2c1-2baf-4bf7-89bb-171a952d65de"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:03:18.725268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725247    2523 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725265    2523 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725275    2523 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725284    2523 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-tls-assets\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725293    2523 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-metrics-client-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725301    2523 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-grpc-tls\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725310    2523 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-db\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725318    2523 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725327    2523 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-metrics-client-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725335    2523 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725345    2523 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-web-config\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725353    2523 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725361    2523 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f611e2c1-2baf-4bf7-89bb-171a952d65de-config-out\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725371    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzfpn\" (UniqueName: \"kubernetes.io/projected/f611e2c1-2baf-4bf7-89bb-171a952d65de-kube-api-access-rzfpn\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725378    2523 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725387    2523 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725396    2523 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-secret-kube-rbac-proxy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725405    2523 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725413    2523 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f611e2c1-2baf-4bf7-89bb-171a952d65de-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.725799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.725421    2523 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f611e2c1-2baf-4bf7-89bb-171a952d65de-config\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:03:18.818924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818888    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025" exitCode=0
Jul 23 15:03:18.818924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818920    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0" exitCode=0
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818930    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b" exitCode=0
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818939    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea" exitCode=0
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818946    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37" exitCode=0
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818954    2523 generic.go:356] "Generic (PLEG): container finished" podID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2" exitCode=0
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818968    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"}
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.818980    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.819055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819036    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"}
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819065    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"}
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819091    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"}
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819107    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819115    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"}
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819139    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"}
Jul 23 15:03:18.819290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.819162    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f611e2c1-2baf-4bf7-89bb-171a952d65de","Type":"ContainerDied","Data":"2638235d4ab4f3d5deaa70ededd79ac9750f657c3582dff6ce1a5cc180e6719f"}
Jul 23 15:03:18.827657 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.827634    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.835107 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.835089    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.841204 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.841183    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.847534 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.847515    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.849356 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.849333    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:18.854395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.854377    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.854516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.854481    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:18.860841 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.860824    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.866708 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.866692    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.866955 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.866936    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.866995 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.866965    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.867044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.866996    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.867220 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.867202    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.867272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867233    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.867272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867249    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.867499 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.867470    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.867573 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867507    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.867573 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867527    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.867742 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.867725    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.867783 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867747    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.867783 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867761    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.867984 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.867971    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.868015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867987    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.868015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.867998    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.868179 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.868162    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.868212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868183    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.868212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868195    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.868368 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:03:18.868354    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.868404 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868371    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.868404 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868382    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.868616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868598    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.868672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868617    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.868784 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868768    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.868828 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868784    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.868997 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868981    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.869037 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.868997    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.869217 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869199    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.869260 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869218    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.869450 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869434    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.869450 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869450    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.869667 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869651    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.869713 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869668    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.869876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869860    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.869921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.869876    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.870072 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870055    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.870112 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870073    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.870255 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870240    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.870296 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870255    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.870440 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870425    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.870440 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870438    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.870677 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870659    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.870729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870678    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.870910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870892    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.870974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.870913    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.871096 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871076    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.871140 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871099    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.871313 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871292    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.871313 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871311    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.871515 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871474    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.871569 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871517    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.871744 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871726    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.871787 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871745    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.871963 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871945    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.871963 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.871960    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.872176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872157    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.872176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872176    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.872407 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872389    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.872447 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872409    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.872633 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872615    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.872680 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872633    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.872842 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872826    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.872886 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.872842    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.873047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873029    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.873047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873046    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.873260 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873241    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.873297 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873261    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.873444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873429    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.873502 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873444    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.873677 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873640    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.873677 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873657    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.873885 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873868    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.873940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.873886    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.874075 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874056    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.874115 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874076    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.874252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874238    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.874288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874252    2523 scope.go:117] "RemoveContainer" containerID="87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"
Jul 23 15:03:18.874463 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874446    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025"} err="failed to get container status \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": rpc error: code = NotFound desc = could not find container \"87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025\": container with ID starting with 87be78c623ed72c05f203c553d05e20b19adf61409b19a7356f52f53fa6c6025 not found: ID does not exist"
Jul 23 15:03:18.874546 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874463    2523 scope.go:117] "RemoveContainer" containerID="e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"
Jul 23 15:03:18.874691 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874671    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0"} err="failed to get container status \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": rpc error: code = NotFound desc = could not find container \"e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0\": container with ID starting with e4c7aac3544a555a878cda56218b1820a57d7d5d0ada3f7e329ae53e1866e9f0 not found: ID does not exist"
Jul 23 15:03:18.874737 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874691    2523 scope.go:117] "RemoveContainer" containerID="b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"
Jul 23 15:03:18.874895 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874873    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b"} err="failed to get container status \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": rpc error: code = NotFound desc = could not find container \"b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b\": container with ID starting with b6cc42330b5b0caec12b87b3d69a14c2c044cebc2196ca31693327eb47408f3b not found: ID does not exist"
Jul 23 15:03:18.874937 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.874896    2523 scope.go:117] "RemoveContainer" containerID="d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"
Jul 23 15:03:18.875085 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875068    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea"} err="failed to get container status \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": rpc error: code = NotFound desc = could not find container \"d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea\": container with ID starting with d2e6a29cf6ecfcc2b862b4b41058de81d9e1c63bf097aeaf9593bb792fdb52ea not found: ID does not exist"
Jul 23 15:03:18.875128 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875085    2523 scope.go:117] "RemoveContainer" containerID="4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"
Jul 23 15:03:18.875290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875271    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37"} err="failed to get container status \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": rpc error: code = NotFound desc = could not find container \"4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37\": container with ID starting with 4f89ad4fdb02465883d6b2ccbb65a1bb8b6584b06eb334aa92739bb610584c37 not found: ID does not exist"
Jul 23 15:03:18.875327 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875293    2523 scope.go:117] "RemoveContainer" containerID="b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"
Jul 23 15:03:18.875507 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875471    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2"} err="failed to get container status \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": rpc error: code = NotFound desc = could not find container \"b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2\": container with ID starting with b7efaaa9958d826143f35f1f397136190b16939663396dd5fbc00d46f5f505a2 not found: ID does not exist"
Jul 23 15:03:18.875507 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875502    2523 scope.go:117] "RemoveContainer" containerID="6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"
Jul 23 15:03:18.875723 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.875708    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64"} err="failed to get container status \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": rpc error: code = NotFound desc = could not find container \"6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64\": container with ID starting with 6ec782badc99f726b676a41f665cb856fe21fa6c9c19a41f56041a3167bd7d64 not found: ID does not exist"
Jul 23 15:03:18.889163 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889145    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:18.889381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889370    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-web"
Jul 23 15:03:18.889425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889383    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-web"
Jul 23 15:03:18.889425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889395    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="init-config-reloader"
Jul 23 15:03:18.889425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889403    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="init-config-reloader"
Jul 23 15:03:18.889425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889415    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy"
Jul 23 15:03:18.889425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889423    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889433    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="prometheus"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889438    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="prometheus"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889444    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-thanos"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889449    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-thanos"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889456    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="config-reloader"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889462    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="config-reloader"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889469    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="thanos-sidecar"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889473    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="thanos-sidecar"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889531    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-thanos"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889541    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="config-reloader"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889546    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889551    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="thanos-sidecar"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889556    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="kube-rbac-proxy-web"
Jul 23 15:03:18.889582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.889561    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" containerName="prometheus"
Jul 23 15:03:18.894322 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.894306    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.897263 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897243    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 15:03:18.897358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897258    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 15:03:18.897358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897244    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 15:03:18.897358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897304    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 15:03:18.897700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897681    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 15:03:18.897973 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897953    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 15:03:18.898063 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897974    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t6jzt\""
Jul 23 15:03:18.898063 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.897956    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 15:03:18.898305 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898271    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 15:03:18.898305 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898275    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 15:03:18.898305 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898298    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 15:03:18.898538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898377    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fdi06529oent3\""
Jul 23 15:03:18.898538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898415    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 15:03:18.898538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.898444    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 15:03:18.899060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.899045    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 15:03:18.903738 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.903722    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 15:03:18.906097 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.906080    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 15:03:18.913054 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.913036    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:18.928239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928219    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928335 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928251    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928335 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928277    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928405 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928356    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928445 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928427    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928479 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928457    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928550 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928480    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvh8s\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-kube-api-access-qvh8s\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928560    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928591    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928705 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928621    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928705 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928649    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928703    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928727    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928749    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928778    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928802    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928834    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928858    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928916    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:18.928957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:18.928937    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029568 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029543    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029568 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029570    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029589    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029606    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029622    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029636    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029656    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029682    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.029714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029714    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029736    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029761    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029801    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029831    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029860    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029888    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvh8s\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-kube-api-access-qvh8s\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029919    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029945    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.029973    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030003    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030041    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030228    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030400    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030447    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.030997 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.030969    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.031329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.031241    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.032188 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.032160    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.032331 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.032283    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.032571 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.032547    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.033214 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.033063    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.033544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.033516    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034069 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034039    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034215 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034190    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034293 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034270    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034509    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034671    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034788    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.034969 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.034946    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.035575 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.035554    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.035844 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.035827    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.040289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.040272    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvh8s\" (UniqueName: \"kubernetes.io/projected/a147af4e-83b6-4dc4-b8bd-0fc6528790ef-kube-api-access-qvh8s\") pod \"prometheus-k8s-0\" (UID: \"a147af4e-83b6-4dc4-b8bd-0fc6528790ef\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.203804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.203755    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:03:19.353225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.353201    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 15:03:19.357686 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:03:19.357653    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda147af4e_83b6_4dc4_b8bd_0fc6528790ef.slice/crio-e1003077e6903508366397bd29f053b571fd385b7b50a4a8ad433f1c6b664abd WatchSource:0}: Error finding container e1003077e6903508366397bd29f053b571fd385b7b50a4a8ad433f1c6b664abd: Status 404 returned error can't find the container with id e1003077e6903508366397bd29f053b571fd385b7b50a4a8ad433f1c6b664abd
Jul 23 15:03:19.824886 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.824852    2523 generic.go:356] "Generic (PLEG): container finished" podID="a147af4e-83b6-4dc4-b8bd-0fc6528790ef" containerID="b198b443835583237345725785d15708efe66d7c3ff1f09a4775b464b7258388" exitCode=0
Jul 23 15:03:19.825031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.824889    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerDied","Data":"b198b443835583237345725785d15708efe66d7c3ff1f09a4775b464b7258388"}
Jul 23 15:03:19.825031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:19.824944    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"e1003077e6903508366397bd29f053b571fd385b7b50a4a8ad433f1c6b664abd"}
Jul 23 15:03:20.134372 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.134346    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f611e2c1-2baf-4bf7-89bb-171a952d65de" path="/var/lib/kubelet/pods/f611e2c1-2baf-4bf7-89bb-171a952d65de/volumes"
Jul 23 15:03:20.832430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832394    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"8c93c6d847cbb4666d9184f4416d2715f5fecd7f8e7aba9cab907d60401bb926"}
Jul 23 15:03:20.832781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832462    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"eb2e6ede8e71b2a982f14af76e407c9cb1930682700bd04e9117c5adf0467030"}
Jul 23 15:03:20.832781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832506    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"b6a80d124a110e98fe54aec7280fe7e98cbd4c10609dbd8175059cd45c54491b"}
Jul 23 15:03:20.832781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832531    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"ec24853a246f4ad1c13310675628ccc662ea6f0478c3086922c9d86cd1abebe7"}
Jul 23 15:03:20.832781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832569    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"76338a4fe4cdfa7e1c010376fb98d00bcf04a9029d481937aab8ef7bd14bbc96"}
Jul 23 15:03:20.832781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.832597    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a147af4e-83b6-4dc4-b8bd-0fc6528790ef","Type":"ContainerStarted","Data":"3580aba35807ca217808e682c6ad982b4b07836dd8f8e1d27a4ff20e62cbe811"}
Jul 23 15:03:20.870009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:20.869949    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.852183571 podStartE2EDuration="2.869929083s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.745512ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:03:20.867907062 +0000 UTC m=+175.162644542" watchObservedRunningTime="2026-07-23 15:03:20.869929083 +0000 UTC m=+175.164666562"
Jul 23 15:03:24.204292 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:03:24.204256    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:04:19.204747 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:04:19.204704    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:04:19.219739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:04:19.219716    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:04:20.053589 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:04:20.053562    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 15:05:26.021074 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:05:26.021046    2523 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 15:06:48.319073 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.318997    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"]
Jul 23 15:06:48.322114 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.322096    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.324707 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.324688    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zbq89\""
Jul 23 15:06:48.325030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.325000    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 15:06:48.325030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.325000    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 15:06:48.325169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.325052    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 15:06:48.325612 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.325597    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 15:06:48.337176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.337147    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"]
Jul 23 15:06:48.430778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.430749    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.430905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.430790    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgdv\" (UniqueName: \"kubernetes.io/projected/e0555c21-7c21-48e0-ab44-a0a191de0a5e-kube-api-access-jhgdv\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.430905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.430834    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.430905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.430870    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.431035 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.430901    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531483 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531455    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531509    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgdv\" (UniqueName: \"kubernetes.io/projected/e0555c21-7c21-48e0-ab44-a0a191de0a5e-kube-api-access-jhgdv\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531539    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531562    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531587    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.531965 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.531936    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-manifests\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.533848 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.533821    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0555c21-7c21-48e0-ab44-a0a191de0a5e-tmp\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.534006 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.533988    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.534065 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.534050    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0555c21-7c21-48e0-ab44-a0a191de0a5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.548687 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.548663    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgdv\" (UniqueName: \"kubernetes.io/projected/e0555c21-7c21-48e0-ab44-a0a191de0a5e-kube-api-access-jhgdv\") pod \"opendatahub-operator-controller-manager-75984d86c4-f8fkh\" (UID: \"e0555c21-7c21-48e0-ab44-a0a191de0a5e\") " pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.632692 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.632640    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:48.779444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.779411    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"]
Jul 23 15:06:48.782731 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:06:48.782700    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0555c21_7c21_48e0_ab44_a0a191de0a5e.slice/crio-4c9b4fb3641f8a7cd6decdeb07c19186676a558f422f26c16f3471f63594bf32 WatchSource:0}: Error finding container 4c9b4fb3641f8a7cd6decdeb07c19186676a558f422f26c16f3471f63594bf32: Status 404 returned error can't find the container with id 4c9b4fb3641f8a7cd6decdeb07c19186676a558f422f26c16f3471f63594bf32
Jul 23 15:06:48.784495 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:48.784466    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:06:49.533339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:49.533222    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh" event={"ID":"e0555c21-7c21-48e0-ab44-a0a191de0a5e","Type":"ContainerStarted","Data":"4c9b4fb3641f8a7cd6decdeb07c19186676a558f422f26c16f3471f63594bf32"}
Jul 23 15:06:52.547677 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:52.547636    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh" event={"ID":"e0555c21-7c21-48e0-ab44-a0a191de0a5e","Type":"ContainerStarted","Data":"07869cae1a59a25cdc54eb5c4436ac6321deb385e04feb7799f36543dfa8cf88"}
Jul 23 15:06:53.553771 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:53.553735    2523 generic.go:356] "Generic (PLEG): container finished" podID="e0555c21-7c21-48e0-ab44-a0a191de0a5e" containerID="07869cae1a59a25cdc54eb5c4436ac6321deb385e04feb7799f36543dfa8cf88" exitCode=0
Jul 23 15:06:53.554171 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:53.553826    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh" event={"ID":"e0555c21-7c21-48e0-ab44-a0a191de0a5e","Type":"ContainerDied","Data":"07869cae1a59a25cdc54eb5c4436ac6321deb385e04feb7799f36543dfa8cf88"}
Jul 23 15:06:54.558962 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:54.558930    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh" event={"ID":"e0555c21-7c21-48e0-ab44-a0a191de0a5e","Type":"ContainerStarted","Data":"945a6cda3f73c7c811bbc22d5f82ee5ddc5207cc0705a7ac6ebb0f2a9e6f52b6"}
Jul 23 15:06:54.559368 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:54.559013    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:06:54.588707 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:06:54.588662    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh" podStartSLOduration=2.0770035 podStartE2EDuration="6.588646194s" totalImagesPullingTime="3.434328333s" totalInitContainerRuntime="1.077314361s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:06:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:06:54.586442909 +0000 UTC m=+388.881180397" watchObservedRunningTime="2026-07-23 15:06:54.588646194 +0000 UTC m=+388.883383748"
Jul 23 15:07:05.564896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:05.564860    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75984d86c4-f8fkh"
Jul 23 15:07:18.997794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:18.997760    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"]
Jul 23 15:07:19.000811 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.000794    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.010968 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.010945    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cxd27\""
Jul 23 15:07:19.011084 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.010980    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 15:07:19.012056 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.012038    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 15:07:19.020784 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.020765    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 15:07:19.044368 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.044334    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"]
Jul 23 15:07:19.069845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.069813    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070021 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.069880    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070021 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.069924    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070021 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.069952    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070021 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.069994    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070237 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.070039    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4vc\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-kube-api-access-8g4vc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070237 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.070081    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070237 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.070105    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45ba99cc-1307-45a7-ae73-acf0af9633a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.070237 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.070172    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171302    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171335    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171358    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171376    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171403    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171442    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4vc\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-kube-api-access-8g4vc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171470    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171511    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45ba99cc-1307-45a7-ae73-acf0af9633a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171553    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171799    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.171971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.171847    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.172124 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.172098    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.172181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.172172    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.172381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.172360    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45ba99cc-1307-45a7-ae73-acf0af9633a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.173856 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.173833    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.173966 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.173924    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.188651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.188626    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4vc\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-kube-api-access-8g4vc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.191235 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.191213    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45ba99cc-1307-45a7-ae73-acf0af9633a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4p8r82\" (UID: \"45ba99cc-1307-45a7-ae73-acf0af9633a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.310974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.310933    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:19.468752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.468596    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"]
Jul 23 15:07:19.470958 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:07:19.470929    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ba99cc_1307_45a7_ae73_acf0af9633a8.slice/crio-abf440fc6c9630e01c813c70458bd91cca0d7556da16bd55a2949abd1f24ce1c WatchSource:0}: Error finding container abf440fc6c9630e01c813c70458bd91cca0d7556da16bd55a2949abd1f24ce1c: Status 404 returned error can't find the container with id abf440fc6c9630e01c813c70458bd91cca0d7556da16bd55a2949abd1f24ce1c
Jul 23 15:07:19.651812 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:19.651725    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82" event={"ID":"45ba99cc-1307-45a7-ae73-acf0af9633a8","Type":"ContainerStarted","Data":"abf440fc6c9630e01c813c70458bd91cca0d7556da16bd55a2949abd1f24ce1c"}
Jul 23 15:07:20.362691 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.362652    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"]
Jul 23 15:07:20.366079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.366051    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.369561 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.369540    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 15:07:20.369805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.369782    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 15:07:20.370187 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.370166    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 15:07:20.370299 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.370212    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tpsqj\""
Jul 23 15:07:20.370299 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.370261    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:07:20.370416 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.370303    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 15:07:20.378640 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.378618    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"]
Jul 23 15:07:20.382741 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.382651    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.382741 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.382701    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-manager-config\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.382921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.382784    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlk75\" (UniqueName: \"kubernetes.io/projected/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-kube-api-access-rlk75\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.382921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.382818    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-metrics-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.483620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.483577    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.483804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.483641    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-manager-config\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.483804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.483681    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlk75\" (UniqueName: \"kubernetes.io/projected/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-kube-api-access-rlk75\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.483804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.483719    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-metrics-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.484438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.484412    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-manager-config\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.486642 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.486616    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-metrics-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.486778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.486758    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-cert\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.507029 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.506995    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlk75\" (UniqueName: \"kubernetes.io/projected/5945ab33-efad-4fc3-a2a5-ea76ea4e240a-kube-api-access-rlk75\") pod \"lws-controller-manager-68b858458d-mzz2f\" (UID: \"5945ab33-efad-4fc3-a2a5-ea76ea4e240a\") " pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.677016 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.676933    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:20.827790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:20.827549    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"]
Jul 23 15:07:20.832389 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:07:20.832364    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5945ab33_efad_4fc3_a2a5_ea76ea4e240a.slice/crio-310e294ed6d0f1fd7b5c8ac3dd26da415685225b339a47687b2524cf8dae76fc WatchSource:0}: Error finding container 310e294ed6d0f1fd7b5c8ac3dd26da415685225b339a47687b2524cf8dae76fc: Status 404 returned error can't find the container with id 310e294ed6d0f1fd7b5c8ac3dd26da415685225b339a47687b2524cf8dae76fc
Jul 23 15:07:21.661374 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:21.661342    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f" event={"ID":"5945ab33-efad-4fc3-a2a5-ea76ea4e240a","Type":"ContainerStarted","Data":"310e294ed6d0f1fd7b5c8ac3dd26da415685225b339a47687b2524cf8dae76fc"}
Jul 23 15:07:22.890884 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:22.890836    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:07:22.891252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:22.890934    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:07:22.891252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:22.890964    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:07:23.671213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:23.671176    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82" event={"ID":"45ba99cc-1307-45a7-ae73-acf0af9633a8","Type":"ContainerStarted","Data":"31118621f33992b92046ba852cb65a40e70dc8e1cce44008ea9f621d192178e1"}
Jul 23 15:07:23.724726 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:23.724672    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82" podStartSLOduration=2.307207583 podStartE2EDuration="5.724651979s" totalImagesPullingTime="3.417444396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:23.724466323 +0000 UTC m=+418.019203801" watchObservedRunningTime="2026-07-23 15:07:23.724651979 +0000 UTC m=+418.019389457"
Jul 23 15:07:24.311689 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:24.311645    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:24.316643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:24.316618    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:24.676604 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:24.676521    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:24.677697 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:24.677660    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4p8r82"
Jul 23 15:07:25.680627 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:25.680588    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f" event={"ID":"5945ab33-efad-4fc3-a2a5-ea76ea4e240a","Type":"ContainerStarted","Data":"913797d092dce9dedb6710006adecefb85b6725bc3f721ef5ccf0ab43d0155ef"}
Jul 23 15:07:25.681116 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:25.680649    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:07:25.704430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:25.704367    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f" podStartSLOduration=1.766263181 podStartE2EDuration="5.704346937s" totalImagesPullingTime="3.938083756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:07:25.703875938 +0000 UTC m=+419.998613416" watchObservedRunningTime="2026-07-23 15:07:25.704346937 +0000 UTC m=+419.999084416"
Jul 23 15:07:36.686620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:07:36.686589    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68b858458d-mzz2f"
Jul 23 15:08:09.414551 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.414513    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:09.421733 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.421706    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:09.424900 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.424874    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 15:08:09.425373 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.425352    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 15:08:09.425911 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.425890    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4sgn7\""
Jul 23 15:08:09.434655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.434628    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:09.605876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.605842    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctkp9\" (UniqueName: \"kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9\") pod \"kuadrant-operator-catalog-wxccc\" (UID: \"e7e6968a-1c92-4716-a294-a84dfe7d7bdd\") " pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:09.706363 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.706265    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctkp9\" (UniqueName: \"kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9\") pod \"kuadrant-operator-catalog-wxccc\" (UID: \"e7e6968a-1c92-4716-a294-a84dfe7d7bdd\") " pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:09.720662 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.720630    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctkp9\" (UniqueName: \"kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9\") pod \"kuadrant-operator-catalog-wxccc\" (UID: \"e7e6968a-1c92-4716-a294-a84dfe7d7bdd\") " pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:09.732073 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.732043    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:09.755740 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.755698    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:09.873665 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.873599    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:09.963703 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.963612    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fbhm9"]
Jul 23 15:08:09.967882 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.967859    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:09.980162 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:09.980135    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fbhm9"]
Jul 23 15:08:10.110484 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.110452    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w82bq\" (UniqueName: \"kubernetes.io/projected/a2a97d38-20bd-4480-8bbc-91c65780ab46-kube-api-access-w82bq\") pod \"kuadrant-operator-catalog-fbhm9\" (UID: \"a2a97d38-20bd-4480-8bbc-91c65780ab46\") " pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:10.211502 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.211463    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w82bq\" (UniqueName: \"kubernetes.io/projected/a2a97d38-20bd-4480-8bbc-91c65780ab46-kube-api-access-w82bq\") pod \"kuadrant-operator-catalog-fbhm9\" (UID: \"a2a97d38-20bd-4480-8bbc-91c65780ab46\") " pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:10.222733 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.222668    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w82bq\" (UniqueName: \"kubernetes.io/projected/a2a97d38-20bd-4480-8bbc-91c65780ab46-kube-api-access-w82bq\") pod \"kuadrant-operator-catalog-fbhm9\" (UID: \"a2a97d38-20bd-4480-8bbc-91c65780ab46\") " pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:10.277818 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.277777    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:10.410908 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.410885    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fbhm9"]
Jul 23 15:08:10.413269 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:08:10.413246    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a97d38_20bd_4480_8bbc_91c65780ab46.slice/crio-a8107af430f1e1fc29965a7a39e87172f3e5e0851c9881939ea1cea64d5c7978 WatchSource:0}: Error finding container a8107af430f1e1fc29965a7a39e87172f3e5e0851c9881939ea1cea64d5c7978: Status 404 returned error can't find the container with id a8107af430f1e1fc29965a7a39e87172f3e5e0851c9881939ea1cea64d5c7978
Jul 23 15:08:10.839521 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.839467    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9" event={"ID":"a2a97d38-20bd-4480-8bbc-91c65780ab46","Type":"ContainerStarted","Data":"a8107af430f1e1fc29965a7a39e87172f3e5e0851c9881939ea1cea64d5c7978"}
Jul 23 15:08:10.840519 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:10.840499    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" event={"ID":"e7e6968a-1c92-4716-a294-a84dfe7d7bdd","Type":"ContainerStarted","Data":"fcd101894827e62b4658b672b3086017d996f6bb136e8b27c3634ed74f72e334"}
Jul 23 15:08:12.851025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:12.850988    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9" event={"ID":"a2a97d38-20bd-4480-8bbc-91c65780ab46","Type":"ContainerStarted","Data":"8caef1ffd4869a9ce623122ddd11262edc4f2a39b0e53e848b0688337956fc75"}
Jul 23 15:08:12.852526 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:12.852502    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" event={"ID":"e7e6968a-1c92-4716-a294-a84dfe7d7bdd","Type":"ContainerStarted","Data":"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"}
Jul 23 15:08:12.852645 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:12.852603    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" podUID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" containerName="registry-server" containerID="cri-o://5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df" gracePeriod=2
Jul 23 15:08:12.870910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:12.870863    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9" podStartSLOduration=1.535914296 podStartE2EDuration="3.870845222s" totalImagesPullingTime="2.334930926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:12.869865034 +0000 UTC m=+467.164602513" watchObservedRunningTime="2026-07-23 15:08:12.870845222 +0000 UTC m=+467.165582699"
Jul 23 15:08:12.899829 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:12.899780    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" podStartSLOduration=1.248302743 podStartE2EDuration="3.899763603s" totalImagesPullingTime="2.65146086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:12.897508236 +0000 UTC m=+467.192245707" watchObservedRunningTime="2026-07-23 15:08:12.899763603 +0000 UTC m=+467.194501080"
Jul 23 15:08:13.094212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.094185    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:13.236697 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.236662    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctkp9\" (UniqueName: \"kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9\") pod \"e7e6968a-1c92-4716-a294-a84dfe7d7bdd\" (UID: \"e7e6968a-1c92-4716-a294-a84dfe7d7bdd\") "
Jul 23 15:08:13.238828 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.238803    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9" (OuterVolumeSpecName: "kube-api-access-ctkp9") pod "e7e6968a-1c92-4716-a294-a84dfe7d7bdd" (UID: "e7e6968a-1c92-4716-a294-a84dfe7d7bdd"). InnerVolumeSpecName "kube-api-access-ctkp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:08:13.338270 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.338181    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctkp9\" (UniqueName: \"kubernetes.io/projected/e7e6968a-1c92-4716-a294-a84dfe7d7bdd-kube-api-access-ctkp9\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:08:13.857362 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.857329    2523 generic.go:356] "Generic (PLEG): container finished" podID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" containerID="5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df" exitCode=0
Jul 23 15:08:13.857860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.857371    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxccc"
Jul 23 15:08:13.857860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.857390    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" event={"ID":"e7e6968a-1c92-4716-a294-a84dfe7d7bdd","Type":"ContainerDied","Data":"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"}
Jul 23 15:08:13.857860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.857449    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxccc" event={"ID":"e7e6968a-1c92-4716-a294-a84dfe7d7bdd","Type":"ContainerDied","Data":"fcd101894827e62b4658b672b3086017d996f6bb136e8b27c3634ed74f72e334"}
Jul 23 15:08:13.857860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.857479    2523 scope.go:117] "RemoveContainer" containerID="5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"
Jul 23 15:08:13.865907 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.865889    2523 scope.go:117] "RemoveContainer" containerID="5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"
Jul 23 15:08:13.866160 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:08:13.866141    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df\": container with ID starting with 5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df not found: ID does not exist" containerID="5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"
Jul 23 15:08:13.866220 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.866168    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df"} err="failed to get container status \"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df\": rpc error: code = NotFound desc = could not find container \"5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df\": container with ID starting with 5c78419d92a92daf624bcc47a6b4b915c6bab4c6c8fdd1655487e0e3d94340df not found: ID does not exist"
Jul 23 15:08:13.884898 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.884869    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:13.887560 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:13.887537    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxccc"]
Jul 23 15:08:14.134201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:14.134127    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" path="/var/lib/kubelet/pods/e7e6968a-1c92-4716-a294-a84dfe7d7bdd/volumes"
Jul 23 15:08:20.278984 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:20.278928    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:20.279553 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:20.279015    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:20.300801 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:20.300771    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:20.907918 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:20.907890    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fbhm9"
Jul 23 15:08:43.219961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.219924    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-924p6"]
Jul 23 15:08:43.220422 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.220193    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" containerName="registry-server"
Jul 23 15:08:43.220422 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.220204    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" containerName="registry-server"
Jul 23 15:08:43.220422 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.220247    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e6968a-1c92-4716-a294-a84dfe7d7bdd" containerName="registry-server"
Jul 23 15:08:43.224499 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.224474    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:43.233331 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.233309    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q566f\""
Jul 23 15:08:43.237957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.237932    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-924p6"]
Jul 23 15:08:43.275909 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.275882    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzjb\" (UniqueName: \"kubernetes.io/projected/4c2462be-9ee6-40d0-97db-d0d844b31d6a-kube-api-access-zlzjb\") pod \"authorino-operator-75cc8d5cb7-924p6\" (UID: \"4c2462be-9ee6-40d0-97db-d0d844b31d6a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:43.377179 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.377151    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzjb\" (UniqueName: \"kubernetes.io/projected/4c2462be-9ee6-40d0-97db-d0d844b31d6a-kube-api-access-zlzjb\") pod \"authorino-operator-75cc8d5cb7-924p6\" (UID: \"4c2462be-9ee6-40d0-97db-d0d844b31d6a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:43.390280 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.390250    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzjb\" (UniqueName: \"kubernetes.io/projected/4c2462be-9ee6-40d0-97db-d0d844b31d6a-kube-api-access-zlzjb\") pod \"authorino-operator-75cc8d5cb7-924p6\" (UID: \"4c2462be-9ee6-40d0-97db-d0d844b31d6a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:43.533611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.533582    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:43.662415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.662378    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-924p6"]
Jul 23 15:08:43.665145 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:08:43.665120    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2462be_9ee6_40d0_97db_d0d844b31d6a.slice/crio-cf6759cf571488fdf90b6a2b938f9c0ff1074640ca387393ba3eca96232dca7a WatchSource:0}: Error finding container cf6759cf571488fdf90b6a2b938f9c0ff1074640ca387393ba3eca96232dca7a: Status 404 returned error can't find the container with id cf6759cf571488fdf90b6a2b938f9c0ff1074640ca387393ba3eca96232dca7a
Jul 23 15:08:43.969526 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:43.969427    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6" event={"ID":"4c2462be-9ee6-40d0-97db-d0d844b31d6a","Type":"ContainerStarted","Data":"cf6759cf571488fdf90b6a2b938f9c0ff1074640ca387393ba3eca96232dca7a"}
Jul 23 15:08:46.983378 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:46.983339    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6" event={"ID":"4c2462be-9ee6-40d0-97db-d0d844b31d6a","Type":"ContainerStarted","Data":"31c54f81c8e0b07c0a5360dddaf2ab3f006bd89d53a055c185e1df3839f40eed"}
Jul 23 15:08:46.983772 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:46.983456    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:08:47.028950 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:47.028907    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6" podStartSLOduration=1.225097201 podStartE2EDuration="4.028893933s" totalImagesPullingTime="2.803796732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:08:47.024839962 +0000 UTC m=+501.319577440" watchObservedRunningTime="2026-07-23 15:08:47.028893933 +0000 UTC m=+501.323631476"
Jul 23 15:08:54.407142 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.407111    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"]
Jul 23 15:08:54.410198 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.410179    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.420961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.420940    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cddmh\""
Jul 23 15:08:54.432622 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.432596    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"]
Jul 23 15:08:54.462357 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.462332    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjht\" (UniqueName: \"kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.462479 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.462390    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.562734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.562703    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.562856 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.562772    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjht\" (UniqueName: \"kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.563163 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.563136    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.572064 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.572036    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjht\" (UniqueName: \"kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.720110 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.720049    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:08:54.856675 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:54.856646    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"]
Jul 23 15:08:54.859864 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:08:54.859837    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2275f5d_c696_4393_a782_03cdded70eae.slice/crio-0a32a9378a81e700289dbc6cd5d954c5a01fcc492a8738048801d817d4188b39 WatchSource:0}: Error finding container 0a32a9378a81e700289dbc6cd5d954c5a01fcc492a8738048801d817d4188b39: Status 404 returned error can't find the container with id 0a32a9378a81e700289dbc6cd5d954c5a01fcc492a8738048801d817d4188b39
Jul 23 15:08:55.017723 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:55.017653    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv" event={"ID":"f2275f5d-c696-4393-a782-03cdded70eae","Type":"ContainerStarted","Data":"0a32a9378a81e700289dbc6cd5d954c5a01fcc492a8738048801d817d4188b39"}
Jul 23 15:08:57.990474 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:08:57.990442    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-924p6"
Jul 23 15:09:01.051141 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:01.051106    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv" event={"ID":"f2275f5d-c696-4393-a782-03cdded70eae","Type":"ContainerStarted","Data":"73f8fe333f13b0a314b618b035e662905ed1d6daecbef1e24fc52354ef87df5f"}
Jul 23 15:09:01.051565 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:01.051228    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:09:01.081106 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:01.081058    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv" podStartSLOduration=1.3540784590000001 podStartE2EDuration="7.08103905s" totalImagesPullingTime="5.726960591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:09:01.080137166 +0000 UTC m=+515.374874645" watchObservedRunningTime="2026-07-23 15:09:01.08103905 +0000 UTC m=+515.375776529"
Jul 23 15:09:12.058406 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:12.058366    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:09:13.985385 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:13.985352    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"]
Jul 23 15:09:13.985867 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:13.985592    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv" podUID="f2275f5d-c696-4393-a782-03cdded70eae" containerName="manager" containerID="cri-o://73f8fe333f13b0a314b618b035e662905ed1d6daecbef1e24fc52354ef87df5f" gracePeriod=2
Jul 23 15:09:13.993941 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:13.993914    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"]
Jul 23 15:09:14.029614 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.029574    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:14.029939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.029923    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2275f5d-c696-4393-a782-03cdded70eae" containerName="manager"
Jul 23 15:09:14.030014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.029942    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2275f5d-c696-4393-a782-03cdded70eae" containerName="manager"
Jul 23 15:09:14.030064 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.030039    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2275f5d-c696-4393-a782-03cdded70eae" containerName="manager"
Jul 23 15:09:14.032885 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.032865    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.072228 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.072192    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:14.107092 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.107064    2523 generic.go:356] "Generic (PLEG): container finished" podID="f2275f5d-c696-4393-a782-03cdded70eae" containerID="73f8fe333f13b0a314b618b035e662905ed1d6daecbef1e24fc52354ef87df5f" exitCode=0
Jul 23 15:09:14.131871 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.131841    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.132028 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.131893    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7wkq\" (UniqueName: \"kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.182281 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:09:14.182243    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tkbfv\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" podUID="f2275f5d-c696-4393-a782-03cdded70eae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:09:14.232961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.232796    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.232961 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.232859    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7wkq\" (UniqueName: \"kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.233205 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.233107    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.246503 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.246431    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:09:14.285247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.285211    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7wkq\" (UniqueName: \"kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4dfjl\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.333378 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.333346    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjht\" (UniqueName: \"kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht\") pod \"f2275f5d-c696-4393-a782-03cdded70eae\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") "
Jul 23 15:09:14.333378 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.333379    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume\") pod \"f2275f5d-c696-4393-a782-03cdded70eae\" (UID: \"f2275f5d-c696-4393-a782-03cdded70eae\") "
Jul 23 15:09:14.333903 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.333879    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2275f5d-c696-4393-a782-03cdded70eae" (UID: "f2275f5d-c696-4393-a782-03cdded70eae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:09:14.335506 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.335473    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht" (OuterVolumeSpecName: "kube-api-access-fnjht") pod "f2275f5d-c696-4393-a782-03cdded70eae" (UID: "f2275f5d-c696-4393-a782-03cdded70eae"). InnerVolumeSpecName "kube-api-access-fnjht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:14.385461 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.385430    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:14.434805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.434778    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjht\" (UniqueName: \"kubernetes.io/projected/f2275f5d-c696-4393-a782-03cdded70eae-kube-api-access-fnjht\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:09:14.434805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.434805    2523 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2275f5d-c696-4393-a782-03cdded70eae-extensions-socket-volume\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:09:14.533347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:14.533319    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:14.535975 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:09:14.535947    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b6f1c3_25c5_4ad5_891f_197707ba2356.slice/crio-0c537d24adbd9706d2ab9bfc469536d1594cc63964ca37c287398bcbf9a2a3b9 WatchSource:0}: Error finding container 0c537d24adbd9706d2ab9bfc469536d1594cc63964ca37c287398bcbf9a2a3b9: Status 404 returned error can't find the container with id 0c537d24adbd9706d2ab9bfc469536d1594cc63964ca37c287398bcbf9a2a3b9
Jul 23 15:09:15.112033 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.111994    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" event={"ID":"f4b6f1c3-25c5-4ad5-891f-197707ba2356","Type":"ContainerStarted","Data":"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"}
Jul 23 15:09:15.112471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.112065    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:15.112471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.112088    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" event={"ID":"f4b6f1c3-25c5-4ad5-891f-197707ba2356","Type":"ContainerStarted","Data":"0c537d24adbd9706d2ab9bfc469536d1594cc63964ca37c287398bcbf9a2a3b9"}
Jul 23 15:09:15.113362 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.113334    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tkbfv"
Jul 23 15:09:15.113362 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.113348    2523 scope.go:117] "RemoveContainer" containerID="73f8fe333f13b0a314b618b035e662905ed1d6daecbef1e24fc52354ef87df5f"
Jul 23 15:09:15.139155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:15.139107    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" podStartSLOduration=2.139090235 podStartE2EDuration="2.139090235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:09:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:09:15.13773792 +0000 UTC m=+529.432475391" watchObservedRunningTime="2026-07-23 15:09:15.139090235 +0000 UTC m=+529.433827712"
Jul 23 15:09:16.130316 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:16.130285    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2275f5d-c696-4393-a782-03cdded70eae" path="/var/lib/kubelet/pods/f2275f5d-c696-4393-a782-03cdded70eae/volumes"
Jul 23 15:09:26.120986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:26.120958    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:42.693949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.693910    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:42.694464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.694198    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" podUID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" containerName="manager" containerID="cri-o://e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb" gracePeriod=10
Jul 23 15:09:42.728542 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.728512    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"]
Jul 23 15:09:42.731146 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.731128    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.733977 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.733952    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lklhp\""
Jul 23 15:09:42.792355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.792321    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"]
Jul 23 15:09:42.854377 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854338    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854563 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854399    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854563 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854422    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854563 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854457    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcbw8\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-kube-api-access-dcbw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854563 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854480    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854568    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854599    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78a6f7e9-88ee-462b-977d-2050585637f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854628    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.854701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.854668    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78a6f7e9-88ee-462b-977d-2050585637f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.955881 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.955794    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.955881 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.955834    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.955881 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.955860    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcbw8\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-kube-api-access-dcbw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.955980    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956027    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956052    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78a6f7e9-88ee-462b-977d-2050585637f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956086    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956123    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78a6f7e9-88ee-462b-977d-2050585637f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956181    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956389 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956266    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956389 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956281    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956389 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956374    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956574 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956510    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.956973 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.956953    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78a6f7e9-88ee-462b-977d-2050585637f4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.958367 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.958344    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78a6f7e9-88ee-462b-977d-2050585637f4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.958511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.958476    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78a6f7e9-88ee-462b-977d-2050585637f4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.966613 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.966593    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:42.966711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:42.966653    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcbw8\" (UniqueName: \"kubernetes.io/projected/78a6f7e9-88ee-462b-977d-2050585637f4-kube-api-access-dcbw8\") pod \"maas-default-gateway-openshift-default-56654dcf7-hpdjn\" (UID: \"78a6f7e9-88ee-462b-977d-2050585637f4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:43.042194 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.042163    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:43.135685 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.135653    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:43.198939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.198913    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"]
Jul 23 15:09:43.200964 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:09:43.200936    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a6f7e9_88ee_462b_977d_2050585637f4.slice/crio-bccf7ddd3710814b0df8c94e92bd89d6b16045e71e29176ec4a6907fe6bb9664 WatchSource:0}: Error finding container bccf7ddd3710814b0df8c94e92bd89d6b16045e71e29176ec4a6907fe6bb9664: Status 404 returned error can't find the container with id bccf7ddd3710814b0df8c94e92bd89d6b16045e71e29176ec4a6907fe6bb9664
Jul 23 15:09:43.202999 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.202973    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:09:43.203059 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.203037    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:09:43.203099 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.203066    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:09:43.221203 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.221166    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" event={"ID":"78a6f7e9-88ee-462b-977d-2050585637f4","Type":"ContainerStarted","Data":"bccf7ddd3710814b0df8c94e92bd89d6b16045e71e29176ec4a6907fe6bb9664"}
Jul 23 15:09:43.222299 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.222278    2523 generic.go:356] "Generic (PLEG): container finished" podID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" containerID="e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb" exitCode=0
Jul 23 15:09:43.222364 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.222319    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"
Jul 23 15:09:43.222364 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.222332    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" event={"ID":"f4b6f1c3-25c5-4ad5-891f-197707ba2356","Type":"ContainerDied","Data":"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"}
Jul 23 15:09:43.222429 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.222377    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl" event={"ID":"f4b6f1c3-25c5-4ad5-891f-197707ba2356","Type":"ContainerDied","Data":"0c537d24adbd9706d2ab9bfc469536d1594cc63964ca37c287398bcbf9a2a3b9"}
Jul 23 15:09:43.222429 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.222403    2523 scope.go:117] "RemoveContainer" containerID="e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"
Jul 23 15:09:43.234121 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.234101    2523 scope.go:117] "RemoveContainer" containerID="e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"
Jul 23 15:09:43.234447 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:09:43.234425    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb\": container with ID starting with e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb not found: ID does not exist" containerID="e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"
Jul 23 15:09:43.234620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.234453    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb"} err="failed to get container status \"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb\": rpc error: code = NotFound desc = could not find container \"e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb\": container with ID starting with e56a198ade4cd651173c1a2a251b2717295b935c275ca5b16d0df40c27bba9fb not found: ID does not exist"
Jul 23 15:09:43.258931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.258902    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume\") pod \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") "
Jul 23 15:09:43.259073 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.259028    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7wkq\" (UniqueName: \"kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq\") pod \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\" (UID: \"f4b6f1c3-25c5-4ad5-891f-197707ba2356\") "
Jul 23 15:09:43.259354 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.259323    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4b6f1c3-25c5-4ad5-891f-197707ba2356" (UID: "f4b6f1c3-25c5-4ad5-891f-197707ba2356"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:09:43.261047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.261021    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq" (OuterVolumeSpecName: "kube-api-access-r7wkq") pod "f4b6f1c3-25c5-4ad5-891f-197707ba2356" (UID: "f4b6f1c3-25c5-4ad5-891f-197707ba2356"). InnerVolumeSpecName "kube-api-access-r7wkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:09:43.360483 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.360451    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7wkq\" (UniqueName: \"kubernetes.io/projected/f4b6f1c3-25c5-4ad5-891f-197707ba2356-kube-api-access-r7wkq\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:09:43.360483 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.360480    2523 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4b6f1c3-25c5-4ad5-891f-197707ba2356-extensions-socket-volume\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:09:43.550247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.550201    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:43.554430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:43.554404    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4dfjl"]
Jul 23 15:09:44.131475 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:44.131441    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" path="/var/lib/kubelet/pods/f4b6f1c3-25c5-4ad5-891f-197707ba2356/volumes"
Jul 23 15:09:44.228771 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:44.228674    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" event={"ID":"78a6f7e9-88ee-462b-977d-2050585637f4","Type":"ContainerStarted","Data":"a415ae8dd9ccf2f8299442a4ac096763e18ccefc27a42e17f243377449074637"}
Jul 23 15:09:44.264643 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:44.264590    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podStartSLOduration=2.26457448 podStartE2EDuration="2.26457448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:09:44.262297675 +0000 UTC m=+558.557035153" watchObservedRunningTime="2026-07-23 15:09:44.26457448 +0000 UTC m=+558.559311958"
Jul 23 15:09:45.042577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:45.042546    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:45.047465 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:45.047439    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:45.233312 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:45.233281    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:09:45.234333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:09:45.234312    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:10:04.303269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.303230    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:10:04.303725 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.303531    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" containerName="manager"
Jul 23 15:10:04.303725 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.303544    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" containerName="manager"
Jul 23 15:10:04.303725 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.303606    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b6f1c3-25c5-4ad5-891f-197707ba2356" containerName="manager"
Jul 23 15:10:04.306532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.306509    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.310679 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.310659    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k7lbl\""
Jul 23 15:10:04.310793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.310660    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 15:10:04.322341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.322317    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:10:04.364225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.364196    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:10:04.441556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.441516    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrfg\" (UniqueName: \"kubernetes.io/projected/b6f84a1a-5018-41c0-af53-677a9cd55a68-kube-api-access-fmrfg\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.441704 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.441595    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f84a1a-5018-41c0-af53-677a9cd55a68-config-file\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.542831 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.542789    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrfg\" (UniqueName: \"kubernetes.io/projected/b6f84a1a-5018-41c0-af53-677a9cd55a68-kube-api-access-fmrfg\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.543019 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.542861    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f84a1a-5018-41c0-af53-677a9cd55a68-config-file\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.543522 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.543479    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6f84a1a-5018-41c0-af53-677a9cd55a68-config-file\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.553004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.552983    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrfg\" (UniqueName: \"kubernetes.io/projected/b6f84a1a-5018-41c0-af53-677a9cd55a68-kube-api-access-fmrfg\") pod \"limitador-limitador-54d6d988d5-z579x\" (UID: \"b6f84a1a-5018-41c0-af53-677a9cd55a68\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.616946 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.616864    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:04.747254 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.747233    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:10:04.749477 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:10:04.749442    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f84a1a_5018_41c0_af53_677a9cd55a68.slice/crio-c2385598b4bd8d7ce826093bbdd153310cd0c3502e4df0d88f0ff5eb57313935 WatchSource:0}: Error finding container c2385598b4bd8d7ce826093bbdd153310cd0c3502e4df0d88f0ff5eb57313935: Status 404 returned error can't find the container with id c2385598b4bd8d7ce826093bbdd153310cd0c3502e4df0d88f0ff5eb57313935
Jul 23 15:10:04.986269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.986190    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:04.990471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.990454    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:04.993504 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:04.993475    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-txvgg\""
Jul 23 15:10:05.001207 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.001182    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:05.147822 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.147786    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p66w\" (UniqueName: \"kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w\") pod \"authorino-75d556bd77-hp22v\" (UID: \"0a297a38-5045-4631-8b89-cfdc8a567c9e\") " pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:05.249168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.249075    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p66w\" (UniqueName: \"kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w\") pod \"authorino-75d556bd77-hp22v\" (UID: \"0a297a38-5045-4631-8b89-cfdc8a567c9e\") " pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:05.258342 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.258312    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p66w\" (UniqueName: \"kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w\") pod \"authorino-75d556bd77-hp22v\" (UID: \"0a297a38-5045-4631-8b89-cfdc8a567c9e\") " pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:05.299133 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.299105    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:05.314828 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.314802    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x" event={"ID":"b6f84a1a-5018-41c0-af53-677a9cd55a68","Type":"ContainerStarted","Data":"c2385598b4bd8d7ce826093bbdd153310cd0c3502e4df0d88f0ff5eb57313935"}
Jul 23 15:10:05.429113 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:05.424040    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:05.430899 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:10:05.430870    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a297a38_5045_4631_8b89_cfdc8a567c9e.slice/crio-e231a77d7c6eb52b6cfe3d64f434c1079992271034b7f89843c117133681fc57 WatchSource:0}: Error finding container e231a77d7c6eb52b6cfe3d64f434c1079992271034b7f89843c117133681fc57: Status 404 returned error can't find the container with id e231a77d7c6eb52b6cfe3d64f434c1079992271034b7f89843c117133681fc57
Jul 23 15:10:06.319256 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:06.319226    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hp22v" event={"ID":"0a297a38-5045-4631-8b89-cfdc8a567c9e","Type":"ContainerStarted","Data":"e231a77d7c6eb52b6cfe3d64f434c1079992271034b7f89843c117133681fc57"}
Jul 23 15:10:11.345424 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:11.345380    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x" event={"ID":"b6f84a1a-5018-41c0-af53-677a9cd55a68","Type":"ContainerStarted","Data":"4f7655960c526e94a82004d5177db8ee2295a2fb56d014c0dc20cd576670f4a3"}
Jul 23 15:10:11.345936 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:11.345445    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:11.346883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:11.346849    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hp22v" event={"ID":"0a297a38-5045-4631-8b89-cfdc8a567c9e","Type":"ContainerStarted","Data":"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"}
Jul 23 15:10:11.364660 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:11.364615    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x" podStartSLOduration=1.685646303 podStartE2EDuration="7.364601913s" totalImagesPullingTime="5.67895561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:11.36397693 +0000 UTC m=+585.658714408" watchObservedRunningTime="2026-07-23 15:10:11.364601913 +0000 UTC m=+585.659339391"
Jul 23 15:10:11.380440 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:11.380392    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hp22v" podStartSLOduration=2.380956851 podStartE2EDuration="7.38037744s" totalImagesPullingTime="4.999420589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:11.379716596 +0000 UTC m=+585.674454076" watchObservedRunningTime="2026-07-23 15:10:11.38037744 +0000 UTC m=+585.675114918"
Jul 23 15:10:22.353625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:22.353597    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z579x"
Jul 23 15:10:40.932160 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:40.932129    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:10:40.938253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:40.938233    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:40.940856 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:40.940835    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 15:10:40.945188 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:40.945025    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:10:41.047915 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.047880    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdn7\" (UniqueName: \"kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.048072 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.047994    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.148393 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.148366    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.148570 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.148409    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdn7\" (UniqueName: \"kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.150739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.150714    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.158182 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.158158    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdn7\" (UniqueName: \"kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7\") pod \"authorino-ff5888b6d-6nc44\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") " pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.248456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.248383    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:10:41.379350 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.379316    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:10:41.382453 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:10:41.382428    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod291402eb_0f00_4b7a_9e2c_6f61d3a4348c.slice/crio-93c7c653bf8598558070cb1c40e6e325d34a9cd0435834de818c32518de0f623 WatchSource:0}: Error finding container 93c7c653bf8598558070cb1c40e6e325d34a9cd0435834de818c32518de0f623: Status 404 returned error can't find the container with id 93c7c653bf8598558070cb1c40e6e325d34a9cd0435834de818c32518de0f623
Jul 23 15:10:41.478544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:41.478510    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff5888b6d-6nc44" event={"ID":"291402eb-0f00-4b7a-9e2c-6f61d3a4348c","Type":"ContainerStarted","Data":"93c7c653bf8598558070cb1c40e6e325d34a9cd0435834de818c32518de0f623"}
Jul 23 15:10:42.483616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.483577    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff5888b6d-6nc44" event={"ID":"291402eb-0f00-4b7a-9e2c-6f61d3a4348c","Type":"ContainerStarted","Data":"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"}
Jul 23 15:10:42.508352 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.508296    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ff5888b6d-6nc44" podStartSLOduration=2.171384892 podStartE2EDuration="2.508280128s" totalImagesPullingTime="336.895236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:10:42.507286217 +0000 UTC m=+616.802023696" watchObservedRunningTime="2026-07-23 15:10:42.508280128 +0000 UTC m=+616.803017605"
Jul 23 15:10:42.539814 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.539778    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:42.540059 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.540032    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hp22v" podUID="0a297a38-5045-4631-8b89-cfdc8a567c9e" containerName="authorino" containerID="cri-o://5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a" gracePeriod=30
Jul 23 15:10:42.790258 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.790231    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:42.865329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.865294    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p66w\" (UniqueName: \"kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w\") pod \"0a297a38-5045-4631-8b89-cfdc8a567c9e\" (UID: \"0a297a38-5045-4631-8b89-cfdc8a567c9e\") "
Jul 23 15:10:42.867361 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.867333    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w" (OuterVolumeSpecName: "kube-api-access-2p66w") pod "0a297a38-5045-4631-8b89-cfdc8a567c9e" (UID: "0a297a38-5045-4631-8b89-cfdc8a567c9e"). InnerVolumeSpecName "kube-api-access-2p66w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:10:42.966859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:42.966825    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p66w\" (UniqueName: \"kubernetes.io/projected/0a297a38-5045-4631-8b89-cfdc8a567c9e-kube-api-access-2p66w\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:10:43.490808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.490779    2523 generic.go:356] "Generic (PLEG): container finished" podID="0a297a38-5045-4631-8b89-cfdc8a567c9e" containerID="5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a" exitCode=0
Jul 23 15:10:43.491258 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.490819    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hp22v"
Jul 23 15:10:43.491258 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.490870    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hp22v" event={"ID":"0a297a38-5045-4631-8b89-cfdc8a567c9e","Type":"ContainerDied","Data":"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"}
Jul 23 15:10:43.491258 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.490913    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hp22v" event={"ID":"0a297a38-5045-4631-8b89-cfdc8a567c9e","Type":"ContainerDied","Data":"e231a77d7c6eb52b6cfe3d64f434c1079992271034b7f89843c117133681fc57"}
Jul 23 15:10:43.491258 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.490930    2523 scope.go:117] "RemoveContainer" containerID="5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"
Jul 23 15:10:43.499799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.499783    2523 scope.go:117] "RemoveContainer" containerID="5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"
Jul 23 15:10:43.500065 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:10:43.500047    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a\": container with ID starting with 5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a not found: ID does not exist" containerID="5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"
Jul 23 15:10:43.500115 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.500076    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a"} err="failed to get container status \"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a\": rpc error: code = NotFound desc = could not find container \"5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a\": container with ID starting with 5d7d56442366a96771e6368a54a5b26200abda108320fcaf264b9a320859191a not found: ID does not exist"
Jul 23 15:10:43.512381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.512357    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:43.514415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:43.514395    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hp22v"]
Jul 23 15:10:44.131161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:10:44.131130    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a297a38-5045-4631-8b89-cfdc8a567c9e" path="/var/lib/kubelet/pods/0a297a38-5045-4631-8b89-cfdc8a567c9e/volumes"
Jul 23 15:11:24.859041 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:24.859004    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:11:31.275639 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:31.275600    2523 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hpdjn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 15:11:31.276007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:31.275654    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podUID="78a6f7e9-88ee-462b-977d-2050585637f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 15:11:32.692622 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.692587    2523 generic.go:356] "Generic (PLEG): container finished" podID="78a6f7e9-88ee-462b-977d-2050585637f4" containerID="a415ae8dd9ccf2f8299442a4ac096763e18ccefc27a42e17f243377449074637" exitCode=0
Jul 23 15:11:32.693091 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.692658    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" event={"ID":"78a6f7e9-88ee-462b-977d-2050585637f4","Type":"ContainerDied","Data":"a415ae8dd9ccf2f8299442a4ac096763e18ccefc27a42e17f243377449074637"}
Jul 23 15:11:32.693091 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.693032    2523 scope.go:117] "RemoveContainer" containerID="a415ae8dd9ccf2f8299442a4ac096763e18ccefc27a42e17f243377449074637"
Jul 23 15:11:32.693995 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.693969    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:11:32.694105 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.694033    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:11:32.694105 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:32.694061    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:11:33.698649 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:33.698620    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" event={"ID":"78a6f7e9-88ee-462b-977d-2050585637f4","Type":"ContainerStarted","Data":"8dd92fb9dac8d5a57db4efedb5d30473ba24e13277e1efaf6737195aeaa52987"}
Jul 23 15:11:34.042731 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:34.042699    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:11:34.042960 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:34.042938    2523 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 23 15:11:34.043005 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:34.042986    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podUID="78a6f7e9-88ee-462b-977d-2050585637f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 23 15:11:35.043030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:35.042994    2523 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 23 15:11:35.043500 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:35.043044    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podUID="78a6f7e9-88ee-462b-977d-2050585637f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 23 15:11:36.043447 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:36.043409    2523 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 23 15:11:36.043845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:36.043479    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podUID="78a6f7e9-88ee-462b-977d-2050585637f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 23 15:11:37.042590 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:37.042552    2523 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hpdjn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 23 15:11:37.042776 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:37.042608    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn" podUID="78a6f7e9-88ee-462b-977d-2050585637f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 23 15:11:38.045630 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:38.045601    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:11:38.046002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:38.045880    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:11:38.046455 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:38.046439    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hpdjn"
Jul 23 15:11:39.889168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:39.889134    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:11:47.430273 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.430242    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"]
Jul 23 15:11:47.430652 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.430564    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a297a38-5045-4631-8b89-cfdc8a567c9e" containerName="authorino"
Jul 23 15:11:47.430652 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.430576    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a297a38-5045-4631-8b89-cfdc8a567c9e" containerName="authorino"
Jul 23 15:11:47.430652 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.430634    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a297a38-5045-4631-8b89-cfdc8a567c9e" containerName="authorino"
Jul 23 15:11:47.433998 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.433979    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.437306 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.437286    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 15:11:47.438408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.438390    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f2jgt\""
Jul 23 15:11:47.438527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.438391    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 15:11:47.438527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.438393    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 15:11:47.458124 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.458101    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"]
Jul 23 15:11:47.608446 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608414    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.608654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608455    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.608654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608475    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.608654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608516    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.608654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608565    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.608654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.608581    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lds8\" (UniqueName: \"kubernetes.io/projected/7edbab82-bd5d-41a0-a17e-6ac86adbf718-kube-api-access-7lds8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.709925 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.709832    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.709925 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.709876    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710157 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.709964    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710157 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.709984    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710157 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.710010    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710157 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.710026    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lds8\" (UniqueName: \"kubernetes.io/projected/7edbab82-bd5d-41a0-a17e-6ac86adbf718-kube-api-access-7lds8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.710232    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.710282    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.710347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.710319    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.712219 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.712195    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7edbab82-bd5d-41a0-a17e-6ac86adbf718-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.712354 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.712340    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7edbab82-bd5d-41a0-a17e-6ac86adbf718-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.725659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.725639    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lds8\" (UniqueName: \"kubernetes.io/projected/7edbab82-bd5d-41a0-a17e-6ac86adbf718-kube-api-access-7lds8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dgd6q\" (UID: \"7edbab82-bd5d-41a0-a17e-6ac86adbf718\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.744515 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.744478    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:47.882571 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:47.882539    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"]
Jul 23 15:11:47.885749 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:11:47.885725    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edbab82_bd5d_41a0_a17e_6ac86adbf718.slice/crio-643f4dfa2b4bffd8a5927cf8a33dd9678d034d88027840e811d22d4062d27f66 WatchSource:0}: Error finding container 643f4dfa2b4bffd8a5927cf8a33dd9678d034d88027840e811d22d4062d27f66: Status 404 returned error can't find the container with id 643f4dfa2b4bffd8a5927cf8a33dd9678d034d88027840e811d22d4062d27f66
Jul 23 15:11:48.479989 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:48.477453    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:11:48.768091 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:48.767980    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q" event={"ID":"7edbab82-bd5d-41a0-a17e-6ac86adbf718","Type":"ContainerStarted","Data":"643f4dfa2b4bffd8a5927cf8a33dd9678d034d88027840e811d22d4062d27f66"}
Jul 23 15:11:49.773423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:49.773393    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q" event={"ID":"7edbab82-bd5d-41a0-a17e-6ac86adbf718","Type":"ContainerStarted","Data":"e18b6995b69c7420f8312e9fd3e0ecfcfe9ae390704557beba080b840b99afea"}
Jul 23 15:11:57.745502 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:57.745443    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:57.745894 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:57.745574    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:57.758607 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:57.758581    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:11:57.802795 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:57.802748    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q" podStartSLOduration=9.709036953 podStartE2EDuration="10.802734163s" totalImagesPullingTime="1.09369721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:11:49.809990646 +0000 UTC m=+684.104728126" watchObservedRunningTime="2026-07-23 15:11:57.802734163 +0000 UTC m=+692.097471641"
Jul 23 15:11:57.822203 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:11:57.822178    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dgd6q"
Jul 23 15:12:10.951505 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:12:10.951454    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:12:26.463077 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:12:26.462999    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:12:48.343449 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:12:48.343412    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:13:00.055387 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:00.055357    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:13:51.935729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:51.935649    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dbd6cbcbf-mdc7k"]
Jul 23 15:13:51.938764 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:51.938740    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:51.951360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:51.951336    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dbd6cbcbf-mdc7k"]
Jul 23 15:13:52.057358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.057325    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce294bfc-50e8-4980-ac1a-830879eed8f0-tls-cert\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.057537 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.057368    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdhq9\" (UniqueName: \"kubernetes.io/projected/ce294bfc-50e8-4980-ac1a-830879eed8f0-kube-api-access-mdhq9\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.158086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.158053    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdhq9\" (UniqueName: \"kubernetes.io/projected/ce294bfc-50e8-4980-ac1a-830879eed8f0-kube-api-access-mdhq9\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.158239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.158134    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce294bfc-50e8-4980-ac1a-830879eed8f0-tls-cert\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.160481 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.160462    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce294bfc-50e8-4980-ac1a-830879eed8f0-tls-cert\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.166837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.166815    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdhq9\" (UniqueName: \"kubernetes.io/projected/ce294bfc-50e8-4980-ac1a-830879eed8f0-kube-api-access-mdhq9\") pod \"authorino-7dbd6cbcbf-mdc7k\" (UID: \"ce294bfc-50e8-4980-ac1a-830879eed8f0\") " pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.246896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.246827    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k"
Jul 23 15:13:52.383292 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.383260    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dbd6cbcbf-mdc7k"]
Jul 23 15:13:52.388218 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:13:52.388192    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce294bfc_50e8_4980_ac1a_830879eed8f0.slice/crio-ff9355dbc446caead2ad3aa1ba544882366791903837a9511f6cf7e0abd193d8 WatchSource:0}: Error finding container ff9355dbc446caead2ad3aa1ba544882366791903837a9511f6cf7e0abd193d8: Status 404 returned error can't find the container with id ff9355dbc446caead2ad3aa1ba544882366791903837a9511f6cf7e0abd193d8
Jul 23 15:13:52.389599 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:52.389581    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:13:53.287379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.287333    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k" event={"ID":"ce294bfc-50e8-4980-ac1a-830879eed8f0","Type":"ContainerStarted","Data":"0430f3219070fed366f76e9dfbcb15b91af963cb0063937bbcb5c24a072379a9"}
Jul 23 15:13:53.287862 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.287390    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k" event={"ID":"ce294bfc-50e8-4980-ac1a-830879eed8f0","Type":"ContainerStarted","Data":"ff9355dbc446caead2ad3aa1ba544882366791903837a9511f6cf7e0abd193d8"}
Jul 23 15:13:53.310120 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.310063    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dbd6cbcbf-mdc7k" podStartSLOduration=1.85201005 podStartE2EDuration="2.310047188s" totalImagesPullingTime="458.037138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:53.309592215 +0000 UTC m=+807.604329688" watchObservedRunningTime="2026-07-23 15:13:53.310047188 +0000 UTC m=+807.604784666"
Jul 23 15:13:53.350717 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.350677    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:13:53.350948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.350898    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-ff5888b6d-6nc44" podUID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" containerName="authorino" containerID="cri-o://1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf" gracePeriod=30
Jul 23 15:13:53.613067 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.613044    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:13:53.671623 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.671589    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert\") pod \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") "
Jul 23 15:13:53.671800 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.671629    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcdn7\" (UniqueName: \"kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7\") pod \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\" (UID: \"291402eb-0f00-4b7a-9e2c-6f61d3a4348c\") "
Jul 23 15:13:53.673601 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.673566    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7" (OuterVolumeSpecName: "kube-api-access-bcdn7") pod "291402eb-0f00-4b7a-9e2c-6f61d3a4348c" (UID: "291402eb-0f00-4b7a-9e2c-6f61d3a4348c"). InnerVolumeSpecName "kube-api-access-bcdn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:13:53.681031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.681010    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "291402eb-0f00-4b7a-9e2c-6f61d3a4348c" (UID: "291402eb-0f00-4b7a-9e2c-6f61d3a4348c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:13:53.772702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.772666    2523 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-tls-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:13:53.772702 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:53.772701    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdn7\" (UniqueName: \"kubernetes.io/projected/291402eb-0f00-4b7a-9e2c-6f61d3a4348c-kube-api-access-bcdn7\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:13:54.292822 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.292790    2523 generic.go:356] "Generic (PLEG): container finished" podID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" containerID="1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf" exitCode=0
Jul 23 15:13:54.293269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.292839    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ff5888b6d-6nc44"
Jul 23 15:13:54.293269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.292880    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff5888b6d-6nc44" event={"ID":"291402eb-0f00-4b7a-9e2c-6f61d3a4348c","Type":"ContainerDied","Data":"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"}
Jul 23 15:13:54.293269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.292925    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ff5888b6d-6nc44" event={"ID":"291402eb-0f00-4b7a-9e2c-6f61d3a4348c","Type":"ContainerDied","Data":"93c7c653bf8598558070cb1c40e6e325d34a9cd0435834de818c32518de0f623"}
Jul 23 15:13:54.293269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.292942    2523 scope.go:117] "RemoveContainer" containerID="1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"
Jul 23 15:13:54.301029 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.301009    2523 scope.go:117] "RemoveContainer" containerID="1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"
Jul 23 15:13:54.301296 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:13:54.301274    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf\": container with ID starting with 1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf not found: ID does not exist" containerID="1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"
Jul 23 15:13:54.301374 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.301302    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf"} err="failed to get container status \"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf\": rpc error: code = NotFound desc = could not find container \"1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf\": container with ID starting with 1e878aeaea345e1b56bdce89595338875ec76ea4a693fc9458300a3470b53fbf not found: ID does not exist"
Jul 23 15:13:54.317704 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.317679    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:13:54.321160 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:54.321140    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-ff5888b6d-6nc44"]
Jul 23 15:13:56.130906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:13:56.130876    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" path="/var/lib/kubelet/pods/291402eb-0f00-4b7a-9e2c-6f61d3a4348c/volumes"
Jul 23 15:14:22.331208 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:14:22.331162    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:14:33.033786 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:14:33.033755    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:14:47.637383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:14:47.637349    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:15:00.146822 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.146787    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"]
Jul 23 15:15:00.147288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.147112    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" containerName="authorino"
Jul 23 15:15:00.147288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.147124    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" containerName="authorino"
Jul 23 15:15:00.147288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.147190    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="291402eb-0f00-4b7a-9e2c-6f61d3a4348c" containerName="authorino"
Jul 23 15:15:00.150093 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.150077    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"
Jul 23 15:15:00.152444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.152423    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:15:00.159990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.159968    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"
Jul 23 15:15:00.161371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.161337    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"]
Jul 23 15:15:00.498978 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.498849    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"]
Jul 23 15:15:00.501600 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:15:00.501573    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f46289b_15ff_406a_8c79_391e26ad3509.slice/crio-234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93 WatchSource:0}: Error finding container 234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93: Status 404 returned error can't find the container with id 234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93
Jul 23 15:15:00.572356 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:00.572327    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl" event={"ID":"4f46289b-15ff-406a-8c79-391e26ad3509","Type":"ContainerStarted","Data":"234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93"}
Jul 23 15:15:03.587564 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:03.587526    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl" event={"ID":"4f46289b-15ff-406a-8c79-391e26ad3509","Type":"ContainerStarted","Data":"d87d58d006901cfd13c93f223119ebf3871a19be468144d2741ec9a41421b210"}
Jul 23 15:15:03.606174 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:03.606127    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl" podStartSLOduration=0.999930614 podStartE2EDuration="3.606111784s" totalImagesPullingTime="2.60618117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:15:03.605086867 +0000 UTC m=+877.899824345" watchObservedRunningTime="2026-07-23 15:15:03.606111784 +0000 UTC m=+877.900849262"
Jul 23 15:15:04.592947 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:04.592916    2523 generic.go:356] "Generic (PLEG): container finished" podID="4f46289b-15ff-406a-8c79-391e26ad3509" containerID="d87d58d006901cfd13c93f223119ebf3871a19be468144d2741ec9a41421b210" exitCode=0
Jul 23 15:15:04.593374 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:04.592968    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl" event={"ID":"4f46289b-15ff-406a-8c79-391e26ad3509","Type":"ContainerDied","Data":"d87d58d006901cfd13c93f223119ebf3871a19be468144d2741ec9a41421b210"}
Jul 23 15:15:05.725980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:05.725956    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"
Jul 23 15:15:06.602745 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:06.602715    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl"
Jul 23 15:15:06.602906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:06.602714    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746995-bkldl" event={"ID":"4f46289b-15ff-406a-8c79-391e26ad3509","Type":"ContainerDied","Data":"234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93"}
Jul 23 15:15:06.602906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:15:06.602836    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="234d133d214028f14d7d120a3eccc7fc01fcd1eca29fbd5d28c8dd72c5af9f93"
Jul 23 15:16:29.032420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:16:29.032381    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:16:38.038101 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:16:38.038071    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:17:08.131193 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:17:08.131155    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:17:18.135916 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:17:18.135884    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:17:28.528378 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:17:28.528343    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:17:40.242696 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:17:40.242658    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:17:51.943268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:17:51.943229    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:18:01.187538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:18:01.187499    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:18:13.250307 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:18:13.250272    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:18:23.147471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:18:23.147388    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:18:44.944686 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:18:44.944649    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:18:55.251397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:18:55.251352    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:19:20.937175 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:19:20.937142    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:19:31.327729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:19:31.327696    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:19:50.664165 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:19:50.664080    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:20:00.167902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:20:00.167864    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:20:09.939355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:20:09.939315    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:20:18.927112 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:20:18.927078    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:20:27.644014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:20:27.643979    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:22:18.452139 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:22:18.452103    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:22:27.235201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:22:27.235164    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:22:39.855382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:22:39.855344    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:22:53.392415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:22:53.392325    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:03.536544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:03.536505    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:13.068638 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:13.068600    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:22.247808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:22.247772    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:33.143252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:33.143214    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:45.135919 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:45.135885    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:23:52.836095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:23:52.836059    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:24:02.946446 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:02.946411    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:24:25.532288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:25.532202    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:24:35.349048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:35.349010    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:24:41.735181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.735143    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:24:41.735585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.735504    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f46289b-15ff-406a-8c79-391e26ad3509" containerName="cleanup"
Jul 23 15:24:41.735585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.735520    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f46289b-15ff-406a-8c79-391e26ad3509" containerName="cleanup"
Jul 23 15:24:41.735666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.735593    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f46289b-15ff-406a-8c79-391e26ad3509" containerName="cleanup"
Jul 23 15:24:41.738742 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.738726    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.761746 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:24:41.761713    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.761855 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:24:41.761840    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-same-id-a-a1a170a5-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"e2e-same-id-a-a1a170a5-kserve-self-signed-certs\"" type="*v1.Secret"
Jul 23 15:24:41.791151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.791127    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:24:41.881834 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881805    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.882009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881852    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.882009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881903    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.882009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881923    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdbxx\" (UniqueName: \"kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.882009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881945    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.882009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.881999    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982459 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982424    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982473    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982524    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982546    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdbxx\" (UniqueName: \"kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982569    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982585    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.982963 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982940    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.983034 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.982956    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.983076 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.983044    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.984851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.984834    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:41.991158 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:41.991094    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdbxx\" (UniqueName: \"kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:42.587391 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:42.587357    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-a1a170a5-kserve-self-signed-certs\""
Jul 23 15:24:42.595882 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:42.595856    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs\") pod \"e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") " pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:42.646813 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:42.646771    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:42.776288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:42.776252    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:24:42.779806 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:24:42.779776    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e4fc186_495e_4496_9b6c_482c5e9a19b7.slice/crio-990590792a7ac7a7831fec9d48e44af7b029c5f35d6bedb30e0d7cbec4f4b0ee WatchSource:0}: Error finding container 990590792a7ac7a7831fec9d48e44af7b029c5f35d6bedb30e0d7cbec4f4b0ee: Status 404 returned error can't find the container with id 990590792a7ac7a7831fec9d48e44af7b029c5f35d6bedb30e0d7cbec4f4b0ee
Jul 23 15:24:43.030739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:43.030707    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" event={"ID":"7e4fc186-495e-4496-9b6c-482c5e9a19b7","Type":"ContainerStarted","Data":"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"}
Jul 23 15:24:43.030962 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:43.030750    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" event={"ID":"7e4fc186-495e-4496-9b6c-482c5e9a19b7","Type":"ContainerStarted","Data":"990590792a7ac7a7831fec9d48e44af7b029c5f35d6bedb30e0d7cbec4f4b0ee"}
Jul 23 15:24:43.051752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:43.051703    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" podStartSLOduration=2.051688129 podStartE2EDuration="2.051688129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:24:43.049330617 +0000 UTC m=+1457.344068086" watchObservedRunningTime="2026-07-23 15:24:43.051688129 +0000 UTC m=+1457.346425607"
Jul 23 15:24:46.747860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:46.747820    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:24:49.495247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.495194    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:24:49.498868 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.498846    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.501631 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.501606    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-a1a170a5-kserve-self-signed-certs\""
Jul 23 15:24:49.511295 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.511273    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:24:49.655651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655610    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.655651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655648    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.655926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655753    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.655926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655790    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.655926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655809    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.655926 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.655878    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv6p2\" (UniqueName: \"kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757043 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.756954    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757043 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.756994    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757043 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757012    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757043 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757040    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv6p2\" (UniqueName: \"kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757354 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757071    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757354 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757088    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757463 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757421    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757473    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.757549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.757529    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.759270 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.759251    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.759568 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.759549    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.766130 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.766110    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv6p2\" (UniqueName: \"kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2\") pod \"e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") " pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.809068 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.809041    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:49.941044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:49.941018    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:24:49.942756 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:24:49.942720    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9932191_3005_4556_b6b3_ffc256308897.slice/crio-ad490132687412c68d425d3df2ae52eca37d7e90fef7185064508c64bc815984 WatchSource:0}: Error finding container ad490132687412c68d425d3df2ae52eca37d7e90fef7185064508c64bc815984: Status 404 returned error can't find the container with id ad490132687412c68d425d3df2ae52eca37d7e90fef7185064508c64bc815984
Jul 23 15:24:50.062059 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:50.062025    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" event={"ID":"d9932191-3005-4556-b6b3-ffc256308897","Type":"ContainerStarted","Data":"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"}
Jul 23 15:24:50.062059 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:50.062064    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" event={"ID":"d9932191-3005-4556-b6b3-ffc256308897","Type":"ContainerStarted","Data":"ad490132687412c68d425d3df2ae52eca37d7e90fef7185064508c64bc815984"}
Jul 23 15:24:50.084941 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:50.084895    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" podStartSLOduration=1.08487878 podStartE2EDuration="1.08487878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:24:50.081965698 +0000 UTC m=+1464.376703175" watchObservedRunningTime="2026-07-23 15:24:50.08487878 +0000 UTC m=+1464.379616257"
Jul 23 15:24:52.647289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:52.647232    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:52.647289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:52.647298    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:52.659712 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:52.659690    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:53.085416 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:53.085378    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:24:59.809905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:59.809866    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:59.810346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:59.809927    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:59.822415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:59.822387    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:24:59.842531 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:24:59.842502    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:25:00.116017 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:00.115922    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:25:23.153148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:23.153116    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:25:24.605415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:24.605379    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:25:27.042527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:27.042474    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:25:38.172909 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.172843    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" containerName="main" containerID="cri-o://c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb" gracePeriod=45
Jul 23 15:25:38.408400 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.408374    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:25:38.590859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.590825    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdbxx\" (UniqueName: \"kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591036 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.590895    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591036 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.590942    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591036 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.590962    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591036 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591005    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591049    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm\") pod \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\" (UID: \"7e4fc186-495e-4496-9b6c-482c5e9a19b7\") "
Jul 23 15:25:38.591252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591219    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:38.591311 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591240    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:38.591367 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591344    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home" (OuterVolumeSpecName: "home") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:38.591367 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591358    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-model-cache\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:38.591469 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.591373    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tmp-dir\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:38.593243 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.593216    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:25:38.593243 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.593233    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm" (OuterVolumeSpecName: "dshm") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:38.593382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.593264    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx" (OuterVolumeSpecName: "kube-api-access-wdbxx") pod "7e4fc186-495e-4496-9b6c-482c5e9a19b7" (UID: "7e4fc186-495e-4496-9b6c-482c5e9a19b7"). InnerVolumeSpecName "kube-api-access-wdbxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:25:38.692538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.692506    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-home\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:38.692538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.692534    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4fc186-495e-4496-9b6c-482c5e9a19b7-dshm\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:38.692538 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.692543    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdbxx\" (UniqueName: \"kubernetes.io/projected/7e4fc186-495e-4496-9b6c-482c5e9a19b7-kube-api-access-wdbxx\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:38.692765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:38.692553    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4fc186-495e-4496-9b6c-482c5e9a19b7-tls-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:39.280338 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.280303    2523 generic.go:356] "Generic (PLEG): container finished" podID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" containerID="c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb" exitCode=0
Jul 23 15:25:39.280796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.280354    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"
Jul 23 15:25:39.280796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.280391    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" event={"ID":"7e4fc186-495e-4496-9b6c-482c5e9a19b7","Type":"ContainerDied","Data":"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"}
Jul 23 15:25:39.280796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.280441    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l" event={"ID":"7e4fc186-495e-4496-9b6c-482c5e9a19b7","Type":"ContainerDied","Data":"990590792a7ac7a7831fec9d48e44af7b029c5f35d6bedb30e0d7cbec4f4b0ee"}
Jul 23 15:25:39.280796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.280459    2523 scope.go:117] "RemoveContainer" containerID="c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"
Jul 23 15:25:39.289107 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.289091    2523 scope.go:117] "RemoveContainer" containerID="c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"
Jul 23 15:25:39.289353 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:25:39.289336    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb\": container with ID starting with c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb not found: ID does not exist" containerID="c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"
Jul 23 15:25:39.289405 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.289361    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb"} err="failed to get container status \"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb\": rpc error: code = NotFound desc = could not find container \"c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb\": container with ID starting with c42604814f9edc638819c1b0a26f4438af6936db0a753f458977390a84c47cdb not found: ID does not exist"
Jul 23 15:25:39.303187 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.303156    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:25:39.309753 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.309731    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-a1a170a5-kserve-57b845b687-ltz2l"]
Jul 23 15:25:39.539895 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.539806    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:25:39.624651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.624615    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" podUID="d9932191-3005-4556-b6b3-ffc256308897" containerName="main" containerID="cri-o://3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16" gracePeriod=45
Jul 23 15:25:39.870790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:39.870767    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:25:40.003744 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003707    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv6p2\" (UniqueName: \"kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.003912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003761    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.003912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003795    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.003912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003839    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.003912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003856    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.003912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.003885    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm\") pod \"d9932191-3005-4556-b6b3-ffc256308897\" (UID: \"d9932191-3005-4556-b6b3-ffc256308897\") "
Jul 23 15:25:40.004179 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.004087    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home" (OuterVolumeSpecName: "home") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:40.004179 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.004106    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:40.004179 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.004120    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:40.005947 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.005925    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm" (OuterVolumeSpecName: "dshm") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:25:40.006039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.006022    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2" (OuterVolumeSpecName: "kube-api-access-tv6p2") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "kube-api-access-tv6p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:25:40.006087 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.006069    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9932191-3005-4556-b6b3-ffc256308897" (UID: "d9932191-3005-4556-b6b3-ffc256308897"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104592    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv6p2\" (UniqueName: \"kubernetes.io/projected/d9932191-3005-4556-b6b3-ffc256308897-kube-api-access-tv6p2\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104616    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-home\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104628    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9932191-3005-4556-b6b3-ffc256308897-tls-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104636    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-tmp-dir\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104644    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-model-cache\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.104666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.104651    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9932191-3005-4556-b6b3-ffc256308897-dshm\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:25:40.133042 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.133006    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" path="/var/lib/kubelet/pods/7e4fc186-495e-4496-9b6c-482c5e9a19b7/volumes"
Jul 23 15:25:40.286532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.286481    2523 generic.go:356] "Generic (PLEG): container finished" podID="d9932191-3005-4556-b6b3-ffc256308897" containerID="3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16" exitCode=0
Jul 23 15:25:40.286532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.286527    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" event={"ID":"d9932191-3005-4556-b6b3-ffc256308897","Type":"ContainerDied","Data":"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"}
Jul 23 15:25:40.286971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.286555    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"
Jul 23 15:25:40.286971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.286572    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79" event={"ID":"d9932191-3005-4556-b6b3-ffc256308897","Type":"ContainerDied","Data":"ad490132687412c68d425d3df2ae52eca37d7e90fef7185064508c64bc815984"}
Jul 23 15:25:40.286971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.286595    2523 scope.go:117] "RemoveContainer" containerID="3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"
Jul 23 15:25:40.295133 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.295110    2523 scope.go:117] "RemoveContainer" containerID="3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"
Jul 23 15:25:40.295398 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:25:40.295380    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16\": container with ID starting with 3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16 not found: ID does not exist" containerID="3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"
Jul 23 15:25:40.295547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.295405    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16"} err="failed to get container status \"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16\": rpc error: code = NotFound desc = could not find container \"3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16\": container with ID starting with 3a0dfc30292fb7d783cfa99ae1d88c2c4b121719742a46fc522f10e816e1fe16 not found: ID does not exist"
Jul 23 15:25:40.303262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.303237    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:25:40.308340 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:40.308318    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-a1a170a5-kserve-6bff7cc4c9-4cg79"]
Jul 23 15:25:42.131119 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:42.131087    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9932191-3005-4556-b6b3-ffc256308897" path="/var/lib/kubelet/pods/d9932191-3005-4556-b6b3-ffc256308897/volumes"
Jul 23 15:25:46.228794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:25:46.228758    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:01.141958 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:01.141920    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:10.741792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:10.741754    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:19.740351 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:19.740315    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:27.536664 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:27.536623    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:37.638303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:37.638262    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:26:46.930841 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:26:46.930789    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:00.241703 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:00.241654    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:09.567958 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:09.567918    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:18.993456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:18.993345    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:31.676845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:31.676809    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:42.232392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:42.232356    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:27:50.157030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:27:50.156994    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:02.237423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:02.237389    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:13.838180 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:13.838142    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:23.031905 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:23.031867    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:37.335390 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:37.335352    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:46.345114 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:46.345075    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:56.625858 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:56.625823    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:28:57.948549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948514    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948822    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9932191-3005-4556-b6b3-ffc256308897" containerName="main"
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948832    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9932191-3005-4556-b6b3-ffc256308897" containerName="main"
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948849    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" containerName="main"
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948854    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" containerName="main"
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948906    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4fc186-495e-4496-9b6c-482c5e9a19b7" containerName="main"
Jul 23 15:28:57.948930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.948916    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9932191-3005-4556-b6b3-ffc256308897" containerName="main"
Jul 23 15:28:57.951718 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.951701    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:57.954456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.954432    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a349867e-openshift-default-dockercfg-662j9\""
Jul 23 15:28:57.985245 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:57.985213    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:28:58.099072 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099034    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099087    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099113    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099211    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099245    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099275    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099304    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099342    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.099418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.099385    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rc5\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200006 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.199922    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200006 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.199968    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200006 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.199994    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200099    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200151    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200187    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200252 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200241    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200480 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200282    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rc5\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200480 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200324    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200480 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200382    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200663 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200534    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200726 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200705    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200783    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.200919 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.200900    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.202942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.202914    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.203097 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.203078    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.209286 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.209258    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.209511 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.209467    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rc5\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5\") pod \"e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") " pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.264289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.264259    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:58.403119 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.403096    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:28:58.405632 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:28:58.405602    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08518426_6522_4bdf_a6c2_2528e96959ff.slice/crio-aacc3a45e671904e97860d8da88ba60e1efcd3380f2ef4eef158a8f923a79176 WatchSource:0}: Error finding container aacc3a45e671904e97860d8da88ba60e1efcd3380f2ef4eef158a8f923a79176: Status 404 returned error can't find the container with id aacc3a45e671904e97860d8da88ba60e1efcd3380f2ef4eef158a8f923a79176
Jul 23 15:28:58.407693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.407661    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:28:58.407796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.407738    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:28:58.407796 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:58.407784    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:28:59.136027 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:59.135987    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerStarted","Data":"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"}
Jul 23 15:28:59.136461 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:59.136051    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerStarted","Data":"aacc3a45e671904e97860d8da88ba60e1efcd3380f2ef4eef158a8f923a79176"}
Jul 23 15:28:59.162614 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:59.162559    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podStartSLOduration=2.162541826 podStartE2EDuration="2.162541826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:28:59.161797739 +0000 UTC m=+1713.456535212" watchObservedRunningTime="2026-07-23 15:28:59.162541826 +0000 UTC m=+1713.457279303"
Jul 23 15:28:59.264554 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:59.264516    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:28:59.269370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:28:59.269344    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:00.140460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:00.140431    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:00.141412 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:00.141390    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:07.526822 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:07.526779    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:29:15.382996 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:15.382151    2523 patch_prober.go:28] interesting pod/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:44742->10.134.0.32:15021: read: connection reset by peer" start-of-body=
Jul 23 15:29:15.382996 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:15.382224    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:44742->10.134.0.32:15021: read: connection reset by peer"
Jul 23 15:29:16.209150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.209116    2523 generic.go:356] "Generic (PLEG): container finished" podID="08518426-6522-4bdf-a6c2-2528e96959ff" containerID="89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777" exitCode=0
Jul 23 15:29:16.209321 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.209189    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerDied","Data":"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"}
Jul 23 15:29:16.209605 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.209591    2523 scope.go:117] "RemoveContainer" containerID="89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"
Jul 23 15:29:16.210595 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.210568    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:16.210683 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.210633    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:16.210683 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:16.210664    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:17.218639 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:17.218598    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerStarted","Data":"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"}
Jul 23 15:29:17.264608 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:17.264573    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:17.264860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:17.264836    2523 patch_prober.go:28] interesting pod/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 23 15:29:17.264915 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:17.264896    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 23 15:29:18.265403 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:18.265370    2523 patch_prober.go:28] interesting pod/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 23 15:29:18.265810 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:18.265422    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 23 15:29:19.265550 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:19.265514    2523 patch_prober.go:28] interesting pod/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 23 15:29:19.265904 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:19.265577    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 23 15:29:20.264808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:20.264773    2523 patch_prober.go:28] interesting pod/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 23 15:29:20.264983 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:20.264822    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 23 15:29:21.268522 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:21.268474    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:21.268956 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:21.268750    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:21.269578 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:21.269557    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:26.172111 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.172078    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"]
Jul 23 15:29:26.175632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.175615    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:26.178015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.177996    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:29:26.178133 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.177997    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:29:26.184985 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.184957    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"]
Jul 23 15:29:26.261991 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.261951    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a349867e-jrpsr\" (UID: \"91986e64-28af-4e70-a108-6c1a915b7f9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:26.363135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.363100    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a349867e-jrpsr\" (UID: \"91986e64-28af-4e70-a108-6c1a915b7f9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:26.363727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.363707    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a349867e-jrpsr\" (UID: \"91986e64-28af-4e70-a108-6c1a915b7f9a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:26.487337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.487258    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:26.621053 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:26.620975    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"]
Jul 23 15:29:26.623123 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:29:26.623095    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91986e64_28af_4e70_a108_6c1a915b7f9a.slice/crio-7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd WatchSource:0}: Error finding container 7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd: Status 404 returned error can't find the container with id 7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd
Jul 23 15:29:27.262382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:27.262288    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr" event={"ID":"91986e64-28af-4e70-a108-6c1a915b7f9a","Type":"ContainerStarted","Data":"41e39452b52db3b7df4f2f8f5fce32e63871a4442e22cfb15fc4a7b69a493c1c"}
Jul 23 15:29:27.262382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:27.262340    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr" event={"ID":"91986e64-28af-4e70-a108-6c1a915b7f9a","Type":"ContainerStarted","Data":"7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd"}
Jul 23 15:29:27.281096 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:27.281040    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr" podStartSLOduration=1.281024081 podStartE2EDuration="1.281024081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:27.279055438 +0000 UTC m=+1741.573792912" watchObservedRunningTime="2026-07-23 15:29:27.281024081 +0000 UTC m=+1741.575761558"
Jul 23 15:29:28.267896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:28.267857    2523 generic.go:356] "Generic (PLEG): container finished" podID="91986e64-28af-4e70-a108-6c1a915b7f9a" containerID="41e39452b52db3b7df4f2f8f5fce32e63871a4442e22cfb15fc4a7b69a493c1c" exitCode=0
Jul 23 15:29:28.268276 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:28.267942    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr" event={"ID":"91986e64-28af-4e70-a108-6c1a915b7f9a","Type":"ContainerDied","Data":"41e39452b52db3b7df4f2f8f5fce32e63871a4442e22cfb15fc4a7b69a493c1c"}
Jul 23 15:29:29.398296 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:29.398274    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:29.486952 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:29.486919    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca\") pod \"91986e64-28af-4e70-a108-6c1a915b7f9a\" (UID: \"91986e64-28af-4e70-a108-6c1a915b7f9a\") "
Jul 23 15:29:29.487261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:29.487237    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91986e64-28af-4e70-a108-6c1a915b7f9a" (UID: "91986e64-28af-4e70-a108-6c1a915b7f9a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:29:29.587978 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:29.587900    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91986e64-28af-4e70-a108-6c1a915b7f9a-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:30.277015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:30.276975    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr" event={"ID":"91986e64-28af-4e70-a108-6c1a915b7f9a","Type":"ContainerDied","Data":"7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd"}
Jul 23 15:29:30.277015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:30.277009    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"
Jul 23 15:29:30.277220 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:30.277031    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d9c1ff131af18ea5d758831da14f2a5f4ac070d3052a226836f7c6776d061cd"
Jul 23 15:29:39.528181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:39.528143    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:29:41.241933 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:41.241891    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"]
Jul 23 15:29:41.244817 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:41.244792    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a349867e-jrpsr"]
Jul 23 15:29:41.391145 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:41.391114    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:29:41.391399 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:41.391359    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy" containerID="cri-o://5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da" gracePeriod=30
Jul 23 15:29:42.132940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.132903    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91986e64-28af-4e70-a108-6c1a915b7f9a" path="/var/lib/kubelet/pods/91986e64-28af-4e70-a108-6c1a915b7f9a/volumes"
Jul 23 15:29:42.493150 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.493067    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:29:42.493523 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.493393    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91986e64-28af-4e70-a108-6c1a915b7f9a" containerName="revoke-keys"
Jul 23 15:29:42.493523 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.493403    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="91986e64-28af-4e70-a108-6c1a915b7f9a" containerName="revoke-keys"
Jul 23 15:29:42.493523 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.493459    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="91986e64-28af-4e70-a108-6c1a915b7f9a" containerName="revoke-keys"
Jul 23 15:29:42.496615 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.496589    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.499850 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.499832    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-37799938-gw-openshift-default-dockercfg-jsspz\""
Jul 23 15:29:42.533994 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.533963    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:29:42.602936 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.602895    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.602950    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603031    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh2mj\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603078    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603214 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603129    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603214 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603177    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603214 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603202    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603308 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603270    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.603308 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.603291    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704270 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704231    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704270 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704270    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704310    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704343    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704376    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh2mj\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704417    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704478 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704449    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704515    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704542    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704908 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704843    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704924    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704945    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.704975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.704967    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.705240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.705218    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.706602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.706583    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.707044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.707024    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.713126 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.713091    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.713521 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.713471    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh2mj\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj\") pod \"e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") " pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.806569 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.806531    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:42.939656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.939630    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:29:42.941604 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:29:42.941576    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e08718_4499_4839_bb42_9e62f78b2ee4.slice/crio-9ac96445592439bb4d1754a1a2df2259cef4f4e9f0a61bb99c73d5bf3774ec66 WatchSource:0}: Error finding container 9ac96445592439bb4d1754a1a2df2259cef4f4e9f0a61bb99c73d5bf3774ec66: Status 404 returned error can't find the container with id 9ac96445592439bb4d1754a1a2df2259cef4f4e9f0a61bb99c73d5bf3774ec66
Jul 23 15:29:42.944175 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.944144    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:42.944264 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.944207    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:42.944264 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:42.944233    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:43.334391 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:43.334357    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerStarted","Data":"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"}
Jul 23 15:29:43.334591 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:43.334403    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerStarted","Data":"9ac96445592439bb4d1754a1a2df2259cef4f4e9f0a61bb99c73d5bf3774ec66"}
Jul 23 15:29:43.355896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:43.355848    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podStartSLOduration=1.355832308 podStartE2EDuration="1.355832308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:29:43.35500978 +0000 UTC m=+1757.649747271" watchObservedRunningTime="2026-07-23 15:29:43.355832308 +0000 UTC m=+1757.650569785"
Jul 23 15:29:43.806975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:43.806946    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:43.811533 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:43.811506    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:44.339198 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:44.339158    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:44.340220 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:44.340196    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:46.649002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.648976    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:46.739337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739241    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739296    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739335    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739364    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739395    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739420    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739474    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739541    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57rc5\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739574    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data\") pod \"08518426-6522-4bdf-a6c2-2528e96959ff\" (UID: \"08518426-6522-4bdf-a6c2-2528e96959ff\") "
Jul 23 15:29:46.739653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739603    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739741    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739775    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739810    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739929    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739947    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739964    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.739993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.739979    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08518426-6522-4bdf-a6c2-2528e96959ff-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.740710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.740684    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:29:46.741761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.741730    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:29:46.741865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.741853    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:29:46.742007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.741991    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5" (OuterVolumeSpecName: "kube-api-access-57rc5") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "kube-api-access-57rc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:29:46.742052 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.742019    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08518426-6522-4bdf-a6c2-2528e96959ff" (UID: "08518426-6522-4bdf-a6c2-2528e96959ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:29:46.840917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.840881    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.840917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.840911    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08518426-6522-4bdf-a6c2-2528e96959ff-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.840917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.840920    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.841152 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.840930    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57rc5\" (UniqueName: \"kubernetes.io/projected/08518426-6522-4bdf-a6c2-2528e96959ff-kube-api-access-57rc5\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:46.841152 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:46.840940    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08518426-6522-4bdf-a6c2-2528e96959ff-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:29:47.355014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.354981    2523 generic.go:356] "Generic (PLEG): container finished" podID="08518426-6522-4bdf-a6c2-2528e96959ff" containerID="5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da" exitCode=0
Jul 23 15:29:47.355225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.355032    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"
Jul 23 15:29:47.355225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.355061    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerDied","Data":"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"}
Jul 23 15:29:47.355225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.355128    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd" event={"ID":"08518426-6522-4bdf-a6c2-2528e96959ff","Type":"ContainerDied","Data":"aacc3a45e671904e97860d8da88ba60e1efcd3380f2ef4eef158a8f923a79176"}
Jul 23 15:29:47.355225 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.355159    2523 scope.go:117] "RemoveContainer" containerID="5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"
Jul 23 15:29:47.364124 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.364107    2523 scope.go:117] "RemoveContainer" containerID="89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"
Jul 23 15:29:47.372082 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.372048    2523 scope.go:117] "RemoveContainer" containerID="5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"
Jul 23 15:29:47.372422 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:29:47.372394    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da\": container with ID starting with 5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da not found: ID does not exist" containerID="5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"
Jul 23 15:29:47.372545 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.372431    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da"} err="failed to get container status \"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da\": rpc error: code = NotFound desc = could not find container \"5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da\": container with ID starting with 5ac31477d9487271de38404a73f0dc4ba1995da3cf4f97f27e347a016499d7da not found: ID does not exist"
Jul 23 15:29:47.372545 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.372450    2523 scope.go:117] "RemoveContainer" containerID="89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"
Jul 23 15:29:47.372749 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:29:47.372703    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777\": container with ID starting with 89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777 not found: ID does not exist" containerID="89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"
Jul 23 15:29:47.372749 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.372732    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777"} err="failed to get container status \"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777\": rpc error: code = NotFound desc = could not find container \"89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777\": container with ID starting with 89ca92a68eedb64ad3437fcecdf8bf37a083301e5608c7b0456955a15e64b777 not found: ID does not exist"
Jul 23 15:29:47.381321 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.381283    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:29:47.383301 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:47.383278    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a349867e-openshift-default-6d4cff4c8f-59pjd"]
Jul 23 15:29:48.131582 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:48.131554    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" path="/var/lib/kubelet/pods/08518426-6522-4bdf-a6c2-2528e96959ff/volumes"
Jul 23 15:29:50.331933 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:50.331899    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:29:58.406551 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.406433    2523 generic.go:356] "Generic (PLEG): container finished" podID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerID="67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495" exitCode=0
Jul 23 15:29:58.406551 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.406523    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerDied","Data":"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"}
Jul 23 15:29:58.406981 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.406944    2523 scope.go:117] "RemoveContainer" containerID="67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"
Jul 23 15:29:58.407983 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.407953    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:58.408066 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.408022    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:58.408066 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:58.408054    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:29:59.339932 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:59.339893    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:59.415669 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:59.415631    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerStarted","Data":"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"}
Jul 23 15:29:59.807366 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:59.807287    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:29:59.808668 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:59.808511    2523 patch_prober.go:28] interesting pod/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 23 15:29:59.808668 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:29:59.808583    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 23 15:30:00.135145 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.135062    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"]
Jul 23 15:30:00.135397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.135384    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.135436 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.135399    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.135471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.135456    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.135471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.135465    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.138212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.138189    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"]
Jul 23 15:30:00.138331 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.138299    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"
Jul 23 15:30:00.138527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.138512    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.138568 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.138529    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="08518426-6522-4bdf-a6c2-2528e96959ff" containerName="istio-proxy"
Jul 23 15:30:00.140498 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.140461    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:30:00.141787 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.141771    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"
Jul 23 15:30:00.150289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.150268    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"]
Jul 23 15:30:00.150687 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.150526    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"
Jul 23 15:30:00.152161 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.152140    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"]
Jul 23 15:30:00.157785 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.157764    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"
Jul 23 15:30:00.341986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.341900    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"]
Jul 23 15:30:00.346077 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:30:00.345546    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1c8a1b_be69_4977_a01e_8846561ea7f0.slice/crio-7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396 WatchSource:0}: Error finding container 7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396: Status 404 returned error can't find the container with id 7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396
Jul 23 15:30:00.377313 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.377292    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"]
Jul 23 15:30:00.386559 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:30:00.386536    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07900700_8e02_472f_8c06_2b66dcd4c1af.slice/crio-b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07 WatchSource:0}: Error finding container b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07: Status 404 returned error can't find the container with id b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07
Jul 23 15:30:00.422103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.422070    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf" event={"ID":"07900700-8e02-472f-8c06-2b66dcd4c1af","Type":"ContainerStarted","Data":"b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07"}
Jul 23 15:30:00.423480 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.423452    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9" event={"ID":"1f1c8a1b-be69-4977-a01e-8846561ea7f0","Type":"ContainerStarted","Data":"7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396"}
Jul 23 15:30:00.808632 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.808608    2523 patch_prober.go:28] interesting pod/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 23 15:30:00.808841 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:00.808817    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 23 15:30:01.430047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.430013    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf" event={"ID":"07900700-8e02-472f-8c06-2b66dcd4c1af","Type":"ContainerStarted","Data":"e4caf6cfe57e539bb46bf78a45eaf5d68f85774301cf3bfd2b5f553d9d98d7b0"}
Jul 23 15:30:01.431433 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.431405    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9" event={"ID":"1f1c8a1b-be69-4977-a01e-8846561ea7f0","Type":"ContainerStarted","Data":"01fa299bf64752ed1f024f8cb0e19ce78f89ad1257dc6ecba900c6ce3bd9fe83"}
Jul 23 15:30:01.447282 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.447237    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf" podStartSLOduration=1.447222533 podStartE2EDuration="1.447222533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:01.445478721 +0000 UTC m=+1775.740216198" watchObservedRunningTime="2026-07-23 15:30:01.447222533 +0000 UTC m=+1775.741960010"
Jul 23 15:30:01.460716 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.460677    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9" podStartSLOduration=1.4606622630000001 podStartE2EDuration="1.460662263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:01.460391023 +0000 UTC m=+1775.755128501" watchObservedRunningTime="2026-07-23 15:30:01.460662263 +0000 UTC m=+1775.755399742"
Jul 23 15:30:01.808532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.808079    2523 patch_prober.go:28] interesting pod/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 23 15:30:01.808532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:01.808141    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 23 15:30:02.437315 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.437282    2523 generic.go:356] "Generic (PLEG): container finished" podID="1f1c8a1b-be69-4977-a01e-8846561ea7f0" containerID="01fa299bf64752ed1f024f8cb0e19ce78f89ad1257dc6ecba900c6ce3bd9fe83" exitCode=0
Jul 23 15:30:02.437792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.437370    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9" event={"ID":"1f1c8a1b-be69-4977-a01e-8846561ea7f0","Type":"ContainerDied","Data":"01fa299bf64752ed1f024f8cb0e19ce78f89ad1257dc6ecba900c6ce3bd9fe83"}
Jul 23 15:30:02.438871 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.438843    2523 generic.go:356] "Generic (PLEG): container finished" podID="07900700-8e02-472f-8c06-2b66dcd4c1af" containerID="e4caf6cfe57e539bb46bf78a45eaf5d68f85774301cf3bfd2b5f553d9d98d7b0" exitCode=0
Jul 23 15:30:02.438987 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.438880    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf" event={"ID":"07900700-8e02-472f-8c06-2b66dcd4c1af","Type":"ContainerDied","Data":"e4caf6cfe57e539bb46bf78a45eaf5d68f85774301cf3bfd2b5f553d9d98d7b0"}
Jul 23 15:30:02.807854 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.807813    2523 patch_prober.go:28] interesting pod/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 23 15:30:02.808153 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:02.808122    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 23 15:30:03.586439 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:03.586415    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"
Jul 23 15:30:03.604589 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:03.604551    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"
Jul 23 15:30:03.811362 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:03.811326    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:30:03.811601 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:03.811581    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:30:03.812292 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:03.812276    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:30:04.449784 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.449704    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"
Jul 23 15:30:04.449948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.449702    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf" event={"ID":"07900700-8e02-472f-8c06-2b66dcd4c1af","Type":"ContainerDied","Data":"b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07"}
Jul 23 15:30:04.449948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.449846    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9915fbc4548b6914231da1219c21b4d2cba6d6f8f447f07a6ff7d0d06762e07"
Jul 23 15:30:04.451080 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.451061    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9"
Jul 23 15:30:04.451209 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.451084    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747010-mmbf9" event={"ID":"1f1c8a1b-be69-4977-a01e-8846561ea7f0","Type":"ContainerDied","Data":"7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396"}
Jul 23 15:30:04.451209 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:04.451116    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dd6f40fc9a448408f249b03493364dc01068b9510a169b95997a0a74cbe8396"
Jul 23 15:30:09.867334 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.867295    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"]
Jul 23 15:30:09.867876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.867857    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1c8a1b-be69-4977-a01e-8846561ea7f0" containerName="cleanup"
Jul 23 15:30:09.867876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.867878    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1c8a1b-be69-4977-a01e-8846561ea7f0" containerName="cleanup"
Jul 23 15:30:09.867980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.867908    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07900700-8e02-472f-8c06-2b66dcd4c1af" containerName="cleanup"
Jul 23 15:30:09.867980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.867917    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="07900700-8e02-472f-8c06-2b66dcd4c1af" containerName="cleanup"
Jul 23 15:30:09.868045 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.868009    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1c8a1b-be69-4977-a01e-8846561ea7f0" containerName="cleanup"
Jul 23 15:30:09.868045 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.868022    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="07900700-8e02-472f-8c06-2b66dcd4c1af" containerName="cleanup"
Jul 23 15:30:09.871351 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.871332    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:09.873870 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.873849    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:30:09.874086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.874070    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:30:09.880428 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.880401    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"]
Jul 23 15:30:09.937539 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:09.937476    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-37799938-zxmf2\" (UID: \"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:10.038383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:10.038337    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-37799938-zxmf2\" (UID: \"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:10.039010 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:10.038989    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-37799938-zxmf2\" (UID: \"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:10.182010 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:10.181924    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:10.325016 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:10.324972    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"]
Jul 23 15:30:10.328929 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:30:10.328900    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e87a17_0b1c_4cff_9392_1e69cd4dcaa4.slice/crio-29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11 WatchSource:0}: Error finding container 29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11: Status 404 returned error can't find the container with id 29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11
Jul 23 15:30:10.478896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:10.478797    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2" event={"ID":"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4","Type":"ContainerStarted","Data":"29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11"}
Jul 23 15:30:11.485246 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:11.485210    2523 generic.go:356] "Generic (PLEG): container finished" podID="48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" containerID="627e641c062c8c2e7a7e548320e2b12fad333733036574b761ebb7b49f2c40a2" exitCode=0
Jul 23 15:30:11.485680 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:11.485304    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2" event={"ID":"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4","Type":"ContainerDied","Data":"627e641c062c8c2e7a7e548320e2b12fad333733036574b761ebb7b49f2c40a2"}
Jul 23 15:30:12.630450 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:12.630420    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:12.663693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:12.663667    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca\") pod \"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4\" (UID: \"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4\") "
Jul 23 15:30:12.663967 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:12.663947    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" (UID: "48e87a17-0b1c-4cff-9392-1e69cd4dcaa4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:30:12.765123 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:12.765046    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:13.495501 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:13.495457    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"
Jul 23 15:30:13.495651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:13.495499    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2" event={"ID":"48e87a17-0b1c-4cff-9392-1e69cd4dcaa4","Type":"ContainerDied","Data":"29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11"}
Jul 23 15:30:13.495651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:13.495549    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29cb08a61bfb28aa088e364bfa51c4b93a163cb3486c8262c03c6d1856db1d11"
Jul 23 15:30:20.476021 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:20.475942    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"]
Jul 23 15:30:20.478507 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:20.478464    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-37799938-29747010-zshxf"]
Jul 23 15:30:22.131033 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:22.130997    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07900700-8e02-472f-8c06-2b66dcd4c1af" path="/var/lib/kubelet/pods/07900700-8e02-472f-8c06-2b66dcd4c1af/volumes"
Jul 23 15:30:23.328368 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:23.328328    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:30:24.945964 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:24.945927    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"]
Jul 23 15:30:24.949238 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:24.949217    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-37799938-zxmf2"]
Jul 23 15:30:25.098990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.098957    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:30:25.099242 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.099215    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy" containerID="cri-o://2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0" gracePeriod=30
Jul 23 15:30:25.939809 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.939780    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:30:25.940166 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.940144    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" containerName="revoke-keys"
Jul 23 15:30:25.940166 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.940164    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" containerName="revoke-keys"
Jul 23 15:30:25.940359 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.940239    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" containerName="revoke-keys"
Jul 23 15:30:25.943221 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.943192    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:25.945674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.945657    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6c19891e-openshift-default-dockercfg-lsplw\""
Jul 23 15:30:25.954076 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:25.954059    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:30:26.094593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094559    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094602    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4pf\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094625    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094674    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094714    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094778 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094761    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094789    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094812    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.094974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.094826    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.133954 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.133918    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e87a17-0b1c-4cff-9392-1e69cd4dcaa4" path="/var/lib/kubelet/pods/48e87a17-0b1c-4cff-9392-1e69cd4dcaa4/volumes"
Jul 23 15:30:26.196135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196053    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196090    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196131    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196174    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4pf\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196204    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196238    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196278    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196350    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196431 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196384    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196528    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196643    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196708    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.196792 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.196785    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.197307 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.197281    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.198944 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.198920    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.199246 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.199222    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.205765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.205739    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.205888 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.205866    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4pf\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf\") pod \"e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") " pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.256087 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.256064    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6c19891e-openshift-default-dockercfg-lsplw\""
Jul 23 15:30:26.264078 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.264062    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:26.395316 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.395295    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:30:26.397591 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:30:26.397548    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ce5ed9_04a9_48cd_a893_8ffbcfce01b2.slice/crio-834b8ceb6958876aeb8bb3444874af8e18f7ec158925ad374f5f910271bd756b WatchSource:0}: Error finding container 834b8ceb6958876aeb8bb3444874af8e18f7ec158925ad374f5f910271bd756b: Status 404 returned error can't find the container with id 834b8ceb6958876aeb8bb3444874af8e18f7ec158925ad374f5f910271bd756b
Jul 23 15:30:26.399840 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.399802    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:26.399912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.399887    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:26.399951 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.399917    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:26.559045 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.558998    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerStarted","Data":"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"}
Jul 23 15:30:26.559235 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.559067    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerStarted","Data":"834b8ceb6958876aeb8bb3444874af8e18f7ec158925ad374f5f910271bd756b"}
Jul 23 15:30:26.580389 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:26.580341    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podStartSLOduration=1.580325521 podStartE2EDuration="1.580325521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:26.578981304 +0000 UTC m=+1800.873718793" watchObservedRunningTime="2026-07-23 15:30:26.580325521 +0000 UTC m=+1800.875062999"
Jul 23 15:30:27.265165 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:27.265125    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:27.270154 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:27.270126    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:27.563783 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:27.563750    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:27.564716 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:27.564692    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:30.350214 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.350186    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:30:30.437290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437186    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437236    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437290 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437289    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437312    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437354    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437398    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh2mj\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437418    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437450    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437562    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token\") pod \"a1e08718-4499-4839-bb42-9e62f78b2ee4\" (UID: \"a1e08718-4499-4839-bb42-9e62f78b2ee4\") "
Jul 23 15:30:30.437924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437665    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:30:30.437924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437699    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:30:30.438044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437925    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:30:30.438044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.437950    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:30:30.438154 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.438042    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.438154 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.438064    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.438154 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.438078    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1e08718-4499-4839-bb42-9e62f78b2ee4-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.438154 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.438094    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.438666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.438641    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:30:30.439666 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.439643    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:30:30.439760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.439667    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj" (OuterVolumeSpecName: "kube-api-access-dh2mj") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "kube-api-access-dh2mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:30:30.439890 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.439868    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:30:30.440261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.440236    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1e08718-4499-4839-bb42-9e62f78b2ee4" (UID: "a1e08718-4499-4839-bb42-9e62f78b2ee4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:30:30.539206 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.539165    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.539206 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.539203    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.539206 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.539215    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh2mj\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-kube-api-access-dh2mj\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.539447 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.539224    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.539447 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.539232    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1e08718-4499-4839-bb42-9e62f78b2ee4-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:30.578971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.578931    2523 generic.go:356] "Generic (PLEG): container finished" podID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerID="2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0" exitCode=0
Jul 23 15:30:30.579148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.578985    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"
Jul 23 15:30:30.579148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.579019    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerDied","Data":"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"}
Jul 23 15:30:30.579148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.579095    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j" event={"ID":"a1e08718-4499-4839-bb42-9e62f78b2ee4","Type":"ContainerDied","Data":"9ac96445592439bb4d1754a1a2df2259cef4f4e9f0a61bb99c73d5bf3774ec66"}
Jul 23 15:30:30.579148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.579118    2523 scope.go:117] "RemoveContainer" containerID="2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"
Jul 23 15:30:30.589641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.589622    2523 scope.go:117] "RemoveContainer" containerID="67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"
Jul 23 15:30:30.598077 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.598053    2523 scope.go:117] "RemoveContainer" containerID="2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"
Jul 23 15:30:30.598400 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:30:30.598372    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0\": container with ID starting with 2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0 not found: ID does not exist" containerID="2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"
Jul 23 15:30:30.598561 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.598413    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0"} err="failed to get container status \"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0\": rpc error: code = NotFound desc = could not find container \"2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0\": container with ID starting with 2986a93962ab04fc07108a697885755df64d6745105fc8c398c4cb79dca527f0 not found: ID does not exist"
Jul 23 15:30:30.598561 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.598439    2523 scope.go:117] "RemoveContainer" containerID="67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"
Jul 23 15:30:30.598825 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:30:30.598788    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495\": container with ID starting with 67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495 not found: ID does not exist" containerID="67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"
Jul 23 15:30:30.598915 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.598821    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495"} err="failed to get container status \"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495\": rpc error: code = NotFound desc = could not find container \"67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495\": container with ID starting with 67df5b8e0d8a9c599e414e368072b874902a77b3a074b3e4aea66e62533d8495 not found: ID does not exist"
Jul 23 15:30:30.600831 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.600810    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:30:30.604608 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:30.604588    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-37799938-gw-openshift-default-69ccb7bbd7-4mc6j"]
Jul 23 15:30:32.132118 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:32.132081    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" path="/var/lib/kubelet/pods/a1e08718-4499-4839-bb42-9e62f78b2ee4/volumes"
Jul 23 15:30:33.733019 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:33.732979    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:30:42.565790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.565747    2523 patch_prober.go:28] interesting pod/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 23 15:30:42.566228 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.565816    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 23 15:30:42.651240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.651205    2523 generic.go:356] "Generic (PLEG): container finished" podID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerID="982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17" exitCode=0
Jul 23 15:30:42.651406 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.651271    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerDied","Data":"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"}
Jul 23 15:30:42.651845 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.651827    2523 scope.go:117] "RemoveContainer" containerID="982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"
Jul 23 15:30:42.652887 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.652861    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:42.652955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.652923    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:42.652999 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:42.652963    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:30:43.658885 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:43.658836    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerStarted","Data":"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"}
Jul 23 15:30:44.264683 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:44.264638    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:44.264939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:44.264917    2523 patch_prober.go:28] interesting pod/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 23 15:30:44.265028 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:44.264973    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 23 15:30:45.265372 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:45.265338    2523 patch_prober.go:28] interesting pod/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 23 15:30:45.265804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:45.265397    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 23 15:30:46.265509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:46.265459    2523 patch_prober.go:28] interesting pod/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 23 15:30:46.265906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:46.265558    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 23 15:30:47.264950 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:47.264906    2523 patch_prober.go:28] interesting pod/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 23 15:30:47.265128 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:47.264984    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 23 15:30:48.268902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:48.268870    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:48.269283 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:48.269129    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:48.269766 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:48.269749    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:30:53.821533 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.821479    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"]
Jul 23 15:30:53.821923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.821823    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:30:53.821923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.821834    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:30:53.821923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.821906    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:30:53.821923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.821915    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:30:53.823823 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.823806    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:53.826281 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.826255    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:30:53.826413 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.826294    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:30:53.830434 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.830395    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2\" (UID: \"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:53.832767 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.832733    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"]
Jul 23 15:30:53.930986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.930950    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2\" (UID: \"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:53.931638 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:53.931619    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2\" (UID: \"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:54.135603 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:54.135529    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:54.271022 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:54.270989    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"]
Jul 23 15:30:54.274846 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:30:54.274808    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd7e1fb_cb5b_40aa_81c1_4f21a3518b53.slice/crio-a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f WatchSource:0}: Error finding container a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f: Status 404 returned error can't find the container with id a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f
Jul 23 15:30:54.710253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:54.710214    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2" event={"ID":"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53","Type":"ContainerStarted","Data":"109e12c712709cc200415a157b65860a2b7a12878972c6842d3ca9d0d5a2b615"}
Jul 23 15:30:54.710428 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:54.710269    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2" event={"ID":"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53","Type":"ContainerStarted","Data":"a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f"}
Jul 23 15:30:54.728435 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:54.728380    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2" podStartSLOduration=1.728365009 podStartE2EDuration="1.728365009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:30:54.726204093 +0000 UTC m=+1829.020941571" watchObservedRunningTime="2026-07-23 15:30:54.728365009 +0000 UTC m=+1829.023102485"
Jul 23 15:30:55.715719 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:55.715680    2523 generic.go:356] "Generic (PLEG): container finished" podID="ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" containerID="109e12c712709cc200415a157b65860a2b7a12878972c6842d3ca9d0d5a2b615" exitCode=0
Jul 23 15:30:55.716117 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:55.715766    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2" event={"ID":"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53","Type":"ContainerDied","Data":"109e12c712709cc200415a157b65860a2b7a12878972c6842d3ca9d0d5a2b615"}
Jul 23 15:30:56.846332 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:56.846306    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:56.851927 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:56.851903    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca\") pod \"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53\" (UID: \"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53\") "
Jul 23 15:30:56.852209 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:56.852188    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" (UID: "ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:30:56.953210 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:56.953160    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:30:57.726168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:57.726130    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2" event={"ID":"ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53","Type":"ContainerDied","Data":"a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f"}
Jul 23 15:30:57.726168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:57.726167    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"
Jul 23 15:30:57.726438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:30:57.726183    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a41b8d39957dd8fe0ed94849a7d8cf6fc346f1d50398acdc454f67127309708f"
Jul 23 15:31:07.027060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:07.027020    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:31:08.894168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:08.894133    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"]
Jul 23 15:31:08.897353 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:08.897326    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6c19891e-b5cv2"]
Jul 23 15:31:10.119851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.119814    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:31:10.120424 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.120095    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy" containerID="cri-o://41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19" gracePeriod=30
Jul 23 15:31:10.132136 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.132107    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" path="/var/lib/kubelet/pods/ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53/volumes"
Jul 23 15:31:10.901336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901302    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:31:10.901734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901704    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:31:10.901734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901724    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e08718-4499-4839-bb42-9e62f78b2ee4" containerName="istio-proxy"
Jul 23 15:31:10.901734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901734    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" containerName="revoke-keys"
Jul 23 15:31:10.901959 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901741    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" containerName="revoke-keys"
Jul 23 15:31:10.901959 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.901802    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddd7e1fb-cb5b-40aa-81c1-4f21a3518b53" containerName="revoke-keys"
Jul 23 15:31:10.904734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.904715    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.907167 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.907146    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ad9a66fd-openshift-default-dockercfg-lzj57\""
Jul 23 15:31:10.915968 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.915938    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:31:10.979180 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979140    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979180 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979180    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979226    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979303    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979464 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979347    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx72f\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979472    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979529    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979565    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:10.979653 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:10.979590    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080568    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080626    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080659    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080685    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080758    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080801    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.080835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080832    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080880    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.080945    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx72f\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081281 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.081248    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081345 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.081271    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081419 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.081384    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081419 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.081398    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.081526 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.081409    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.083306 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.083284    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.083540 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.083518    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.089239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.089211    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.089380 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.089239    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx72f\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f\") pod \"e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") " pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.217760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.217655    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:11.360930 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.360904    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:31:11.363392 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:31:11.363362    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44810337_0f82_41ff_9cf3_ec0c5cdeb162.slice/crio-79e2217d35c15a12e009da9e40a32aa3a7a585844b7f5c7636a4c252c567caa6 WatchSource:0}: Error finding container 79e2217d35c15a12e009da9e40a32aa3a7a585844b7f5c7636a4c252c567caa6: Status 404 returned error can't find the container with id 79e2217d35c15a12e009da9e40a32aa3a7a585844b7f5c7636a4c252c567caa6
Jul 23 15:31:11.366215 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.366179    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:11.366345 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.366251    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:11.366345 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.366277    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:11.793031 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.792996    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerStarted","Data":"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"}
Jul 23 15:31:11.793194 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.793059    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerStarted","Data":"79e2217d35c15a12e009da9e40a32aa3a7a585844b7f5c7636a4c252c567caa6"}
Jul 23 15:31:11.813347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:11.813292    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podStartSLOduration=1.813275144 podStartE2EDuration="1.813275144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:31:11.811300537 +0000 UTC m=+1846.106038014" watchObservedRunningTime="2026-07-23 15:31:11.813275144 +0000 UTC m=+1846.108012623"
Jul 23 15:31:12.218081 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:12.217978    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:12.222903 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:12.222876    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:12.797466 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:12.797438    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:12.798523 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:12.798484    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:15.372861 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.372831    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:31:15.427135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427043    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427088    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427135 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427126    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427147    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b4pf\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427166    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427184    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427216    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427253    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427308    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs\") pod \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\" (UID: \"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2\") "
Jul 23 15:31:15.427758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427556    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:15.427758 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427711    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:15.427870 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427808    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:15.427976 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.427936    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:31:15.428285 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.428263    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:15.429619 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.429588    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:15.429730 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.429626    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf" (OuterVolumeSpecName: "kube-api-access-2b4pf") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "kube-api-access-2b4pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:15.429819 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.429803    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:15.429884 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.429806    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" (UID: "71ce5ed9-04a9-48cd-a893-8ffbcfce01b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:31:15.528737 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528690    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.528737 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528723    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.528737 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528733    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.528737 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528743    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.529007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528752    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.529007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528761    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.529007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528769    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b4pf\" (UniqueName: \"kubernetes.io/projected/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-kube-api-access-2b4pf\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.529007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528776    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.529007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.528784    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:15.812543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.812479    2523 generic.go:356] "Generic (PLEG): container finished" podID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerID="41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19" exitCode=0
Jul 23 15:31:15.812711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.812563    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"
Jul 23 15:31:15.812711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.812588    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerDied","Data":"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"}
Jul 23 15:31:15.812711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.812670    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh" event={"ID":"71ce5ed9-04a9-48cd-a893-8ffbcfce01b2","Type":"ContainerDied","Data":"834b8ceb6958876aeb8bb3444874af8e18f7ec158925ad374f5f910271bd756b"}
Jul 23 15:31:15.812711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.812692    2523 scope.go:117] "RemoveContainer" containerID="41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"
Jul 23 15:31:15.821927 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.821909    2523 scope.go:117] "RemoveContainer" containerID="982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"
Jul 23 15:31:15.830289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.830269    2523 scope.go:117] "RemoveContainer" containerID="41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"
Jul 23 15:31:15.830576 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:31:15.830557    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19\": container with ID starting with 41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19 not found: ID does not exist" containerID="41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"
Jul 23 15:31:15.830634 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.830587    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19"} err="failed to get container status \"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19\": rpc error: code = NotFound desc = could not find container \"41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19\": container with ID starting with 41d1552813500f5e062270f011b7191817364867241284080abf77e495252a19 not found: ID does not exist"
Jul 23 15:31:15.830634 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.830606    2523 scope.go:117] "RemoveContainer" containerID="982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"
Jul 23 15:31:15.830854 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:31:15.830836    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17\": container with ID starting with 982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17 not found: ID does not exist" containerID="982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"
Jul 23 15:31:15.830956 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.830858    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17"} err="failed to get container status \"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17\": rpc error: code = NotFound desc = could not find container \"982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17\": container with ID starting with 982c698c345cc11c3ab6a8e8e748c35a9ec05291bb67301ef06513da31878e17 not found: ID does not exist"
Jul 23 15:31:15.834608 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.834582    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:31:15.839023 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:15.839003    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6c19891e-openshift-default-6d8bf9dc8c-jm5sh"]
Jul 23 15:31:16.132272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:16.132187    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" path="/var/lib/kubelet/pods/71ce5ed9-04a9-48cd-a893-8ffbcfce01b2/volumes"
Jul 23 15:31:16.221071 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:16.221037    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:31:23.855398 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.855361    2523 generic.go:356] "Generic (PLEG): container finished" podID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerID="755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef" exitCode=0
Jul 23 15:31:23.855841 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.855434    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerDied","Data":"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"}
Jul 23 15:31:23.855904 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.855841    2523 scope.go:117] "RemoveContainer" containerID="755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"
Jul 23 15:31:23.856821 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.856792    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:23.856939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.856875    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:23.856939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:23.856923    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:31:24.862987 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:24.862951    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerStarted","Data":"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"}
Jul 23 15:31:25.218730 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:25.218634    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:25.219831 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:25.219807    2523 patch_prober.go:28] interesting pod/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 15:31:25.219942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:25.219857    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 15:31:26.218370 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:26.218336    2523 patch_prober.go:28] interesting pod/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 15:31:26.219395 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:26.219346    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 15:31:27.218711 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:27.218667    2523 patch_prober.go:28] interesting pod/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 15:31:27.219101 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:27.218757    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 15:31:27.798329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:27.798277    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:28.218534 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:28.218419    2523 patch_prober.go:28] interesting pod/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 15:31:28.218534 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:28.218511    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 15:31:29.218355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:29.218322    2523 patch_prober.go:28] interesting pod/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 23 15:31:29.218804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:29.218780    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 23 15:31:30.222971 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:30.222940    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:30.224149 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:30.224129    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:38.082614 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.082579    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"]
Jul 23 15:31:38.083056 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.082997    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:31:38.083056 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.083016    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:31:38.083056 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.083028    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:31:38.083056 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.083036    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:31:38.083312 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.083192    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:31:38.086435 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.086417    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:38.088776 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.088748    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:31:38.088881 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.088817    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:31:38.092814 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.092783    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"]
Jul 23 15:31:38.238461 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.238421    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn\" (UID: \"003c81d3-2eb5-49ad-95c8-e3543c618c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:38.339023 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.338915    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn\" (UID: \"003c81d3-2eb5-49ad-95c8-e3543c618c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:38.339598 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.339569    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn\" (UID: \"003c81d3-2eb5-49ad-95c8-e3543c618c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:38.398049 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.398008    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:38.533217 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.533192    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"]
Jul 23 15:31:38.535265 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:31:38.535233    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003c81d3_2eb5_49ad_95c8_e3543c618c47.slice/crio-7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76 WatchSource:0}: Error finding container 7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76: Status 404 returned error can't find the container with id 7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76
Jul 23 15:31:38.931033 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.930993    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn" event={"ID":"003c81d3-2eb5-49ad-95c8-e3543c618c47","Type":"ContainerStarted","Data":"2c628ba96c3a22d03c718a02569246b74a857fca527cf4f409e8adccccd99d9d"}
Jul 23 15:31:38.931209 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.931084    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn" event={"ID":"003c81d3-2eb5-49ad-95c8-e3543c618c47","Type":"ContainerStarted","Data":"7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76"}
Jul 23 15:31:38.946336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:38.946270    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn" podStartSLOduration=0.946255358 podStartE2EDuration="946.255358ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:31:38.94582747 +0000 UTC m=+1873.240564948" watchObservedRunningTime="2026-07-23 15:31:38.946255358 +0000 UTC m=+1873.240992835"
Jul 23 15:31:39.937418 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:39.937380    2523 generic.go:356] "Generic (PLEG): container finished" podID="003c81d3-2eb5-49ad-95c8-e3543c618c47" containerID="2c628ba96c3a22d03c718a02569246b74a857fca527cf4f409e8adccccd99d9d" exitCode=0
Jul 23 15:31:39.937858 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:39.937470    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn" event={"ID":"003c81d3-2eb5-49ad-95c8-e3543c618c47","Type":"ContainerDied","Data":"2c628ba96c3a22d03c718a02569246b74a857fca527cf4f409e8adccccd99d9d"}
Jul 23 15:31:41.073570 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.073546    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:41.164642 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.164610    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca\") pod \"003c81d3-2eb5-49ad-95c8-e3543c618c47\" (UID: \"003c81d3-2eb5-49ad-95c8-e3543c618c47\") "
Jul 23 15:31:41.165144 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.165003    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "003c81d3-2eb5-49ad-95c8-e3543c618c47" (UID: "003c81d3-2eb5-49ad-95c8-e3543c618c47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:31:41.266206 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.266112    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/003c81d3-2eb5-49ad-95c8-e3543c618c47-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:41.948063 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.948032    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"
Jul 23 15:31:41.948267 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.948030    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn" event={"ID":"003c81d3-2eb5-49ad-95c8-e3543c618c47","Type":"ContainerDied","Data":"7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76"}
Jul 23 15:31:41.948267 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:41.948154    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b76d89ce3a8c75713e7ae3a96b1d28bd323e128040210b222f8b34a1a802a76"
Jul 23 15:31:51.319788 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:51.319689    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:31:53.197883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:53.197844    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"]
Jul 23 15:31:53.200032 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:53.200006    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ad9a66fd-f2mgn"]
Jul 23 15:31:53.305264 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:53.305230    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:31:53.305541 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:53.305516    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy" containerID="cri-o://c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0" gracePeriod=30
Jul 23 15:31:54.130985 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:54.130943    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="003c81d3-2eb5-49ad-95c8-e3543c618c47" path="/var/lib/kubelet/pods/003c81d3-2eb5-49ad-95c8-e3543c618c47/volumes"
Jul 23 15:31:58.573388 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.573319    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:58.621948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.621911    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.621948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.621948    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.621989    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx72f\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622013    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622067    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622091    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622134    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622263    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:58.622415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622340    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622415 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622372    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:58.622594 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622428    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token\") pod \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\" (UID: \"44810337-0f82-41ff-9cf3-ec0c5cdeb162\") "
Jul 23 15:31:58.622810 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622760    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.622810 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622786    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.622993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622888    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:58.622993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.622968    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:31:58.623399 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.623374    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data" (OuterVolumeSpecName: "istio-data") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:58.624656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.624621    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:31:58.624656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.624640    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:31:58.624940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.624920    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f" (OuterVolumeSpecName: "kube-api-access-zx72f") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "kube-api-access-zx72f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:58.624982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.624935    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token" (OuterVolumeSpecName: "istio-token") pod "44810337-0f82-41ff-9cf3-ec0c5cdeb162" (UID: "44810337-0f82-41ff-9cf3-ec0c5cdeb162"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:31:58.723247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723202    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723239    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723247 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723249    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx72f\" (UniqueName: \"kubernetes.io/projected/44810337-0f82-41ff-9cf3-ec0c5cdeb162-kube-api-access-zx72f\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723262    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723275    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723283    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44810337-0f82-41ff-9cf3-ec0c5cdeb162-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:58.723593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:58.723292    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44810337-0f82-41ff-9cf3-ec0c5cdeb162-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:31:59.025095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.025060    2523 generic.go:356] "Generic (PLEG): container finished" podID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerID="c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0" exitCode=0
Jul 23 15:31:59.025269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.025116    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"
Jul 23 15:31:59.025269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.025127    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerDied","Data":"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"}
Jul 23 15:31:59.025269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.025213    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc" event={"ID":"44810337-0f82-41ff-9cf3-ec0c5cdeb162","Type":"ContainerDied","Data":"79e2217d35c15a12e009da9e40a32aa3a7a585844b7f5c7636a4c252c567caa6"}
Jul 23 15:31:59.025269 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.025242    2523 scope.go:117] "RemoveContainer" containerID="c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"
Jul 23 15:31:59.034682 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.034657    2523 scope.go:117] "RemoveContainer" containerID="755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"
Jul 23 15:31:59.042839 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.042820    2523 scope.go:117] "RemoveContainer" containerID="c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"
Jul 23 15:31:59.043163 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:31:59.043141    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0\": container with ID starting with c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0 not found: ID does not exist" containerID="c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"
Jul 23 15:31:59.043213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.043173    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0"} err="failed to get container status \"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0\": rpc error: code = NotFound desc = could not find container \"c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0\": container with ID starting with c0e9c1df6d6b9813d79215f5553a9f11e23e432997992494a717fa4837e4b7e0 not found: ID does not exist"
Jul 23 15:31:59.043213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.043192    2523 scope.go:117] "RemoveContainer" containerID="755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"
Jul 23 15:31:59.043443 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:31:59.043425    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef\": container with ID starting with 755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef not found: ID does not exist" containerID="755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"
Jul 23 15:31:59.043527 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.043453    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef"} err="failed to get container status \"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef\": rpc error: code = NotFound desc = could not find container \"755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef\": container with ID starting with 755c9501112541a2ac0f10eb9d0c9e347dc452acfa1d618ae0fd24c4a87013ef not found: ID does not exist"
Jul 23 15:31:59.046384 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.046362    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:31:59.050560 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:31:59.050537    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ad9a66fd-openshift-default-6b7cc4888c-77mnc"]
Jul 23 15:32:00.132649 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:32:00.132618    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" path="/var/lib/kubelet/pods/44810337-0f82-41ff-9cf3-ec0c5cdeb162/volumes"
Jul 23 15:33:25.030320 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:25.030236    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:33:37.032162 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:37.032119    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:33:38.817253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817217    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:33:38.817761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817694    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:38.817761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817712    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:38.817761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817745    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003c81d3-2eb5-49ad-95c8-e3543c618c47" containerName="revoke-keys"
Jul 23 15:33:38.817761 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817752    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="003c81d3-2eb5-49ad-95c8-e3543c618c47" containerName="revoke-keys"
Jul 23 15:33:38.817975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817839    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="003c81d3-2eb5-49ad-95c8-e3543c618c47" containerName="revoke-keys"
Jul 23 15:33:38.817975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817855    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:38.817975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817866    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:38.817975 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.817874    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ce5ed9-04a9-48cd-a893-8ffbcfce01b2" containerName="istio-proxy"
Jul 23 15:33:38.820910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.820887    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.823645 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.823621    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9a77be01-openshift-default-dockercfg-2qlv4\""
Jul 23 15:33:38.843002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.842971    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:33:38.906085 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906049    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906085 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906085    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906122    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906225    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906259    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906285    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906346    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mb6\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906671 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906373    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:38.906671 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:38.906392    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007144 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007106    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007182    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007230    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007257    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007309    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mb6\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007339    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007368    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007402    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007425    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007658    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007822    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.007889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007871    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.008004 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.007955    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.008330 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.008300    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.009916 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.009885    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.010006 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.009917    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.015424 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.015404    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.016153 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.016132    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mb6\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6\") pod \"e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") " pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.133268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.133163    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:39.282136 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.282103    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:33:39.287041 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:33:39.287014    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec06b1f6_7de1_463b_91b4_62b012c054b6.slice/crio-1a0d2c02830cc8b5d8082171bdc7f62cb68a4e245b6b053fc2207f6552d3d17a WatchSource:0}: Error finding container 1a0d2c02830cc8b5d8082171bdc7f62cb68a4e245b6b053fc2207f6552d3d17a: Status 404 returned error can't find the container with id 1a0d2c02830cc8b5d8082171bdc7f62cb68a4e245b6b053fc2207f6552d3d17a
Jul 23 15:33:39.289605 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.289571    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:39.289700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.289647    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:39.289700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.289685    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:39.500251 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.500162    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerStarted","Data":"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"}
Jul 23 15:33:39.500251 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.500231    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerStarted","Data":"1a0d2c02830cc8b5d8082171bdc7f62cb68a4e245b6b053fc2207f6552d3d17a"}
Jul 23 15:33:39.522261 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:39.522204    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podStartSLOduration=1.5221884270000001 podStartE2EDuration="1.522188427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:33:39.521262766 +0000 UTC m=+1993.816000245" watchObservedRunningTime="2026-07-23 15:33:39.522188427 +0000 UTC m=+1993.816925905"
Jul 23 15:33:40.133358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:40.133328    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:40.138275 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:40.138254    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:40.504438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:40.504342    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:40.505477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:40.505456    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:33:49.029837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:49.029802    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:33:53.779030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.778993    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"]
Jul 23 15:33:53.779459 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.779327    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:53.779459 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.779338    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="44810337-0f82-41ff-9cf3-ec0c5cdeb162" containerName="istio-proxy"
Jul 23 15:33:53.782579 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.782562    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:53.785025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.785002    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:33:53.785155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.785095    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:33:53.790001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.789977    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"]
Jul 23 15:33:53.940253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:53.940210    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j\" (UID: \"91d1463d-2edc-4ea0-b8c2-e3700d35f52c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:54.041083 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:54.040981    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j\" (UID: \"91d1463d-2edc-4ea0-b8c2-e3700d35f52c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:54.041682 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:54.041664    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j\" (UID: \"91d1463d-2edc-4ea0-b8c2-e3700d35f52c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:54.095830 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:54.095792    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:54.267391 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:54.267361    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"]
Jul 23 15:33:54.568176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:54.568139    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j" event={"ID":"91d1463d-2edc-4ea0-b8c2-e3700d35f52c","Type":"ContainerStarted","Data":"9f7171dbaa495172557fbce022018c4e57774a74507d645c0ef5c0d8be75ee32"}
Jul 23 15:33:55.575428 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:55.575394    2523 generic.go:356] "Generic (PLEG): container finished" podID="91d1463d-2edc-4ea0-b8c2-e3700d35f52c" containerID="0ae4939e6804f165768d603b3cb2f30719510333d85a3989aee8336431777f7d" exitCode=0
Jul 23 15:33:55.575931 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:55.575446    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j" event={"ID":"91d1463d-2edc-4ea0-b8c2-e3700d35f52c","Type":"ContainerDied","Data":"0ae4939e6804f165768d603b3cb2f30719510333d85a3989aee8336431777f7d"}
Jul 23 15:33:56.505229 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.505184    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 15:33:56.505507 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.505245    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 15:33:56.711949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.711922    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:56.867749 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.867713    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca\") pod \"91d1463d-2edc-4ea0-b8c2-e3700d35f52c\" (UID: \"91d1463d-2edc-4ea0-b8c2-e3700d35f52c\") "
Jul 23 15:33:56.868202 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.868170    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91d1463d-2edc-4ea0-b8c2-e3700d35f52c" (UID: "91d1463d-2edc-4ea0-b8c2-e3700d35f52c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:33:56.968706 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:56.968666    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91d1463d-2edc-4ea0-b8c2-e3700d35f52c-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:33:57.587055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:57.587020    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j" event={"ID":"91d1463d-2edc-4ea0-b8c2-e3700d35f52c","Type":"ContainerDied","Data":"9f7171dbaa495172557fbce022018c4e57774a74507d645c0ef5c0d8be75ee32"}
Jul 23 15:33:57.587055 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:57.587043    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"
Jul 23 15:33:57.587276 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:57.587070    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f7171dbaa495172557fbce022018c4e57774a74507d645c0ef5c0d8be75ee32"
Jul 23 15:33:58.592730 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.592698    2523 generic.go:356] "Generic (PLEG): container finished" podID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerID="fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b" exitCode=0
Jul 23 15:33:58.592730 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.592733    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerDied","Data":"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"}
Jul 23 15:33:58.593202 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.593094    2523 scope.go:117] "RemoveContainer" containerID="fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"
Jul 23 15:33:58.594072 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.594043    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:58.594145 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.594128    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:58.594187 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:58.594175    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:33:59.604639 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:33:59.604599    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerStarted","Data":"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"}
Jul 23 15:34:00.134097 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:00.134069    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:00.134339 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:00.134318    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 23 15:34:00.134387 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:00.134367    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 23 15:34:01.134504 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:01.134450    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 23 15:34:01.134888 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:01.134535    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 23 15:34:02.134523 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:02.134472    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 23 15:34:02.134936 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:02.134556    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 23 15:34:03.134053 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:03.134011    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 23 15:34:03.134235 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:03.134073    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 23 15:34:04.137627 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:04.137557    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:04.138109 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:04.137919    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:04.139074 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:04.139054    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:06.823262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:06.823228    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:34:08.860066 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:08.860009    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"]
Jul 23 15:34:08.862014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:08.861989    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9a77be01-6nd9j"]
Jul 23 15:34:10.131760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:10.131727    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d1463d-2edc-4ea0-b8c2-e3700d35f52c" path="/var/lib/kubelet/pods/91d1463d-2edc-4ea0-b8c2-e3700d35f52c/volumes"
Jul 23 15:34:15.633655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:15.633619    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:34:15.634086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:15.633883    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" containerID="cri-o://d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9" gracePeriod=30
Jul 23 15:34:19.139694 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:19.139656    2523 patch_prober.go:28] interesting pod/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 15:34:19.140080 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:19.139711    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 15:34:20.891919 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.891896    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:20.980767 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980676    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.980767 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980730    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.980767 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980751    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980777    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980801    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980820    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4mb6\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980850    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980903    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.980949    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket\") pod \"ec06b1f6-7de1-463b-91b4-62b012c054b6\" (UID: \"ec06b1f6-7de1-463b-91b4-62b012c054b6\") "
Jul 23 15:34:20.981039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981005    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:34:20.981417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981121    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:34:20.981417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981265    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:20.981417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981282    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:20.981598 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981459    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:34:20.981651 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981599    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:34:20.981795 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.981772    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:34:20.983017 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.982987    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:34:20.983148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.983023    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6" (OuterVolumeSpecName: "kube-api-access-q4mb6") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "kube-api-access-q4mb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:34:20.983332 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.983306    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:34:20.983436 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:20.983376    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec06b1f6-7de1-463b-91b4-62b012c054b6" (UID: "ec06b1f6-7de1-463b-91b4-62b012c054b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:34:21.082255 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082217    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082255 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082245    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082255 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082255    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4mb6\" (UniqueName: \"kubernetes.io/projected/ec06b1f6-7de1-463b-91b4-62b012c054b6-kube-api-access-q4mb6\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082255 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082264    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082557 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082272    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec06b1f6-7de1-463b-91b4-62b012c054b6-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082557 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082280    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec06b1f6-7de1-463b-91b4-62b012c054b6-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.082557 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.082289    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec06b1f6-7de1-463b-91b4-62b012c054b6-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:34:21.709438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.709399    2523 generic.go:356] "Generic (PLEG): container finished" podID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerID="d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9" exitCode=0
Jul 23 15:34:21.709621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.709454    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"
Jul 23 15:34:21.709621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.709470    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerDied","Data":"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"}
Jul 23 15:34:21.709621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.709545    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq" event={"ID":"ec06b1f6-7de1-463b-91b4-62b012c054b6","Type":"ContainerDied","Data":"1a0d2c02830cc8b5d8082171bdc7f62cb68a4e245b6b053fc2207f6552d3d17a"}
Jul 23 15:34:21.709621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.709575    2523 scope.go:117] "RemoveContainer" containerID="d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"
Jul 23 15:34:21.718311 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.718292    2523 scope.go:117] "RemoveContainer" containerID="fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"
Jul 23 15:34:21.726309 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.726288    2523 scope.go:117] "RemoveContainer" containerID="d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"
Jul 23 15:34:21.726622 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:34:21.726603    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9\": container with ID starting with d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9 not found: ID does not exist" containerID="d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"
Jul 23 15:34:21.726678 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.726632    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9"} err="failed to get container status \"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9\": rpc error: code = NotFound desc = could not find container \"d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9\": container with ID starting with d12964c9ac18d20b947da0a36f5febeeb23bd3420b465a2156ee5056ac2784a9 not found: ID does not exist"
Jul 23 15:34:21.726678 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.726650    2523 scope.go:117] "RemoveContainer" containerID="fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"
Jul 23 15:34:21.726906 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:34:21.726888    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b\": container with ID starting with fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b not found: ID does not exist" containerID="fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"
Jul 23 15:34:21.726970 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.726915    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b"} err="failed to get container status \"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b\": rpc error: code = NotFound desc = could not find container \"fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b\": container with ID starting with fa7112b03e984405e3810354bd38fef9495e12497aba7c36495c2a4dfe4a219b not found: ID does not exist"
Jul 23 15:34:21.730952 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.730931    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:34:21.737019 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:21.736995    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9a77be01-openshift-default-6f9b6df555-9scjq"]
Jul 23 15:34:22.136197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:22.131897    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" path="/var/lib/kubelet/pods/ec06b1f6-7de1-463b-91b4-62b012c054b6/volumes"
Jul 23 15:34:35.609826 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.609793    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610096    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610108    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610119    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610124    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610133    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d1463d-2edc-4ea0-b8c2-e3700d35f52c" containerName="revoke-keys"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610139    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d1463d-2edc-4ea0-b8c2-e3700d35f52c" containerName="revoke-keys"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610192    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:35.610397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.610199    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d1463d-2edc-4ea0-b8c2-e3700d35f52c" containerName="revoke-keys"
Jul 23 15:34:35.613119 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.613099    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.615541 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.615518    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cafd77c7-openshift-default-dockercfg-jfl4m\""
Jul 23 15:34:35.625732 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.625702    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:34:35.717204 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717163    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717426 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717276    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717426 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717313    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717426 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717347    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qv2v\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717426 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717378    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717481    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717546    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717581    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.717701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.717629    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818252    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818288 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818295    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818315    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818353    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818391    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818440    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818460    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818527    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qv2v\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818567    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818978 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818790    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.818978 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.818834    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.819184 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.819160    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.819267 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.819247    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.819315 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.819272    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.820821 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.820791    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.821060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.821040    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.828989 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.828962    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qv2v\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.830377 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.830354    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token\") pod \"e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") " pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:35.925729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:35.925635    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:36.056909 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.056875    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:34:36.059365 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:34:36.059339    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8165696_a720_4ccf_a504_77d6679ca741.slice/crio-c5fff87699f07ac4d98d3ef4bf9e0661ccc297108544693062fdf26e52a20187 WatchSource:0}: Error finding container c5fff87699f07ac4d98d3ef4bf9e0661ccc297108544693062fdf26e52a20187: Status 404 returned error can't find the container with id c5fff87699f07ac4d98d3ef4bf9e0661ccc297108544693062fdf26e52a20187
Jul 23 15:34:36.061394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.061362    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:36.061544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.061437    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:36.061544 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.061482    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:36.779990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.779953    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerStarted","Data":"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"}
Jul 23 15:34:36.780379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.780011    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerStarted","Data":"c5fff87699f07ac4d98d3ef4bf9e0661ccc297108544693062fdf26e52a20187"}
Jul 23 15:34:36.801471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.801417    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podStartSLOduration=1.801402651 podStartE2EDuration="1.801402651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:34:36.799518569 +0000 UTC m=+2051.094256049" watchObservedRunningTime="2026-07-23 15:34:36.801402651 +0000 UTC m=+2051.096140129"
Jul 23 15:34:36.926400 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:36.926369    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:37.931155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:37.931128    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:38.788535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:38.788504    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:38.789338 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:38.789317    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:45.735954 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:45.735922    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:34:53.789914 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.789881    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 23 15:34:53.790309 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.789945    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 23 15:34:53.865984 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.865903    2523 generic.go:356] "Generic (PLEG): container finished" podID="b8165696-a720-4ccf-a504-77d6679ca741" containerID="1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8" exitCode=0
Jul 23 15:34:53.865984 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.865952    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerDied","Data":"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"}
Jul 23 15:34:53.866343 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.866329    2523 scope.go:117] "RemoveContainer" containerID="1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"
Jul 23 15:34:53.867317 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.867291    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:53.867420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.867355    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:53.867420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:53.867392    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:34:54.872469 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:54.872422    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerStarted","Data":"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"}
Jul 23 15:34:54.926667 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:54.926624    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:54.926932 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:54.926908    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 23 15:34:54.926982 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:54.926962    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 23 15:34:55.926902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:55.926862    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 23 15:34:55.927331 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:55.926921    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 23 15:34:56.920516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.913887    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:34:56.920516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.914467    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec06b1f6-7de1-463b-91b4-62b012c054b6" containerName="istio-proxy"
Jul 23 15:34:56.921278 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.921254    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:56.924784 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.924756    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cafd77c7\"/\"openshift-service-ca.crt\""
Jul 23 15:34:56.924900 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.924802    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cafd77c7\"/\"kube-root-ca.crt\""
Jul 23 15:34:56.924900 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.924802    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cafd77c7\"/\"default-dockercfg-b2t8m\""
Jul 23 15:34:56.924900 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.924756    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cafd77c7\"/\"e2e-lifecycle-model-cafd77c7-kserve-self-signed-certs\""
Jul 23 15:34:56.926266 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.926244    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 23 15:34:56.926327 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.926308    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 23 15:34:56.930360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:56.930339    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:34:57.011014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.010946    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.011014 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.011028    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.011337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.011072    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.011337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.011116    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.011337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.011176    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.011337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.011229    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6dr\" (UniqueName: \"kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.112122 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.112084    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.112882 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.112860    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.113355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.113337    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.113947 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.113929    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.114092 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.112794    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.114245 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.114230    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.114438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.113272    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.114826 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.114611    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.115008 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.114990    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6dr\" (UniqueName: \"kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.116623 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.116594    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.116959 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.116940    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.122742 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.122710    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6dr\" (UniqueName: \"kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr\") pod \"e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") " pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.232233 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.232130    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:34:57.378992 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.378969    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:34:57.381164 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:34:57.381137    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5928a29_0d13_488b_8dbf_6877c0ed6897.slice/crio-3c55a62fded33ae93cef1717a8cfc6ffb65bcb0bf185410b8aed1f036b4b5f80 WatchSource:0}: Error finding container 3c55a62fded33ae93cef1717a8cfc6ffb65bcb0bf185410b8aed1f036b4b5f80: Status 404 returned error can't find the container with id 3c55a62fded33ae93cef1717a8cfc6ffb65bcb0bf185410b8aed1f036b4b5f80
Jul 23 15:34:57.888401 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.888357    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" event={"ID":"e5928a29-0d13-488b-8dbf-6877c0ed6897","Type":"ContainerStarted","Data":"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"}
Jul 23 15:34:57.888401 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.888396    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" event={"ID":"e5928a29-0d13-488b-8dbf-6877c0ed6897","Type":"ContainerStarted","Data":"3c55a62fded33ae93cef1717a8cfc6ffb65bcb0bf185410b8aed1f036b4b5f80"}
Jul 23 15:34:57.908282 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.908214    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" podStartSLOduration=1.908191961 podStartE2EDuration="1.908191961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:34:57.906184178 +0000 UTC m=+2072.200921656" watchObservedRunningTime="2026-07-23 15:34:57.908191961 +0000 UTC m=+2072.202929440"
Jul 23 15:34:57.926115 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.926080    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 23 15:34:57.926270 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:57.926132    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 23 15:34:58.929808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:58.929772    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:58.930186 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:58.930033    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:34:58.930876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:34:58.930857    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:35:00.131793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:00.131761    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:35:07.232923 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:07.232884    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:35:07.233392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:07.232941    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:35:07.245387 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:07.245362    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:35:07.945566 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:07.945538    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:35:13.232189 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:13.232150    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:35:16.764951 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.764910    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"]
Jul 23 15:35:16.767477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.767453    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:16.769775 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.769750    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:35:16.769877 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.769846    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:35:16.775212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.775181    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"]
Jul 23 15:35:16.893774 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.893730    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd\" (UID: \"57bc1aea-4203-4437-b3e0-131ccd042a9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:16.995083 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.995052    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd\" (UID: \"57bc1aea-4203-4437-b3e0-131ccd042a9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:16.995718 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:16.995698    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd\" (UID: \"57bc1aea-4203-4437-b3e0-131ccd042a9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:17.079032 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:17.079004    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:17.208841 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:17.208802    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"]
Jul 23 15:35:17.211008 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:35:17.210979    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bc1aea_4203_4437_b3e0_131ccd042a9d.slice/crio-6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d WatchSource:0}: Error finding container 6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d: Status 404 returned error can't find the container with id 6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d
Jul 23 15:35:17.984558 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:17.984523    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd" event={"ID":"57bc1aea-4203-4437-b3e0-131ccd042a9d","Type":"ContainerStarted","Data":"83f50a80049e90afddc995df4af2c27888f3e6e87adc854bb3d8a6c8f19560b1"}
Jul 23 15:35:17.984950 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:17.984577    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd" event={"ID":"57bc1aea-4203-4437-b3e0-131ccd042a9d","Type":"ContainerStarted","Data":"6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d"}
Jul 23 15:35:18.000990 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:18.000949    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd" podStartSLOduration=2.000934378 podStartE2EDuration="2.000934378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:35:18.000252125 +0000 UTC m=+2092.294989623" watchObservedRunningTime="2026-07-23 15:35:18.000934378 +0000 UTC m=+2092.295671853"
Jul 23 15:35:18.990250 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:18.990215    2523 generic.go:356] "Generic (PLEG): container finished" podID="57bc1aea-4203-4437-b3e0-131ccd042a9d" containerID="83f50a80049e90afddc995df4af2c27888f3e6e87adc854bb3d8a6c8f19560b1" exitCode=0
Jul 23 15:35:18.990663 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:18.990271    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd" event={"ID":"57bc1aea-4203-4437-b3e0-131ccd042a9d","Type":"ContainerDied","Data":"83f50a80049e90afddc995df4af2c27888f3e6e87adc854bb3d8a6c8f19560b1"}
Jul 23 15:35:20.124276 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:20.124249    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:20.224358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:20.224328    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca\") pod \"57bc1aea-4203-4437-b3e0-131ccd042a9d\" (UID: \"57bc1aea-4203-4437-b3e0-131ccd042a9d\") "
Jul 23 15:35:20.224769 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:20.224748    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57bc1aea-4203-4437-b3e0-131ccd042a9d" (UID: "57bc1aea-4203-4437-b3e0-131ccd042a9d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:35:20.325889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:20.325859    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bc1aea-4203-4437-b3e0-131ccd042a9d-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:21.000347 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:21.000311    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd" event={"ID":"57bc1aea-4203-4437-b3e0-131ccd042a9d","Type":"ContainerDied","Data":"6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d"}
Jul 23 15:35:21.000558 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:21.000362    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b5996909baac09d73e2227abb5ea35565b96a0520b3bfa1f2970ce08649c07d"
Jul 23 15:35:21.000558 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:21.000324    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"
Jul 23 15:35:30.920153 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:30.920119    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:35:36.848483 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:36.848434    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"]
Jul 23 15:35:36.850999 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:36.850972    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-cafd77c7-wm2qd"]
Jul 23 15:35:38.131426 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:38.131392    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57bc1aea-4203-4437-b3e0-131ccd042a9d" path="/var/lib/kubelet/pods/57bc1aea-4203-4437-b3e0-131ccd042a9d/volumes"
Jul 23 15:35:41.125315 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:41.125281    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:35:44.166892 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:44.166861    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:35:59.188896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.188827    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" podUID="e5928a29-0d13-488b-8dbf-6877c0ed6897" containerName="main" containerID="cri-o://4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207" gracePeriod=45
Jul 23 15:35:59.425071 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.425044    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:35:59.561672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.560943    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.561672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561394    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.561672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561535    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.561672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561657    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.562026 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561690    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.562026 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561702    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:35:59.562026 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.561721    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz6dr\" (UniqueName: \"kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr\") pod \"e5928a29-0d13-488b-8dbf-6877c0ed6897\" (UID: \"e5928a29-0d13-488b-8dbf-6877c0ed6897\") "
Jul 23 15:35:59.562472 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.562166    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-tmp-dir\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:59.564414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.564385    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:35:59.564630 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.564610    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache" (OuterVolumeSpecName: "model-cache") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:35:59.564804 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.564787    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home" (OuterVolumeSpecName: "home") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:35:59.567535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.565176    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm" (OuterVolumeSpecName: "dshm") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:35:59.567535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.565563    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr" (OuterVolumeSpecName: "kube-api-access-qz6dr") pod "e5928a29-0d13-488b-8dbf-6877c0ed6897" (UID: "e5928a29-0d13-488b-8dbf-6877c0ed6897"). InnerVolumeSpecName "kube-api-access-qz6dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:35:59.663287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.663254    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-model-cache\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:59.663287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.663282    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5928a29-0d13-488b-8dbf-6877c0ed6897-tls-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:59.663287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.663290    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-home\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:59.663539 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.663301    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz6dr\" (UniqueName: \"kubernetes.io/projected/e5928a29-0d13-488b-8dbf-6877c0ed6897-kube-api-access-qz6dr\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:35:59.663539 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:35:59.663311    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5928a29-0d13-488b-8dbf-6877c0ed6897-dshm\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:00.180153 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.180116    2523 generic.go:356] "Generic (PLEG): container finished" podID="e5928a29-0d13-488b-8dbf-6877c0ed6897" containerID="4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207" exitCode=0
Jul 23 15:36:00.180334 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.180177    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"
Jul 23 15:36:00.180334 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.180195    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" event={"ID":"e5928a29-0d13-488b-8dbf-6877c0ed6897","Type":"ContainerDied","Data":"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"}
Jul 23 15:36:00.180334 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.180248    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq" event={"ID":"e5928a29-0d13-488b-8dbf-6877c0ed6897","Type":"ContainerDied","Data":"3c55a62fded33ae93cef1717a8cfc6ffb65bcb0bf185410b8aed1f036b4b5f80"}
Jul 23 15:36:00.180334 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.180266    2523 scope.go:117] "RemoveContainer" containerID="4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"
Jul 23 15:36:00.188895 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.188876    2523 scope.go:117] "RemoveContainer" containerID="4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"
Jul 23 15:36:00.189166 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:36:00.189148    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207\": container with ID starting with 4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207 not found: ID does not exist" containerID="4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"
Jul 23 15:36:00.189419 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.189174    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207"} err="failed to get container status \"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207\": rpc error: code = NotFound desc = could not find container \"4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207\": container with ID starting with 4a2f7bc86632036e552371fc30775fd116515b8b141b4bc7fdcf231127169207 not found: ID does not exist"
Jul 23 15:36:00.197882 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.197853    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:36:00.203915 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:00.203894    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cafd77c7/e2e-lifecycle-model-cafd77c7-kserve-688d67c49f-cl4tq"]
Jul 23 15:36:02.131468 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:02.131433    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5928a29-0d13-488b-8dbf-6877c0ed6897" path="/var/lib/kubelet/pods/e5928a29-0d13-488b-8dbf-6877c0ed6897/volumes"
Jul 23 15:36:26.275047 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:26.274971    2523 scope.go:117] "RemoveContainer" containerID="627e641c062c8c2e7a7e548320e2b12fad333733036574b761ebb7b49f2c40a2"
Jul 23 15:36:26.282658 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:26.282640    2523 scope.go:117] "RemoveContainer" containerID="e4caf6cfe57e539bb46bf78a45eaf5d68f85774301cf3bfd2b5f553d9d98d7b0"
Jul 23 15:36:26.291030 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:26.291006    2523 scope.go:117] "RemoveContainer" containerID="41e39452b52db3b7df4f2f8f5fce32e63871a4442e22cfb15fc4a7b69a493c1c"
Jul 23 15:36:27.507941 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:27.507890    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:36:27.508411 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:27.508126    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" containerID="cri-o://45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5" gracePeriod=30
Jul 23 15:36:28.933156 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:28.933109    2523 patch_prober.go:28] interesting pod/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 15:36:28.933616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:28.933177    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 15:36:31.036736 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:31.036703    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:36:32.773594 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.773573    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:36:32.859226 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859184    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859252    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859307    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859345    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859610 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859411    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qv2v\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859610 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859433    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:36:32.859610 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859449    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859785 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859621    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859785 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859657    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859785 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859684    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data\") pod \"b8165696-a720-4ccf-a504-77d6679ca741\" (UID: \"b8165696-a720-4ccf-a504-77d6679ca741\") "
Jul 23 15:36:32.859785 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859713    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:36:32.860001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859796    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:36:32.860001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859892    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:36:32.860001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.859984    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.860001 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.860000    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.860211 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.860014    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8165696-a720-4ccf-a504-77d6679ca741-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.860211 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.860026    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.860509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.860460    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:36:32.861686 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.861662    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v" (OuterVolumeSpecName: "kube-api-access-8qv2v") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "kube-api-access-8qv2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:36:32.861937 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.861898    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:36:32.862039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.862002    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:36:32.862133 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.862115    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8165696-a720-4ccf-a504-77d6679ca741" (UID: "b8165696-a720-4ccf-a504-77d6679ca741"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:36:32.960910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.960871    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8165696-a720-4ccf-a504-77d6679ca741-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.960910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.960898    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.960910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.960908    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8165696-a720-4ccf-a504-77d6679ca741-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.960910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.960918    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:32.960910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:32.960926    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qv2v\" (UniqueName: \"kubernetes.io/projected/b8165696-a720-4ccf-a504-77d6679ca741-kube-api-access-8qv2v\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:36:33.348676 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.348643    2523 generic.go:356] "Generic (PLEG): container finished" podID="b8165696-a720-4ccf-a504-77d6679ca741" containerID="45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5" exitCode=0
Jul 23 15:36:33.348847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.348702    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"
Jul 23 15:36:33.348847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.348699    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerDied","Data":"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"}
Jul 23 15:36:33.348847 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.348829    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm" event={"ID":"b8165696-a720-4ccf-a504-77d6679ca741","Type":"ContainerDied","Data":"c5fff87699f07ac4d98d3ef4bf9e0661ccc297108544693062fdf26e52a20187"}
Jul 23 15:36:33.348951 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.348851    2523 scope.go:117] "RemoveContainer" containerID="45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"
Jul 23 15:36:33.358303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.358285    2523 scope.go:117] "RemoveContainer" containerID="1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"
Jul 23 15:36:33.365756 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.365738    2523 scope.go:117] "RemoveContainer" containerID="45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"
Jul 23 15:36:33.366000 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:36:33.365980    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5\": container with ID starting with 45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5 not found: ID does not exist" containerID="45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"
Jul 23 15:36:33.366046 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.366009    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5"} err="failed to get container status \"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5\": rpc error: code = NotFound desc = could not find container \"45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5\": container with ID starting with 45e4ca9eb1551d6049dc79fe7c8d9a515c571df3d545124dbf9820cf6038b3a5 not found: ID does not exist"
Jul 23 15:36:33.366046 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.366027    2523 scope.go:117] "RemoveContainer" containerID="1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"
Jul 23 15:36:33.366269 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:36:33.366252    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8\": container with ID starting with 1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8 not found: ID does not exist" containerID="1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"
Jul 23 15:36:33.366321 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.366271    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8"} err="failed to get container status \"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8\": rpc error: code = NotFound desc = could not find container \"1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8\": container with ID starting with 1c55bceb5b1a45f41926fb350b397988daf833f46e246787968ee5c76a48b6e8 not found: ID does not exist"
Jul 23 15:36:33.376132 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.372806    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:36:33.376132 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:33.376023    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cafd77c7-openshift-default-675c65b959-zd5bm"]
Jul 23 15:36:34.131177 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:34.131136    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8165696-a720-4ccf-a504-77d6679ca741" path="/var/lib/kubelet/pods/b8165696-a720-4ccf-a504-77d6679ca741/volumes"
Jul 23 15:36:40.420385 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:36:40.420352    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:37:23.485052 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485018    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485438    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bc1aea-4203-4437-b3e0-131ccd042a9d" containerName="revoke-keys"
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485452    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bc1aea-4203-4437-b3e0-131ccd042a9d" containerName="revoke-keys"
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485480    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485504    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485516    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5928a29-0d13-488b-8dbf-6877c0ed6897" containerName="main"
Jul 23 15:37:23.485529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485524    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5928a29-0d13-488b-8dbf-6877c0ed6897" containerName="main"
Jul 23 15:37:23.485735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485598    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5928a29-0d13-488b-8dbf-6877c0ed6897" containerName="main"
Jul 23 15:37:23.485735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485610    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:23.485735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485619    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:23.485735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.485629    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bc1aea-4203-4437-b3e0-131ccd042a9d" containerName="revoke-keys"
Jul 23 15:37:23.489033 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.489013    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.491543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.491481    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-80ba32-openshift-default-dockercfg-b5psg\""
Jul 23 15:37:23.499609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.499574    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:37:23.604251 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604217    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604251 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604256    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82j54\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604291    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604311    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604334    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604350    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604379    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604422    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.604556 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.604445    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.710939 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.710900    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711144 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.710954    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711216 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711141    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711216 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711180    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711314 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711219    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711314 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711260    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711314 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711288    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711463 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711344    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711463 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711378    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82j54\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711476    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711581    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711862    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.711955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.711870    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.712151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.712129    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.713627 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.713589    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.714151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.714128    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.720036 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.720008    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.721793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.721771    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82j54\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54\") pod \"e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") " pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.800102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.800070    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:23.933475 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.933445    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:37:23.936195 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:37:23.936172    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b9d85a_5910_46eb_b8bd_d8075022054e.slice/crio-f27288de699f2f97e417f297f174308abd58d985557eba21fe365e8d7d75405a WatchSource:0}: Error finding container f27288de699f2f97e417f297f174308abd58d985557eba21fe365e8d7d75405a: Status 404 returned error can't find the container with id f27288de699f2f97e417f297f174308abd58d985557eba21fe365e8d7d75405a
Jul 23 15:37:23.938283 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.938249    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:23.938386 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.938341    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:23.938449 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:23.938385    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:24.586889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:24.586847    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerStarted","Data":"fe9a820ce7a987d3090955bef59d803166980de8990982ebf92953e22b9b3fe4"}
Jul 23 15:37:24.587296 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:24.586907    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerStarted","Data":"f27288de699f2f97e417f297f174308abd58d985557eba21fe365e8d7d75405a"}
Jul 23 15:37:24.606018 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:24.605969    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podStartSLOduration=1.605955037 podStartE2EDuration="1.605955037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:37:24.60521814 +0000 UTC m=+2218.899955619" watchObservedRunningTime="2026-07-23 15:37:24.605955037 +0000 UTC m=+2218.900692527"
Jul 23 15:37:24.801060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:24.801021    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:24.805915 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:24.805886    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:25.592124 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:25.592082    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:25.592957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:25.592940    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:26.324437 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:26.324403    2523 scope.go:117] "RemoveContainer" containerID="109e12c712709cc200415a157b65860a2b7a12878972c6842d3ca9d0d5a2b615"
Jul 23 15:37:31.455578 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.455541    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:37:31.787593 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.787562    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:37:31.787889 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.787876    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:31.787955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.787890    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8165696-a720-4ccf-a504-77d6679ca741" containerName="istio-proxy"
Jul 23 15:37:31.791042 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.791022    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.793315 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.793293    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-979b59-openshift-default-dockercfg-df7j8\""
Jul 23 15:37:31.801764 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.801718    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:37:31.890888 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.890851    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvk8\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.890888 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.890893    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.890919    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891012    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891050    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891096    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891159 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891157    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891198    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.891420 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.891251    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992018 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.991980    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992029    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992061    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992084    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992121    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992174    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992213 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992209    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992245    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992307    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvk8\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992447    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992477    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992777 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992757    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.992921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992889    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.993053 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.992959    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.995244 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.995205    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:31.995471 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:31.995449    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:32.000482 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.000461    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvk8\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:32.000641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.000619    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token\") pod \"e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") " pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:32.101830 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.101746    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:32.248097 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.248065    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:37:32.249989 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:37:32.249949    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9502aafc_0976_44c0_b72a_6717cbbf02da.slice/crio-2116db53ba44f0264abef1c768e1c11c283413c2bdee7e8e57ae459c4c768352 WatchSource:0}: Error finding container 2116db53ba44f0264abef1c768e1c11c283413c2bdee7e8e57ae459c4c768352: Status 404 returned error can't find the container with id 2116db53ba44f0264abef1c768e1c11c283413c2bdee7e8e57ae459c4c768352
Jul 23 15:37:32.252542 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.252475    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:32.252672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.252571    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:32.252672 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.252604    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:32.631501 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.631458    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerStarted","Data":"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"}
Jul 23 15:37:32.632009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.631538    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerStarted","Data":"2116db53ba44f0264abef1c768e1c11c283413c2bdee7e8e57ae459c4c768352"}
Jul 23 15:37:32.652406 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:32.652352    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podStartSLOduration=1.6523359549999999 podStartE2EDuration="1.652335955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:37:32.651311923 +0000 UTC m=+2226.946049403" watchObservedRunningTime="2026-07-23 15:37:32.652335955 +0000 UTC m=+2226.947073433"
Jul 23 15:37:33.102509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:33.102407    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:33.117354 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:33.117319    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:33.635840 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:33.635809    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:33.636808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:33.636785    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:39.665330 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.665297    2523 generic.go:356] "Generic (PLEG): container finished" podID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerID="fe9a820ce7a987d3090955bef59d803166980de8990982ebf92953e22b9b3fe4" exitCode=0
Jul 23 15:37:39.665838 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.665373    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerDied","Data":"fe9a820ce7a987d3090955bef59d803166980de8990982ebf92953e22b9b3fe4"}
Jul 23 15:37:39.665838 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.665793    2523 scope.go:117] "RemoveContainer" containerID="fe9a820ce7a987d3090955bef59d803166980de8990982ebf92953e22b9b3fe4"
Jul 23 15:37:39.672577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.667246    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:39.672577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.667420    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:39.672577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:39.667535    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:40.321079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.321041    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:37:40.593119 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.593011    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:40.672145 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.672106    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerStarted","Data":"5c3f30ca83dda23eae65f28003d31fae2f96172cfaff295324dac8ba7a6889aa"}
Jul 23 15:37:40.800691 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.800649    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:40.802201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.801868    2523 patch_prober.go:28] interesting pod/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 23 15:37:40.802201 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:40.801925    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 23 15:37:41.800642 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:41.800606    2523 patch_prober.go:28] interesting pod/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 23 15:37:41.801246 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:41.801213    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 23 15:37:42.800578 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:42.800537    2523 patch_prober.go:28] interesting pod/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 23 15:37:42.800922 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:42.800889    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 23 15:37:43.801002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:43.800957    2523 patch_prober.go:28] interesting pod/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 23 15:37:43.801532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:43.801027    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 23 15:37:44.807000 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:44.806964    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:44.808219 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:44.808088    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:44.809007 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:44.808978    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:37:48.637851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.637766    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:48.637851 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.637821    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:48.709167 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.709129    2523 generic.go:356] "Generic (PLEG): container finished" podID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerID="053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86" exitCode=0
Jul 23 15:37:48.709330 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.709199    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerDied","Data":"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"}
Jul 23 15:37:48.709620 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.709605    2523 scope.go:117] "RemoveContainer" containerID="053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"
Jul 23 15:37:48.710611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.710582    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:48.710669 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.710660    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:48.710705 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:48.710692    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:37:49.634701 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:49.634667    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:37:49.716564 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:49.716531    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerStarted","Data":"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"}
Jul 23 15:37:50.102876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:50.102834    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:50.103087 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:50.102964    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:50.103087 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:50.103007    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:51.103550 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:51.103043    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:51.103550 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:51.103109    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:52.103233 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:52.103178    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:52.103566 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:52.103533    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:53.102751 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:53.102711    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:53.103062 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:53.103034    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:54.102811 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:54.102769    2523 patch_prober.go:28] interesting pod/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 23 15:37:54.103244 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:54.102827    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 23 15:37:55.106613 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:55.106581    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:55.107129 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:55.107110    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:37:55.107820 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:37:55.107802    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:38:05.431312 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:05.431270    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:38:18.845311 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:18.845268    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:38:26.348251 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:26.348213    2523 scope.go:117] "RemoveContainer" containerID="2c628ba96c3a22d03c718a02569246b74a857fca527cf4f409e8adccccd99d9d"
Jul 23 15:38:44.730451 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.730410    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"]
Jul 23 15:38:44.733806 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.733787    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:44.736363 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.736341    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:38:44.736474 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.736364    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:38:44.742972 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.742946    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"]
Jul 23 15:38:44.778279 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.778248    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n\" (UID: \"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:44.879335 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.879298    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n\" (UID: \"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:44.879964 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:44.879940    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n\" (UID: \"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:45.044411 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:45.044383    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:45.174855 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:45.174825    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"]
Jul 23 15:38:45.176841 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:38:45.176812    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd0e36f_645d_40fb_bbf5_e5a94b2afb00.slice/crio-1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847 WatchSource:0}: Error finding container 1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847: Status 404 returned error can't find the container with id 1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847
Jul 23 15:38:45.984355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:45.984321    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n" event={"ID":"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00","Type":"ContainerStarted","Data":"7577ba5c7f29a5691e2fad4132c8d1907f68eb8111fc73aeafb9deb14a01ffc6"}
Jul 23 15:38:45.984857 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:45.984372    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n" event={"ID":"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00","Type":"ContainerStarted","Data":"1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847"}
Jul 23 15:38:46.001482 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:46.001436    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n" podStartSLOduration=2.001419764 podStartE2EDuration="2.001419764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:38:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:38:45.999603936 +0000 UTC m=+2300.294341420" watchObservedRunningTime="2026-07-23 15:38:46.001419764 +0000 UTC m=+2300.296157241"
Jul 23 15:38:46.990779 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:46.990741    2523 generic.go:356] "Generic (PLEG): container finished" podID="0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" containerID="7577ba5c7f29a5691e2fad4132c8d1907f68eb8111fc73aeafb9deb14a01ffc6" exitCode=0
Jul 23 15:38:46.991202 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:46.990797    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n" event={"ID":"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00","Type":"ContainerDied","Data":"7577ba5c7f29a5691e2fad4132c8d1907f68eb8111fc73aeafb9deb14a01ffc6"}
Jul 23 15:38:48.128003 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:48.127981    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:48.132218 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:48.132194    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:38:48.211073 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:48.211037    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca\") pod \"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00\" (UID: \"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00\") "
Jul 23 15:38:48.211377 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:48.211358    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" (UID: "0cd0e36f-645d-40fb-bbf5-e5a94b2afb00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:38:48.211535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:48.211504    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:38:49.000397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:49.000359    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n" event={"ID":"0cd0e36f-645d-40fb-bbf5-e5a94b2afb00","Type":"ContainerDied","Data":"1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847"}
Jul 23 15:38:49.000397 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:49.000384    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"
Jul 23 15:38:49.000636 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:49.000415    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f0fc9b69c9d628bd4dd3c6ea56b6b2f56025908db2c12d051049ff371c5e847"
Jul 23 15:38:59.794360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:59.794317    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"]
Jul 23 15:38:59.796591 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:38:59.796559    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-80ba32-cht9n"]
Jul 23 15:39:00.047336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:00.047255    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:39:00.130808 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:00.130779    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" path="/var/lib/kubelet/pods/0cd0e36f-645d-40fb-bbf5-e5a94b2afb00/volumes"
Jul 23 15:39:06.907180 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:06.907141    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:39:06.907696 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:06.907376    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy" containerID="cri-o://5c3f30ca83dda23eae65f28003d31fae2f96172cfaff295324dac8ba7a6889aa" gracePeriod=30
Jul 23 15:39:07.269980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.269900    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"]
Jul 23 15:39:07.270233 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.270218    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" containerName="revoke-keys"
Jul 23 15:39:07.270284 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.270237    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" containerName="revoke-keys"
Jul 23 15:39:07.270337 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.270326    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd0e36f-645d-40fb-bbf5-e5a94b2afb00" containerName="revoke-keys"
Jul 23 15:39:07.272740 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.272719    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:07.275245 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.275222    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:39:07.275349 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.275226    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:39:07.281291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.281253    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"]
Jul 23 15:39:07.395763 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.395727    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-979b59-nbv86\" (UID: \"959ca1ed-bde1-4913-b79d-c1c00d443a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:07.496299 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.496267    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-979b59-nbv86\" (UID: \"959ca1ed-bde1-4913-b79d-c1c00d443a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:07.496928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.496908    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-979b59-nbv86\" (UID: \"959ca1ed-bde1-4913-b79d-c1c00d443a8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:07.583955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.583921    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:07.717717 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:07.717684    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"]
Jul 23 15:39:07.720644 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:39:07.720616    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959ca1ed_bde1_4913_b79d_c1c00d443a8c.slice/crio-195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0 WatchSource:0}: Error finding container 195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0: Status 404 returned error can't find the container with id 195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0
Jul 23 15:39:08.094236 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:08.094204    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86" event={"ID":"959ca1ed-bde1-4913-b79d-c1c00d443a8c","Type":"ContainerStarted","Data":"9c3ea77e345802ad03052f2abf3e40278ed26b9001c98acee5aebb2a631033d9"}
Jul 23 15:39:08.094631 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:08.094255    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86" event={"ID":"959ca1ed-bde1-4913-b79d-c1c00d443a8c","Type":"ContainerStarted","Data":"195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0"}
Jul 23 15:39:08.113015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:08.112960    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86" podStartSLOduration=1.112945897 podStartE2EDuration="1.112945897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:39:08.110682056 +0000 UTC m=+2322.405419534" watchObservedRunningTime="2026-07-23 15:39:08.112945897 +0000 UTC m=+2322.407683375"
Jul 23 15:39:09.100989 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:09.100949    2523 generic.go:356] "Generic (PLEG): container finished" podID="959ca1ed-bde1-4913-b79d-c1c00d443a8c" containerID="9c3ea77e345802ad03052f2abf3e40278ed26b9001c98acee5aebb2a631033d9" exitCode=0
Jul 23 15:39:09.101364 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:09.101000    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86" event={"ID":"959ca1ed-bde1-4913-b79d-c1c00d443a8c","Type":"ContainerDied","Data":"9c3ea77e345802ad03052f2abf3e40278ed26b9001c98acee5aebb2a631033d9"}
Jul 23 15:39:10.239176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:10.239151    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:10.424289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:10.424206    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca\") pod \"959ca1ed-bde1-4913-b79d-c1c00d443a8c\" (UID: \"959ca1ed-bde1-4913-b79d-c1c00d443a8c\") "
Jul 23 15:39:10.424590 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:10.424566    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "959ca1ed-bde1-4913-b79d-c1c00d443a8c" (UID: "959ca1ed-bde1-4913-b79d-c1c00d443a8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:39:10.525880 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:10.525846    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/959ca1ed-bde1-4913-b79d-c1c00d443a8c-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:11.111835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:11.111794    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86" event={"ID":"959ca1ed-bde1-4913-b79d-c1c00d443a8c","Type":"ContainerDied","Data":"195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0"}
Jul 23 15:39:11.112022 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:11.111890    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="195e793de6ad0f3b4da62dbb84fc32256023bcba25385ecc6256de24ce4a1cb0"
Jul 23 15:39:11.112022 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:11.111807    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"
Jul 23 15:39:12.120465 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.120429    2523 generic.go:356] "Generic (PLEG): container finished" podID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerID="5c3f30ca83dda23eae65f28003d31fae2f96172cfaff295324dac8ba7a6889aa" exitCode=0
Jul 23 15:39:12.120918 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.120523    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerDied","Data":"5c3f30ca83dda23eae65f28003d31fae2f96172cfaff295324dac8ba7a6889aa"}
Jul 23 15:39:12.120918 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.120608    2523 scope.go:117] "RemoveContainer" containerID="fe9a820ce7a987d3090955bef59d803166980de8990982ebf92953e22b9b3fe4"
Jul 23 15:39:12.177250 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.177185    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:39:12.342710 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342671    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342744    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342786    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342816    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342840    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342875    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82j54\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.342912 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342900    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.343259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342968    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.343259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.342973    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:12.343259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343015    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket\") pod \"12b9d85a-5910-46eb-b8bd-d8075022054e\" (UID: \"12b9d85a-5910-46eb-b8bd-d8075022054e\") "
Jul 23 15:39:12.343259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343186    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:12.343259 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343218    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:39:12.343535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343329    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12b9d85a-5910-46eb-b8bd-d8075022054e-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.343535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343441    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.343535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343457    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.343535 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.343390    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:12.344163 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.344132    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data" (OuterVolumeSpecName: "istio-data") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:12.345181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.345156    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token" (OuterVolumeSpecName: "istio-token") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:39:12.345181 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.345159    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:39:12.345322 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.345225    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:12.345322 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.345251    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54" (OuterVolumeSpecName: "kube-api-access-82j54") pod "12b9d85a-5910-46eb-b8bd-d8075022054e" (UID: "12b9d85a-5910-46eb-b8bd-d8075022054e"). InnerVolumeSpecName "kube-api-access-82j54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444169    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444202    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444213    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444222    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444230    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82j54\" (UniqueName: \"kubernetes.io/projected/12b9d85a-5910-46eb-b8bd-d8075022054e-kube-api-access-82j54\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:12.444262 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:12.444240    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12b9d85a-5910-46eb-b8bd-d8075022054e-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:13.126425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:13.126393    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"
Jul 23 15:39:13.126425 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:13.126405    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr" event={"ID":"12b9d85a-5910-46eb-b8bd-d8075022054e","Type":"ContainerDied","Data":"f27288de699f2f97e417f297f174308abd58d985557eba21fe365e8d7d75405a"}
Jul 23 15:39:13.126922 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:13.126458    2523 scope.go:117] "RemoveContainer" containerID="5c3f30ca83dda23eae65f28003d31fae2f96172cfaff295324dac8ba7a6889aa"
Jul 23 15:39:13.147177 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:13.147147    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:39:13.150752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:13.150730    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-80ba32-openshift-default-597ddf5b97-8kwsr"]
Jul 23 15:39:14.131600 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:14.131565    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" path="/var/lib/kubelet/pods/12b9d85a-5910-46eb-b8bd-d8075022054e/volumes"
Jul 23 15:39:20.629704 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:20.629621    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:39:22.363342 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:22.363307    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"]
Jul 23 15:39:22.365412 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:22.365389    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-979b59-nbv86"]
Jul 23 15:39:24.130933 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:24.130895    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959ca1ed-bde1-4913-b79d-c1c00d443a8c" path="/var/lib/kubelet/pods/959ca1ed-bde1-4913-b79d-c1c00d443a8c/volumes"
Jul 23 15:39:29.353460 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:29.353421    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:39:29.353906 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:29.353655    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy" containerID="cri-o://93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b" gracePeriod=30
Jul 23 15:39:30.256780 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.256728    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:39:30.257103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257089    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:30.257171 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257103    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:30.257171 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257132    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959ca1ed-bde1-4913-b79d-c1c00d443a8c" containerName="revoke-keys"
Jul 23 15:39:30.257171 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257138    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="959ca1ed-bde1-4913-b79d-c1c00d443a8c" containerName="revoke-keys"
Jul 23 15:39:30.257346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257193    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:30.257346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257202    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="959ca1ed-bde1-4913-b79d-c1c00d443a8c" containerName="revoke-keys"
Jul 23 15:39:30.257346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.257208    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:30.261771 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.261748    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.266590 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.266565    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2a5003-openshift-default-dockercfg-z2rwr\""
Jul 23 15:39:30.273587 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.273565    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:39:30.311359 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311327    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbnf\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311386    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311415    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311521    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311580    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311624    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311681    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311840 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311730    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.311840 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.311747    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412280 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412237    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412309    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412342    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412360    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412384    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbnf\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412452    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412475    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412547    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412604    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412660    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.412759 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412700    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.413253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412912    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.413253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.412942    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.413253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.413092    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.414881 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.414855    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.415085 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.415067    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.421226 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.421201    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbnf\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.421361 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.421328    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token\") pod \"e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") " pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.572591 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.572556    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:30.710272 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.710237    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:39:30.713894 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:39:30.713861    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d4a098_b9c7_45dc_9689_968a603ef34e.slice/crio-7124269c9f84af5d47a54dbd75648e049e1a8067a9a9e94785e4db627d8eba25 WatchSource:0}: Error finding container 7124269c9f84af5d47a54dbd75648e049e1a8067a9a9e94785e4db627d8eba25: Status 404 returned error can't find the container with id 7124269c9f84af5d47a54dbd75648e049e1a8067a9a9e94785e4db627d8eba25
Jul 23 15:39:30.715880 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.715848    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:30.715943 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.715914    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:30.715986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:30.715951    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:31.208618 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:31.208585    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerStarted","Data":"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"}
Jul 23 15:39:31.208807 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:31.208638    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerStarted","Data":"7124269c9f84af5d47a54dbd75648e049e1a8067a9a9e94785e4db627d8eba25"}
Jul 23 15:39:31.228646 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:31.228588    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podStartSLOduration=1.2285682470000001 podStartE2EDuration="1.228568247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:39:31.228308259 +0000 UTC m=+2345.523045737" watchObservedRunningTime="2026-07-23 15:39:31.228568247 +0000 UTC m=+2345.523305725"
Jul 23 15:39:31.573015 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:31.572978    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:31.577650 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:31.577625    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:32.213468 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:32.213440    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:32.214609 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:32.214588    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:34.607968 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.607939    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:39:34.748477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748375    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748428    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748463    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbvk8\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748524    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748565    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748591    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748677    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748704    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748727    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token\") pod \"9502aafc-0976-44c0-b72a-6717cbbf02da\" (UID: \"9502aafc-0976-44c0-b72a-6717cbbf02da\") "
Jul 23 15:39:34.748794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748743    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748794    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.748819    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.749002    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.749022    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.749038    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.749143 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.749101    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:39:34.749517 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.749473    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data" (OuterVolumeSpecName: "istio-data") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:34.750805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.750783    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:39:34.750805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.750797    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8" (OuterVolumeSpecName: "kube-api-access-sbvk8") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "kube-api-access-sbvk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:39:34.751192 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.751171    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token" (OuterVolumeSpecName: "istio-token") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:39:34.751278 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.751168    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9502aafc-0976-44c0-b72a-6717cbbf02da" (UID: "9502aafc-0976-44c0-b72a-6717cbbf02da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:39:34.850423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850378    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.850423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850415    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.850423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850430    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9502aafc-0976-44c0-b72a-6717cbbf02da-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.850700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850443    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.850700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850454    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:34.850700 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:34.850466    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbvk8\" (UniqueName: \"kubernetes.io/projected/9502aafc-0976-44c0-b72a-6717cbbf02da-kube-api-access-sbvk8\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:35.228327 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.228293    2523 generic.go:356] "Generic (PLEG): container finished" podID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerID="93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b" exitCode=0
Jul 23 15:39:35.228543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.228347    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"
Jul 23 15:39:35.228543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.228374    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerDied","Data":"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"}
Jul 23 15:39:35.228543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.228432    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt" event={"ID":"9502aafc-0976-44c0-b72a-6717cbbf02da","Type":"ContainerDied","Data":"2116db53ba44f0264abef1c768e1c11c283413c2bdee7e8e57ae459c4c768352"}
Jul 23 15:39:35.228543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.228455    2523 scope.go:117] "RemoveContainer" containerID="93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"
Jul 23 15:39:35.238676 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.238655    2523 scope.go:117] "RemoveContainer" containerID="053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"
Jul 23 15:39:35.246376 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.246358    2523 scope.go:117] "RemoveContainer" containerID="93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"
Jul 23 15:39:35.246647 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:39:35.246628    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b\": container with ID starting with 93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b not found: ID does not exist" containerID="93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"
Jul 23 15:39:35.246727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.246660    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b"} err="failed to get container status \"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b\": rpc error: code = NotFound desc = could not find container \"93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b\": container with ID starting with 93ead4aca510b6b50f26595518abeb96a2251a43ceb2d0c94e62b8ea0739148b not found: ID does not exist"
Jul 23 15:39:35.246727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.246684    2523 scope.go:117] "RemoveContainer" containerID="053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"
Jul 23 15:39:35.246913 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:39:35.246893    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86\": container with ID starting with 053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86 not found: ID does not exist" containerID="053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"
Jul 23 15:39:35.246952 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.246918    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86"} err="failed to get container status \"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86\": rpc error: code = NotFound desc = could not find container \"053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86\": container with ID starting with 053af0e14f32d5689612932c7021c2cfb2fc21417bcfff5556e646091cd66c86 not found: ID does not exist"
Jul 23 15:39:35.250626 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.250605    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:39:35.255438 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:35.255421    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-979b59-openshift-default-7c5f4c9cfc-cgpvt"]
Jul 23 15:39:36.134060 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:36.134027    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" path="/var/lib/kubelet/pods/9502aafc-0976-44c0-b72a-6717cbbf02da/volumes"
Jul 23 15:39:38.497066 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497028    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:39:38.497553 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497537    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.497628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497556    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.497628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497568    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.497628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497577    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.497628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497589    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:38.497628 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497598    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b9d85a-5910-46eb-b8bd-d8075022054e" containerName="istio-proxy"
Jul 23 15:39:38.497793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497672    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.497793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.497683    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="9502aafc-0976-44c0-b72a-6717cbbf02da" containerName="istio-proxy"
Jul 23 15:39:38.503524 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.503475    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.505918 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.505894    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2b4d9c-openshift-default-dockercfg-wfdxq\""
Jul 23 15:39:38.513437 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.513409    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:39:38.581877 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.581831    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.581877 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.581879    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582131 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.581897    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582131 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.581913    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582131 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.581982    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582131 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.582050    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582131 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.582081    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4x8s\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582351 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.582166    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.582351 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.582221    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.682885 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682847    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682896    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682920    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682939    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682956    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.682978    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683086 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683073    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683113    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4x8s\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683394 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683321    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683394    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683517    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683536    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683611    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.683887 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.683863    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.685644 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.685611    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.685772 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.685737    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.704077 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.704046    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.710781 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.710755    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4x8s\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s\") pod \"e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") " pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.815876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.815829    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:38.956765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.956730    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:39:38.960208 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:39:38.960173    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c6606b_d021_4962_8f75_56efefbe2ffa.slice/crio-4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3 WatchSource:0}: Error finding container 4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3: Status 404 returned error can't find the container with id 4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3
Jul 23 15:39:38.962821 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.962786    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:38.962928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.962853    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:38.962928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:38.962882    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:39.028002 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:39.027968    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:39:39.249445 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:39.249344    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerStarted","Data":"d0e989b4dab262d85980f20674d1743338226f0cf8215ddefbd510f91b2fd1c4"}
Jul 23 15:39:39.249445 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:39.249402    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerStarted","Data":"4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3"}
Jul 23 15:39:39.270408 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:39.270354    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podStartSLOduration=1.27033764 podStartE2EDuration="1.27033764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:39:39.26828779 +0000 UTC m=+2353.563025268" watchObservedRunningTime="2026-07-23 15:39:39.27033764 +0000 UTC m=+2353.565075118"
Jul 23 15:39:39.816828 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:39.816783    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:40.821797 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:40.821766    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:41.258228 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:41.258140    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:41.259257 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:41.259235    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:47.931057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:47.930411    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:55022->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Jul 23 15:39:47.931057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:47.930481    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:55022->10.134.0.51:15021: read: connection reset by peer"
Jul 23 15:39:48.293685 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.293655    2523 generic.go:356] "Generic (PLEG): container finished" podID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerID="da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a" exitCode=0
Jul 23 15:39:48.293854 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.293723    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerDied","Data":"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"}
Jul 23 15:39:48.294095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.294082    2523 scope.go:117] "RemoveContainer" containerID="da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"
Jul 23 15:39:48.295044 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.295016    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:48.295148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.295080    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:48.295148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.295112    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:48.638138 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:48.638055    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:39:49.306974 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:49.306919    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerStarted","Data":"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"}
Jul 23 15:39:49.573077 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:49.572992    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:49.573228 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:49.573201    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 23 15:39:49.573283 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:49.573263    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 23 15:39:50.573980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:50.573938    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 23 15:39:50.574403 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:50.573993    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 23 15:39:51.573304 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:51.573269    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 23 15:39:51.573586 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:51.573317    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 23 15:39:52.573877 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:52.573828    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 23 15:39:52.574303 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:52.573917    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 23 15:39:53.577383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.577352    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:53.577820 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.577707    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:53.578364 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.578347    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:39:53.838138 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.838059    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"]
Jul 23 15:39:53.841442 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.841424    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:53.843835 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.843810    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:39:53.843947 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.843882    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:39:53.848625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.848595    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2a5003-tt62g\" (UID: \"292187cf-5e46-46f5-85db-cd5b8e34049f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:53.849763 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.849739    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"]
Jul 23 15:39:53.949868 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.949824    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2a5003-tt62g\" (UID: \"292187cf-5e46-46f5-85db-cd5b8e34049f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:53.950473 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:53.950446    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-2a5003-tt62g\" (UID: \"292187cf-5e46-46f5-85db-cd5b8e34049f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:54.153025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:54.152934    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:54.290098 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:54.290075    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"]
Jul 23 15:39:54.292444 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:39:54.292414    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292187cf_5e46_46f5_85db_cd5b8e34049f.slice/crio-96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5 WatchSource:0}: Error finding container 96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5: Status 404 returned error can't find the container with id 96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5
Jul 23 15:39:54.340734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:54.340695    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g" event={"ID":"292187cf-5e46-46f5-85db-cd5b8e34049f","Type":"ContainerStarted","Data":"96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5"}
Jul 23 15:39:55.347454 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:55.347360    2523 generic.go:356] "Generic (PLEG): container finished" podID="292187cf-5e46-46f5-85db-cd5b8e34049f" containerID="7c57368da541ceccd121eab6bf7e4b88fa0227532d6a6dea0b9fce809736bb1a" exitCode=0
Jul 23 15:39:55.347897 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:55.347447    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g" event={"ID":"292187cf-5e46-46f5-85db-cd5b8e34049f","Type":"ContainerDied","Data":"7c57368da541ceccd121eab6bf7e4b88fa0227532d6a6dea0b9fce809736bb1a"}
Jul 23 15:39:56.484457 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.484430    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:56.573013 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.572969    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca\") pod \"292187cf-5e46-46f5-85db-cd5b8e34049f\" (UID: \"292187cf-5e46-46f5-85db-cd5b8e34049f\") "
Jul 23 15:39:56.573358 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.573330    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "292187cf-5e46-46f5-85db-cd5b8e34049f" (UID: "292187cf-5e46-46f5-85db-cd5b8e34049f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:39:56.673897 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.673820    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/292187cf-5e46-46f5-85db-cd5b8e34049f-maas-api-service-ca\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:39:56.929268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.928313    2523 patch_prober.go:28] interesting pod/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:37032->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Jul 23 15:39:56.929268 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:56.928386    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:37032->10.134.0.52:15021: read: connection reset by peer"
Jul 23 15:39:57.357547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.357512    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"
Jul 23 15:39:57.357547 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.357524    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g" event={"ID":"292187cf-5e46-46f5-85db-cd5b8e34049f","Type":"ContainerDied","Data":"96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5"}
Jul 23 15:39:57.357794 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.357575    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96a18c159bf1667bac86de57eeedc7e1f018e0d628e77264a11054fa8b39e7c5"
Jul 23 15:39:57.359078 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.359057    2523 generic.go:356] "Generic (PLEG): container finished" podID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerID="d0e989b4dab262d85980f20674d1743338226f0cf8215ddefbd510f91b2fd1c4" exitCode=0
Jul 23 15:39:57.359184 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.359112    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerDied","Data":"d0e989b4dab262d85980f20674d1743338226f0cf8215ddefbd510f91b2fd1c4"}
Jul 23 15:39:57.359446 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.359432    2523 scope.go:117] "RemoveContainer" containerID="d0e989b4dab262d85980f20674d1743338226f0cf8215ddefbd510f91b2fd1c4"
Jul 23 15:39:57.360403 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.360376    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:57.360507 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.360455    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:57.360561 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:57.360505    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:39:58.366151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:58.366120    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerStarted","Data":"806b8db35798805f957c1700df0b13c33770872b55cfcfa061e3f46ab8770aff"}
Jul 23 15:39:58.816573 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:58.816284    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:39:58.816573 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:58.816412    2523 patch_prober.go:28] interesting pod/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 15:39:58.816573 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:58.816535    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 15:39:59.816611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:59.816569    2523 patch_prober.go:28] interesting pod/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 15:39:59.817125 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:39:59.816629    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 15:40:00.816910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:00.816873    2523 patch_prober.go:28] interesting pod/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 15:40:00.817331 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:00.816931    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 15:40:01.816589 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:01.816544    2523 patch_prober.go:28] interesting pod/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 23 15:40:01.816770 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:01.816617    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 23 15:40:02.820400 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:02.820364    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:40:02.820898 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:02.820611    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:40:02.821381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:02.821359    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:40:12.232962 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:12.232925    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:40:13.915197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:13.915154    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"]
Jul 23 15:40:13.918287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:13.918263    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-2a5003-tt62g"]
Jul 23 15:40:14.132176 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:14.132143    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292187cf-5e46-46f5-85db-cd5b8e34049f" path="/var/lib/kubelet/pods/292187cf-5e46-46f5-85db-cd5b8e34049f/volumes"
Jul 23 15:40:20.957584 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:20.957549    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:40:20.958061 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:20.957853    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" containerID="cri-o://2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3" gracePeriod=30
Jul 23 15:40:23.579879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:23.579843    2523 patch_prober.go:28] interesting pod/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 15:40:23.580329 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:23.579928    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 15:40:26.215451 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.215423    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:40:26.356295 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356264    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356295 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356308    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356332    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356358    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356373    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356398    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356419    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356440    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbnf\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356528    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data\") pod \"d4d4a098-b9c7-45dc-9689-968a603ef34e\" (UID: \"d4d4a098-b9c7-45dc-9689-968a603ef34e\") "
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356635    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356688    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356707    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356872    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356892    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356906    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.356993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.356978    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:40:26.357639 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.357611    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:26.358754 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.358723    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:26.358754 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.358732    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:26.358893 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.358804    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf" (OuterVolumeSpecName: "kube-api-access-tmbnf") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "kube-api-access-tmbnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:26.358893 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.358864    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4d4a098-b9c7-45dc-9689-968a603ef34e" (UID: "d4d4a098-b9c7-45dc-9689-968a603ef34e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:40:26.377712 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.377691    2523 scope.go:117] "RemoveContainer" containerID="0ae4939e6804f165768d603b3cb2f30719510333d85a3989aee8336431777f7d"
Jul 23 15:40:26.457757 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457723    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.457757 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457755    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4d4a098-b9c7-45dc-9689-968a603ef34e-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.457928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457768    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.457928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457776    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.457928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457785    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbnf\" (UniqueName: \"kubernetes.io/projected/d4d4a098-b9c7-45dc-9689-968a603ef34e-kube-api-access-tmbnf\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.457928 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.457794    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4d4a098-b9c7-45dc-9689-968a603ef34e-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:26.504622 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.504587    2523 generic.go:356] "Generic (PLEG): container finished" podID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerID="2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3" exitCode=0
Jul 23 15:40:26.504762 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.504645    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"
Jul 23 15:40:26.504762 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.504667    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerDied","Data":"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"}
Jul 23 15:40:26.504762 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.504722    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb" event={"ID":"d4d4a098-b9c7-45dc-9689-968a603ef34e","Type":"ContainerDied","Data":"7124269c9f84af5d47a54dbd75648e049e1a8067a9a9e94785e4db627d8eba25"}
Jul 23 15:40:26.504762 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.504747    2523 scope.go:117] "RemoveContainer" containerID="2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"
Jul 23 15:40:26.513019 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.513003    2523 scope.go:117] "RemoveContainer" containerID="da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"
Jul 23 15:40:26.520793 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.520775    2523 scope.go:117] "RemoveContainer" containerID="2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"
Jul 23 15:40:26.521065 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:40:26.521048    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3\": container with ID starting with 2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3 not found: ID does not exist" containerID="2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"
Jul 23 15:40:26.521139 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.521075    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3"} err="failed to get container status \"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3\": rpc error: code = NotFound desc = could not find container \"2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3\": container with ID starting with 2cd166e0f08dcc55bbfc9249fce409fe3f4eeb8bdaeefcfdd6f9b63e31eb8df3 not found: ID does not exist"
Jul 23 15:40:26.521139 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.521099    2523 scope.go:117] "RemoveContainer" containerID="da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"
Jul 23 15:40:26.521345 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:40:26.521328    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a\": container with ID starting with da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a not found: ID does not exist" containerID="da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"
Jul 23 15:40:26.521383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.521351    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a"} err="failed to get container status \"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a\": rpc error: code = NotFound desc = could not find container \"da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a\": container with ID starting with da0c04579333b1ac76cecbb6e20b514b236b52f3ed1b42b2b9983f14bd19977a not found: ID does not exist"
Jul 23 15:40:26.526412 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.526391    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:40:26.529518 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:26.529473    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2a5003-openshift-default-77bc77b465-vz7gb"]
Jul 23 15:40:28.132442 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:28.132406    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" path="/var/lib/kubelet/pods/d4d4a098-b9c7-45dc-9689-968a603ef34e/volumes"
Jul 23 15:40:41.226432 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:41.226397    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:40:48.381432 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:48.381392    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:40:48.381853 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:48.381689    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy" containerID="cri-o://806b8db35798805f957c1700df0b13c33770872b55cfcfa061e3f46ab8770aff" gracePeriod=30
Jul 23 15:40:49.296355 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296324    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:40:49.296656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296642    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.296656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296657    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.296743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296667    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.296743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296673    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.296743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296690    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292187cf-5e46-46f5-85db-cd5b8e34049f" containerName="revoke-keys"
Jul 23 15:40:49.296743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296696    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="292187cf-5e46-46f5-85db-cd5b8e34049f" containerName="revoke-keys"
Jul 23 15:40:49.296879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296754    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="292187cf-5e46-46f5-85db-cd5b8e34049f" containerName="revoke-keys"
Jul 23 15:40:49.296879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296764    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.296879 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.296771    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d4a098-b9c7-45dc-9689-968a603ef34e" containerName="istio-proxy"
Jul 23 15:40:49.299800 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.299782    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.302382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.302361    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-290c54-openshift-default-dockercfg-czrjr\""
Jul 23 15:40:49.316549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.316519    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:40:49.349616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349580    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349616 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349625    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349668    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349704    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349737    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349761    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349837 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349791    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmdn\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349869    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.349993 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.349923    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451297 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451244    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmdn\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451297 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451312    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451347    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451369    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451396    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451422    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451455    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451519    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451549    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.451859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451845    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.452291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.451892    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.452291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.452008    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.452291 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.452059    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.452656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.452567    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.453722 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.453689    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.454064 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.454042    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.462707 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.462683    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmdn\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.462833 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.462784    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token\") pod \"e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") " pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.610063 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.609977    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:49.746529 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.746413    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:40:49.748770 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:40:49.748742    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f67cfe6_9456_40ae_b4de_3cc00aa88ec3.slice/crio-3cb9be55514cff5b4cda2d71d3b3c034c877067605a95c15b2bf4e290d73bb16 WatchSource:0}: Error finding container 3cb9be55514cff5b4cda2d71d3b3c034c877067605a95c15b2bf4e290d73bb16: Status 404 returned error can't find the container with id 3cb9be55514cff5b4cda2d71d3b3c034c877067605a95c15b2bf4e290d73bb16
Jul 23 15:40:49.750669 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.750639    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:49.750765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.750702    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:49.750765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:49.750729    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:50.614691 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:50.614651    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerStarted","Data":"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"}
Jul 23 15:40:50.615072 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:50.614711    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerStarted","Data":"3cb9be55514cff5b4cda2d71d3b3c034c877067605a95c15b2bf4e290d73bb16"}
Jul 23 15:40:50.638295 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:50.638244    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podStartSLOduration=1.638229571 podStartE2EDuration="1.638229571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:40:50.636656704 +0000 UTC m=+2424.931394182" watchObservedRunningTime="2026-07-23 15:40:50.638229571 +0000 UTC m=+2424.932967049"
Jul 23 15:40:51.610379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:51.610343    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:51.615103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:51.615076    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:51.618999 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:51.618977    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:51.619742 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:51.619723    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:40:53.633572 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.633546    2523 generic.go:356] "Generic (PLEG): container finished" podID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerID="806b8db35798805f957c1700df0b13c33770872b55cfcfa061e3f46ab8770aff" exitCode=0
Jul 23 15:40:53.633902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.633615    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerDied","Data":"806b8db35798805f957c1700df0b13c33770872b55cfcfa061e3f46ab8770aff"}
Jul 23 15:40:53.633902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.633671    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b" event={"ID":"f2c6606b-d021-4962-8f75-56efefbe2ffa","Type":"ContainerDied","Data":"4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3"}
Jul 23 15:40:53.633902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.633695    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4166d9d9c35818447d9756abaad2ebf4dd1a5b2c7cef6af61a4056b84df1a3f3"
Jul 23 15:40:53.633902 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.633713    2523 scope.go:117] "RemoveContainer" containerID="d0e989b4dab262d85980f20674d1743338226f0cf8215ddefbd510f91b2fd1c4"
Jul 23 15:40:53.634896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.634880    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:40:53.688444 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688410    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688474    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688516    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4x8s\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688540    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688561    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688585    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688637    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688663    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.688957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688712    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:53.688957 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.688757    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket\") pod \"f2c6606b-d021-4962-8f75-56efefbe2ffa\" (UID: \"f2c6606b-d021-4962-8f75-56efefbe2ffa\") "
Jul 23 15:40:53.689106 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689019    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:53.689210 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689179    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.689297 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689208    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.689429 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689403    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:53.689776 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689748    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:40:53.689877 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.689813    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:53.690903 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.690877    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:40:53.690987 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.690928    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s" (OuterVolumeSpecName: "kube-api-access-x4x8s") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "kube-api-access-x4x8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:53.691168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.691149    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:40:53.691168 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.691154    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2c6606b-d021-4962-8f75-56efefbe2ffa" (UID: "f2c6606b-d021-4962-8f75-56efefbe2ffa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:40:53.790670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790635    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790662    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790671    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790681    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4x8s\" (UniqueName: \"kubernetes.io/projected/f2c6606b-d021-4962-8f75-56efefbe2ffa-kube-api-access-x4x8s\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790690    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790698    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2c6606b-d021-4962-8f75-56efefbe2ffa-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:53.790940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:53.790706    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2c6606b-d021-4962-8f75-56efefbe2ffa-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:40:54.641369 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:54.641338    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"
Jul 23 15:40:54.677057 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:54.677024    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:40:54.681127 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:54.681094    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2b4d9c-openshift-default-6ffcdf97f7-skp6b"]
Jul 23 15:40:56.131075 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:56.131044    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" path="/var/lib/kubelet/pods/f2c6606b-d021-4962-8f75-56efefbe2ffa/volumes"
Jul 23 15:40:57.736287 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.736256    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:40:57.736798 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.736756    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:40:57.736798 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.736773    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:40:57.736919 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.736868    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:40:57.741735 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.741709    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.744732 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.744703    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d05e2c-openshift-default-dockercfg-f9mlm\""
Jul 23 15:40:57.753995 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.753971    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:40:57.826392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826351    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826392 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826398    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826424    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826455    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826480    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826561    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826627    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4slvz\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826675    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.826693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.826695    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.927756 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927711    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.927756 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927755    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927781    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927802    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927830    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927895    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4slvz\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927933    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.927959    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928048 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928001    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928349    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928367    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928606 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928526    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928780 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928655    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.928780 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.928747    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.930096 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.930075    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.930309 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.930292    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.937684 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.937657    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:57.937921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:57.937895    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4slvz\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz\") pod \"e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") " pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:58.053451 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.053403    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:58.197169 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.197132    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:40:58.201049 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:40:58.201019    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2daf8c6_d6d4_4e56_ab2c_03ba401448d9.slice/crio-e5c114a5d6f29cd4482c32d1e402321c8863451c8d80bd3c72d886b90bec8975 WatchSource:0}: Error finding container e5c114a5d6f29cd4482c32d1e402321c8863451c8d80bd3c72d886b90bec8975: Status 404 returned error can't find the container with id e5c114a5d6f29cd4482c32d1e402321c8863451c8d80bd3c72d886b90bec8975
Jul 23 15:40:58.203276 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.203239    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:58.203379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.203313    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:58.203379 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.203345    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:40:58.660940 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.660905    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerStarted","Data":"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"}
Jul 23 15:40:58.661121 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.660961    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerStarted","Data":"e5c114a5d6f29cd4482c32d1e402321c8863451c8d80bd3c72d886b90bec8975"}
Jul 23 15:40:58.683625 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.683577    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podStartSLOduration=1.6835600830000002 podStartE2EDuration="1.683560083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:40:58.682289062 +0000 UTC m=+2432.977026537" watchObservedRunningTime="2026-07-23 15:40:58.683560083 +0000 UTC m=+2432.978297561"
Jul 23 15:40:58.734153 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:58.734121    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:40:59.054130 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:59.054100    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:59.059099 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:59.059072    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:59.665148 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:59.665113    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:40:59.666212 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:40:59.666189    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:41:07.660691 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:07.660642    2523 patch_prober.go:28] interesting pod/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 15:41:07.661190 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:07.660727    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 15:41:09.744692 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.744642    2523 generic.go:356] "Generic (PLEG): container finished" podID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerID="8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e" exitCode=0
Jul 23 15:41:09.744692 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.744690    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerDied","Data":"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"}
Jul 23 15:41:09.745278 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.745150    2523 scope.go:117] "RemoveContainer" containerID="8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"
Jul 23 15:41:09.746330 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.746295    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:09.746421 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.746383    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:09.746503 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:09.746425    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:10.031360 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:10.031326    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:41:10.751501 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:10.751460    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerStarted","Data":"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"}
Jul 23 15:41:11.610760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.610721    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:41:11.611965 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.610775    2523 patch_prober.go:28] interesting pod/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 15:41:11.611965 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.610843    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 15:41:11.758102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.758015    2523 generic.go:356] "Generic (PLEG): container finished" podID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerID="6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc" exitCode=0
Jul 23 15:41:11.758102 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.758089    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerDied","Data":"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"}
Jul 23 15:41:11.758602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.758589    2523 scope.go:117] "RemoveContainer" containerID="6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"
Jul 23 15:41:11.759565 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.759543    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:11.759621 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.759603    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:11.759656 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:11.759635    2523 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 15:41:12.610783 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:12.610733    2523 patch_prober.go:28] interesting pod/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 15:41:12.611018 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:12.610806    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 15:41:12.764860 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:12.764824    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerStarted","Data":"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"}
Jul 23 15:41:13.054180 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:13.054137    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:41:13.055445 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:13.055411    2523 patch_prober.go:28] interesting pod/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 23 15:41:13.055586 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:13.055468    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 23 15:41:13.610673 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:13.610625    2523 patch_prober.go:28] interesting pod/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 15:41:13.610896 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:13.610698    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 15:41:14.054147 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:14.054102    2523 patch_prober.go:28] interesting pod/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 23 15:41:14.054570 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:14.054167    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 23 15:41:14.611155 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:14.611093    2523 patch_prober.go:28] interesting pod/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 23 15:41:14.611391 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:14.611180    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 23 15:41:14.666028 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:14.665974    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:41:15.054398 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:15.054364    2523 patch_prober.go:28] interesting pod/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 23 15:41:15.054866 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:15.054417    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 23 15:41:15.618878 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:15.618849    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:41:15.619164 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:15.619138    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:41:15.619980 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:15.619960    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:41:16.054848 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:16.054812    2523 patch_prober.go:28] interesting pod/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 23 15:41:16.055248 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:16.054877    2523 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 23 15:41:17.093430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:17.093394    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:41:17.094543 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:17.094522    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:41:23.225612 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:23.225572    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:41:26.400627 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:26.400594    2523 scope.go:117] "RemoveContainer" containerID="83f50a80049e90afddc995df4af2c27888f3e6e87adc854bb3d8a6c8f19560b1"
Jul 23 15:41:58.433032 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:41:58.432995    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:42:22.531476 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:42:22.531393    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:42:41.235924 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:42:41.235885    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:42:56.329404 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:42:56.329367    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:43:15.433690 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:43:15.433657    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:43:34.327938 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:43:34.327895    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:43:52.434641 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:43:52.432210    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:44:11.034876 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:44:11.034837    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:44:27.934658 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:44:27.934622    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:45:00.147170 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.147135    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"]
Jul 23 15:45:00.147738 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.147510    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:45:00.147738 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.147528    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:45:00.147738 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.147592    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c6606b-d021-4962-8f75-56efefbe2ffa" containerName="istio-proxy"
Jul 23 15:45:00.149289 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.149271    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"
Jul 23 15:45:00.151766 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.151743    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9ftw\""
Jul 23 15:45:00.160409 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.160381    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"
Jul 23 15:45:00.160577 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.160525    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"]
Jul 23 15:45:00.293601 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.293574    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"]
Jul 23 15:45:00.296435 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:45:00.296387    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88808c9_72f5_47d9_a10e_ad7b42a3048f.slice/crio-b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae WatchSource:0}: Error finding container b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae: Status 404 returned error can't find the container with id b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae
Jul 23 15:45:00.825744 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.825707    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj" event={"ID":"d88808c9-72f5-47d9-a10e-ad7b42a3048f","Type":"ContainerStarted","Data":"3ed6710529633105bc680caccdf91e75a424f6f97144c4efde6b761b4eee63c9"}
Jul 23 15:45:00.825916 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.825789    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj" event={"ID":"d88808c9-72f5-47d9-a10e-ad7b42a3048f","Type":"ContainerStarted","Data":"b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae"}
Jul 23 15:45:00.842095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:00.842044    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj" podStartSLOduration=0.842029694 podStartE2EDuration="842.029694ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:45:00.841183582 +0000 UTC m=+2675.135921058" watchObservedRunningTime="2026-07-23 15:45:00.842029694 +0000 UTC m=+2675.136767149"
Jul 23 15:45:01.831942 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:01.831905    2523 generic.go:356] "Generic (PLEG): container finished" podID="d88808c9-72f5-47d9-a10e-ad7b42a3048f" containerID="3ed6710529633105bc680caccdf91e75a424f6f97144c4efde6b761b4eee63c9" exitCode=0
Jul 23 15:45:01.832328 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:01.831994    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj" event={"ID":"d88808c9-72f5-47d9-a10e-ad7b42a3048f","Type":"ContainerDied","Data":"3ed6710529633105bc680caccdf91e75a424f6f97144c4efde6b761b4eee63c9"}
Jul 23 15:45:02.963580 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:02.963550    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"
Jul 23 15:45:03.842369 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:03.842337    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj" event={"ID":"d88808c9-72f5-47d9-a10e-ad7b42a3048f","Type":"ContainerDied","Data":"b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae"}
Jul 23 15:45:03.842567 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:03.842386    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b965cae34815fa9c63bbe378ee86f302a509a70dc68fb309ce3530309a796cae"
Jul 23 15:45:03.842567 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:03.842346    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"
Jul 23 15:45:26.446016 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:26.445931    2523 scope.go:117] "RemoveContainer" containerID="7577ba5c7f29a5691e2fad4132c8d1907f68eb8111fc73aeafb9deb14a01ffc6"
Jul 23 15:45:26.453727 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:26.453708    2523 scope.go:117] "RemoveContainer" containerID="9c3ea77e345802ad03052f2abf3e40278ed26b9001c98acee5aebb2a631033d9"
Jul 23 15:45:27.226916 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:27.226882    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:45:41.870692 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:41.870649    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:45:59.927163 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:45:59.927127    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:46:17.345674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:46:17.345633    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:46:26.474729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:46:26.474695    2523 scope.go:117] "RemoveContainer" containerID="806b8db35798805f957c1700df0b13c33770872b55cfcfa061e3f46ab8770aff"
Jul 23 15:46:26.483152 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:46:26.483129    2523 scope.go:117] "RemoveContainer" containerID="7c57368da541ceccd121eab6bf7e4b88fa0227532d6a6dea0b9fce809736bb1a"
Jul 23 15:46:30.923423 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:46:30.923384    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:46:56.635955 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:46:56.635916    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:47:29.326292 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:29.326251    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:47:44.145279 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:44.145246    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:47:52.294414 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.294380    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7749-140687783283888"]
Jul 23 15:47:52.294824 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.294732    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d88808c9-72f5-47d9-a10e-ad7b42a3048f" containerName="cleanup"
Jul 23 15:47:52.294824 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.294744    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d88808c9-72f5-47d9-a10e-ad7b42a3048f" containerName="cleanup"
Jul 23 15:47:52.294824 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.294806    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="d88808c9-72f5-47d9-a10e-ad7b42a3048f" containerName="cleanup"
Jul 23 15:47:52.297937 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.297920    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:52.300346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.300308    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rgjms\""
Jul 23 15:47:52.304477 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.304454    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783283888"]
Jul 23 15:47:52.335345 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.335313    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdf5\" (UniqueName: \"kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5\") pod \"test-curl-7749-140687783283888\" (UID: \"38bbcf19-4977-4a4c-8054-f40d3903ce57\") " pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:52.436103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.436071    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdf5\" (UniqueName: \"kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5\") pod \"test-curl-7749-140687783283888\" (UID: \"38bbcf19-4977-4a4c-8054-f40d3903ce57\") " pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:52.444734 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.444705    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdf5\" (UniqueName: \"kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5\") pod \"test-curl-7749-140687783283888\" (UID: \"38bbcf19-4977-4a4c-8054-f40d3903ce57\") " pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:52.607416 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.607309    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:52.736196 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.736125    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783283888"]
Jul 23 15:47:52.738440 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:47:52.738413    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38bbcf19_4977_4a4c_8054_f40d3903ce57.slice/crio-64919989fd099296c3745080669080f955104f99c491c6099f30d937097f29a0 WatchSource:0}: Error finding container 64919989fd099296c3745080669080f955104f99c491c6099f30d937097f29a0: Status 404 returned error can't find the container with id 64919989fd099296c3745080669080f955104f99c491c6099f30d937097f29a0
Jul 23 15:47:52.739708 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:52.739687    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:47:53.626383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:53.626349    2523 generic.go:356] "Generic (PLEG): container finished" podID="38bbcf19-4977-4a4c-8054-f40d3903ce57" containerID="edeb52ae0c08134bc0d8626d79248102ed8193b32450f015d9beb16ff4e03abd" exitCode=0
Jul 23 15:47:53.626805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:53.626404    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783283888" event={"ID":"38bbcf19-4977-4a4c-8054-f40d3903ce57","Type":"ContainerDied","Data":"edeb52ae0c08134bc0d8626d79248102ed8193b32450f015d9beb16ff4e03abd"}
Jul 23 15:47:53.626805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:53.626429    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783283888" event={"ID":"38bbcf19-4977-4a4c-8054-f40d3903ce57","Type":"ContainerStarted","Data":"64919989fd099296c3745080669080f955104f99c491c6099f30d937097f29a0"}
Jul 23 15:47:54.756499 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.756459    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:54.790592 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.790565    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7749-140687783283888_38bbcf19-4977-4a4c-8054-f40d3903ce57/test-curl-7749-140687783283888/0.log"
Jul 23 15:47:54.813341 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.813316    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7749-140687783283888"]
Jul 23 15:47:54.816729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.816707    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7749-140687783283888"]
Jul 23 15:47:54.854969 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.854943    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfdf5\" (UniqueName: \"kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5\") pod \"38bbcf19-4977-4a4c-8054-f40d3903ce57\" (UID: \"38bbcf19-4977-4a4c-8054-f40d3903ce57\") "
Jul 23 15:47:54.857064 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.857035    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5" (OuterVolumeSpecName: "kube-api-access-vfdf5") pod "38bbcf19-4977-4a4c-8054-f40d3903ce57" (UID: "38bbcf19-4977-4a4c-8054-f40d3903ce57"). InnerVolumeSpecName "kube-api-access-vfdf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:47:54.956095 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:54.956012    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfdf5\" (UniqueName: \"kubernetes.io/projected/38bbcf19-4977-4a4c-8054-f40d3903ce57-kube-api-access-vfdf5\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:47:55.635986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:55.635958    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:55.635986 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:55.635971    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64919989fd099296c3745080669080f955104f99c491c6099f30d937097f29a0"
Jul 23 15:47:55.645972 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:47:55.645928    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7749-140687783283888\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:56.130073 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:47:56.130035    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7749-140687783283888\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" pod="opendatahub/test-curl-7749-140687783283888"
Jul 23 15:47:56.131501 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:56.131467    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" path="/var/lib/kubelet/pods/38bbcf19-4977-4a4c-8054-f40d3903ce57/volumes"
Jul 23 15:47:58.224017 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.223983    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:47:58.224393 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.224301    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" containerName="test-curl-7749-140687783283888"
Jul 23 15:47:58.224393 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.224312    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" containerName="test-curl-7749-140687783283888"
Jul 23 15:47:58.224393 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.224374    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="38bbcf19-4977-4a4c-8054-f40d3903ce57" containerName="test-curl-7749-140687783283888"
Jul 23 15:47:58.227465 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.227444    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:47:58.231277 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.231259    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rgjms\""
Jul 23 15:47:58.243585 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.243557    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:47:58.286552 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.286521    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8l7r\" (UniqueName: \"kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r\") pod \"test-curl-7749-140687783330848\" (UID: \"c285352a-6cb4-44c1-a071-a660494571a7\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:47:58.387721 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.387686    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8l7r\" (UniqueName: \"kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r\") pod \"test-curl-7749-140687783330848\" (UID: \"c285352a-6cb4-44c1-a071-a660494571a7\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:47:58.396388 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.396364    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8l7r\" (UniqueName: \"kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r\") pod \"test-curl-7749-140687783330848\" (UID: \"c285352a-6cb4-44c1-a071-a660494571a7\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:47:58.536608 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.536580    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:47:58.671039 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:58.671009    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:47:58.673955 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:47:58.673929    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc285352a_6cb4_44c1_a071_a660494571a7.slice/crio-be5b4d0bad521a42561cbf8d553802333fbdac85bb07535faa7b68678629fa4e WatchSource:0}: Error finding container be5b4d0bad521a42561cbf8d553802333fbdac85bb07535faa7b68678629fa4e: Status 404 returned error can't find the container with id be5b4d0bad521a42561cbf8d553802333fbdac85bb07535faa7b68678629fa4e
Jul 23 15:47:59.655856 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:59.655774    2523 generic.go:356] "Generic (PLEG): container finished" podID="c285352a-6cb4-44c1-a071-a660494571a7" containerID="ad6705a7b24a38bd0f7eca0319b64847d6e3f09e003f89a5dae6a8efa2b535e9" exitCode=0
Jul 23 15:47:59.655856 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:59.655840    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783330848" event={"ID":"c285352a-6cb4-44c1-a071-a660494571a7","Type":"ContainerDied","Data":"ad6705a7b24a38bd0f7eca0319b64847d6e3f09e003f89a5dae6a8efa2b535e9"}
Jul 23 15:47:59.656238 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:47:59.655866    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783330848" event={"ID":"c285352a-6cb4-44c1-a071-a660494571a7","Type":"ContainerStarted","Data":"be5b4d0bad521a42561cbf8d553802333fbdac85bb07535faa7b68678629fa4e"}
Jul 23 15:48:00.793185 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.793156    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:00.814560 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.814529    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7749-140687783330848_c285352a-6cb4-44c1-a071-a660494571a7/test-curl-7749-140687783330848/0.log"
Jul 23 15:48:00.836375 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.836336    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:00.839714 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.839689    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:00.911105 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.911003    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8l7r\" (UniqueName: \"kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r\") pod \"c285352a-6cb4-44c1-a071-a660494571a7\" (UID: \"c285352a-6cb4-44c1-a071-a660494571a7\") "
Jul 23 15:48:00.913008 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.912979    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r" (OuterVolumeSpecName: "kube-api-access-k8l7r") pod "c285352a-6cb4-44c1-a071-a660494571a7" (UID: "c285352a-6cb4-44c1-a071-a660494571a7"). InnerVolumeSpecName "kube-api-access-k8l7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:00.973728 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.973691    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:00.974023 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.974010    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c285352a-6cb4-44c1-a071-a660494571a7" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:00.974083 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.974024    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="c285352a-6cb4-44c1-a071-a660494571a7" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:00.974121 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.974085    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="c285352a-6cb4-44c1-a071-a660494571a7" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:00.976903 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.976886    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:00.982838 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:00.982815    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:01.012368 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.012333    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55hk\" (UniqueName: \"kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk\") pod \"test-curl-7749-140687783330848\" (UID: \"a5e6b659-6ad2-4310-843b-dfab61f260e5\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:01.012599 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.012479    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8l7r\" (UniqueName: \"kubernetes.io/projected/c285352a-6cb4-44c1-a071-a660494571a7-kube-api-access-k8l7r\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:01.113115 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.113076    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55hk\" (UniqueName: \"kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk\") pod \"test-curl-7749-140687783330848\" (UID: \"a5e6b659-6ad2-4310-843b-dfab61f260e5\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:01.122697 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.122665    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55hk\" (UniqueName: \"kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk\") pod \"test-curl-7749-140687783330848\" (UID: \"a5e6b659-6ad2-4310-843b-dfab61f260e5\") " pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:01.287335 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.287299    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:01.418921 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.418885    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:01.422115 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:48:01.422087    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5e6b659_6ad2_4310_843b_dfab61f260e5.slice/crio-44c2d85ddcf52d788ce2fdfa834dfde38047e9f1de20d6e7c4887ac4a95a5f06 WatchSource:0}: Error finding container 44c2d85ddcf52d788ce2fdfa834dfde38047e9f1de20d6e7c4887ac4a95a5f06: Status 404 returned error can't find the container with id 44c2d85ddcf52d788ce2fdfa834dfde38047e9f1de20d6e7c4887ac4a95a5f06
Jul 23 15:48:01.665555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.665466    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:01.665555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.665512    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be5b4d0bad521a42561cbf8d553802333fbdac85bb07535faa7b68678629fa4e"
Jul 23 15:48:01.666613 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.666582    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783330848" event={"ID":"a5e6b659-6ad2-4310-843b-dfab61f260e5","Type":"ContainerStarted","Data":"44c2d85ddcf52d788ce2fdfa834dfde38047e9f1de20d6e7c4887ac4a95a5f06"}
Jul 23 15:48:01.677686 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.677655    2523 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7749-140687783330848" oldPodUID="c285352a-6cb4-44c1-a071-a660494571a7" podUID="a5e6b659-6ad2-4310-843b-dfab61f260e5"
Jul 23 15:48:01.821763 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:01.821730    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:48:02.131448 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:02.131414    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c285352a-6cb4-44c1-a071-a660494571a7" path="/var/lib/kubelet/pods/c285352a-6cb4-44c1-a071-a660494571a7/volumes"
Jul 23 15:48:02.672451 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:02.672415    2523 generic.go:356] "Generic (PLEG): container finished" podID="a5e6b659-6ad2-4310-843b-dfab61f260e5" containerID="986d5377ec949168f9e220b2de863fe1c7bf41da5f9655f7e7e11798679c196b" exitCode=0
Jul 23 15:48:02.672655 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:02.672527    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783330848" event={"ID":"a5e6b659-6ad2-4310-843b-dfab61f260e5","Type":"ContainerDied","Data":"986d5377ec949168f9e220b2de863fe1c7bf41da5f9655f7e7e11798679c196b"}
Jul 23 15:48:03.806513 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.806476    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:03.831739 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.831711    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7749-140687783330848_a5e6b659-6ad2-4310-843b-dfab61f260e5/test-curl-7749-140687783330848/0.log"
Jul 23 15:48:03.857730 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.857699    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:03.862189 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.862162    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7749-140687783330848"]
Jul 23 15:48:03.938878 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.938778    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t55hk\" (UniqueName: \"kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk\") pod \"a5e6b659-6ad2-4310-843b-dfab61f260e5\" (UID: \"a5e6b659-6ad2-4310-843b-dfab61f260e5\") "
Jul 23 15:48:03.940917 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.940886    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk" (OuterVolumeSpecName: "kube-api-access-t55hk") pod "a5e6b659-6ad2-4310-843b-dfab61f260e5" (UID: "a5e6b659-6ad2-4310-843b-dfab61f260e5"). InnerVolumeSpecName "kube-api-access-t55hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:03.998466 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.998432    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7749-140687783331856"]
Jul 23 15:48:03.998805 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.998792    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e6b659-6ad2-4310-843b-dfab61f260e5" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:03.998866 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.998807    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e6b659-6ad2-4310-843b-dfab61f260e5" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:03.998866 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:03.998860    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e6b659-6ad2-4310-843b-dfab61f260e5" containerName="test-curl-7749-140687783330848"
Jul 23 15:48:04.001731 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.001712    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:04.008077 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.008046    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783331856"]
Jul 23 15:48:04.040025 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.039982    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vdzq\" (UniqueName: \"kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq\") pod \"test-curl-7749-140687783331856\" (UID: \"5d82f2b5-84cc-4bf7-a35b-b9be62305737\") " pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:04.040200 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.040057    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55hk\" (UniqueName: \"kubernetes.io/projected/a5e6b659-6ad2-4310-843b-dfab61f260e5-kube-api-access-t55hk\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:04.132162 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.132131    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e6b659-6ad2-4310-843b-dfab61f260e5" path="/var/lib/kubelet/pods/a5e6b659-6ad2-4310-843b-dfab61f260e5/volumes"
Jul 23 15:48:04.140542 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.140513    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vdzq\" (UniqueName: \"kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq\") pod \"test-curl-7749-140687783331856\" (UID: \"5d82f2b5-84cc-4bf7-a35b-b9be62305737\") " pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:04.149555 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.149527    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vdzq\" (UniqueName: \"kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq\") pod \"test-curl-7749-140687783331856\" (UID: \"5d82f2b5-84cc-4bf7-a35b-b9be62305737\") " pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:04.311457 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.311421    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:04.439968 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.439933    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7749-140687783331856"]
Jul 23 15:48:04.442895 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:48:04.442867    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d82f2b5_84cc_4bf7_a35b_b9be62305737.slice/crio-7efd5f27649189e56d0351c0fa466ebcefe48bc8e144c869ec019e5bda3b28ff WatchSource:0}: Error finding container 7efd5f27649189e56d0351c0fa466ebcefe48bc8e144c869ec019e5bda3b28ff: Status 404 returned error can't find the container with id 7efd5f27649189e56d0351c0fa466ebcefe48bc8e144c869ec019e5bda3b28ff
Jul 23 15:48:04.682398 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.682300    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783331856" event={"ID":"5d82f2b5-84cc-4bf7-a35b-b9be62305737","Type":"ContainerStarted","Data":"7efd5f27649189e56d0351c0fa466ebcefe48bc8e144c869ec019e5bda3b28ff"}
Jul 23 15:48:04.683561 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.683536    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783330848"
Jul 23 15:48:04.683684 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:04.683543    2523 scope.go:117] "RemoveContainer" containerID="986d5377ec949168f9e220b2de863fe1c7bf41da5f9655f7e7e11798679c196b"
Jul 23 15:48:05.690752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:05.690718    2523 generic.go:356] "Generic (PLEG): container finished" podID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" containerID="c9bb8090124279f7548608fa84e679514d64253429ee2019d19ed0113c7be75d" exitCode=0
Jul 23 15:48:05.691185 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:05.690752    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7749-140687783331856" event={"ID":"5d82f2b5-84cc-4bf7-a35b-b9be62305737","Type":"ContainerDied","Data":"c9bb8090124279f7548608fa84e679514d64253429ee2019d19ed0113c7be75d"}
Jul 23 15:48:06.823605 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.823580    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:06.843549 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.843525    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7749-140687783331856_5d82f2b5-84cc-4bf7-a35b-b9be62305737/test-curl-7749-140687783331856/0.log"
Jul 23 15:48:06.866752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.866720    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7749-140687783331856"]
Jul 23 15:48:06.870918 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.870890    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7749-140687783331856"]
Jul 23 15:48:06.967963 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.967876    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vdzq\" (UniqueName: \"kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq\") pod \"5d82f2b5-84cc-4bf7-a35b-b9be62305737\" (UID: \"5d82f2b5-84cc-4bf7-a35b-b9be62305737\") "
Jul 23 15:48:06.969949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:06.969916    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq" (OuterVolumeSpecName: "kube-api-access-9vdzq") pod "5d82f2b5-84cc-4bf7-a35b-b9be62305737" (UID: "5d82f2b5-84cc-4bf7-a35b-b9be62305737"). InnerVolumeSpecName "kube-api-access-9vdzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:07.068950 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:07.068909    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vdzq\" (UniqueName: \"kubernetes.io/projected/5d82f2b5-84cc-4bf7-a35b-b9be62305737-kube-api-access-9vdzq\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:07.702465 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:07.702438    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7efd5f27649189e56d0351c0fa466ebcefe48bc8e144c869ec019e5bda3b28ff"
Jul 23 15:48:07.702654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:07.702470    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:07.712615 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:48:07.712585    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7749-140687783331856\" is forbidden: User \"system:node:ip-10-0-133-217.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-217.ec2.internal' and this object" podUID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" pod="opendatahub/test-curl-7749-140687783331856"
Jul 23 15:48:08.131608 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:08.131570    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" path="/var/lib/kubelet/pods/5d82f2b5-84cc-4bf7-a35b-b9be62305737/volumes"
Jul 23 15:48:23.223217 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:23.223135    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:48:31.295013 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:31.294980    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:48:31.295417 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:31.295199    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy" containerID="cri-o://12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd" gracePeriod=30
Jul 23 15:48:36.553215 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.553189    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:48:36.629654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629560    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.629654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629597    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.629654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629616    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvmdn\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.629654 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629636    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629664    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629737    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629772    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629798    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629859    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy\") pod \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\" (UID: \"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3\") "
Jul 23 15:48:36.630009 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.629878    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:36.630293 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630067    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:36.630293 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630145    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.630293 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630164    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.630449 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630355    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:36.630519 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630448    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:36.630765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.630736    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:36.632071 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.632047    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:36.632156 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.632095    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:48:36.632285 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.632264    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:36.632328 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.632283    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn" (OuterVolumeSpecName: "kube-api-access-zvmdn") pod "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" (UID: "0f67cfe6-9456-40ae-b4de-3cc00aa88ec3"). InnerVolumeSpecName "kube-api-access-zvmdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:36.731509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731440    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731507    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731517    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731509 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731525    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731535    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731542    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.731790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.731553    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvmdn\" (UniqueName: \"kubernetes.io/projected/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3-kube-api-access-zvmdn\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:36.843693 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.843661    2523 generic.go:356] "Generic (PLEG): container finished" podID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerID="12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd" exitCode=0
Jul 23 15:48:36.843849 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.843714    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"
Jul 23 15:48:36.843849 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.843743    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerDied","Data":"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"}
Jul 23 15:48:36.843849 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.843799    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7" event={"ID":"0f67cfe6-9456-40ae-b4de-3cc00aa88ec3","Type":"ContainerDied","Data":"3cb9be55514cff5b4cda2d71d3b3c034c877067605a95c15b2bf4e290d73bb16"}
Jul 23 15:48:36.843849 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.843823    2523 scope.go:117] "RemoveContainer" containerID="12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"
Jul 23 15:48:36.852557 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.852539    2523 scope.go:117] "RemoveContainer" containerID="8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"
Jul 23 15:48:36.859891 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.859876    2523 scope.go:117] "RemoveContainer" containerID="12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"
Jul 23 15:48:36.860138 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:48:36.860119    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd\": container with ID starting with 12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd not found: ID does not exist" containerID="12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"
Jul 23 15:48:36.860188 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.860147    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd"} err="failed to get container status \"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd\": rpc error: code = NotFound desc = could not find container \"12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd\": container with ID starting with 12853dd3a507914a24746f6fed106ddbddaccd97ca6dc0105aea827f2a4fd1cd not found: ID does not exist"
Jul 23 15:48:36.860188 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.860165    2523 scope.go:117] "RemoveContainer" containerID="8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"
Jul 23 15:48:36.860372 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:48:36.860351    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e\": container with ID starting with 8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e not found: ID does not exist" containerID="8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"
Jul 23 15:48:36.860428 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.860382    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e"} err="failed to get container status \"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e\": rpc error: code = NotFound desc = could not find container \"8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e\": container with ID starting with 8ea3d0c52bd21d79b544aaf66d5f70b2408308863648ded2aef0afcc04d4f92e not found: ID does not exist"
Jul 23 15:48:36.867336 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.867315    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:48:36.872070 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:36.872047    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-290c54-openshift-default-5589df5cdc-bbxw7"]
Jul 23 15:48:38.132065 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:38.132031    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" path="/var/lib/kubelet/pods/0f67cfe6-9456-40ae-b4de-3cc00aa88ec3/volumes"
Jul 23 15:48:42.095743 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:42.095708    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"]
Jul 23 15:48:42.098195 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:42.098169    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d05e2c-29747025-6f6jj"]
Jul 23 15:48:42.130941 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:42.130914    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d88808c9-72f5-47d9-a10e-ad7b42a3048f" path="/var/lib/kubelet/pods/d88808c9-72f5-47d9-a10e-ad7b42a3048f/volumes"
Jul 23 15:48:44.623466 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:44.623431    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z579x"]
Jul 23 15:48:53.601381 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:53.601349    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:48:53.601844 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:53.601591    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy" containerID="cri-o://ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e" gracePeriod=30
Jul 23 15:48:54.325383 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:54.325347    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dbd6cbcbf-mdc7k_ce294bfc-50e8-4980-ac1a-830879eed8f0/authorino/0.log"
Jul 23 15:48:58.857865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.857841    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:48:58.925079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925001    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925032    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925079 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925073    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4slvz\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925095    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925114    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925160    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925182    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925203    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925325 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925230    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket\") pod \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\" (UID: \"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9\") "
Jul 23 15:48:58.925659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925346    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:58.925659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925511    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:58.925659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925519    2523 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-certs\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:58.925659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925621    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:48:58.925861 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.925721    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:58.926133 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.926110    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:58.927741 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.927718    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 15:48:58.927741 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.927723    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz" (OuterVolumeSpecName: "kube-api-access-4slvz") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "kube-api-access-4slvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:58.928023 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.928002    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:48:58.928094 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.928007    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" (UID: "f2daf8c6-d6d4-4e56-ab2c-03ba401448d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:48:58.946949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.944889    2523 generic.go:356] "Generic (PLEG): container finished" podID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerID="ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e" exitCode=0
Jul 23 15:48:58.946949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.944996    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerDied","Data":"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"}
Jul 23 15:48:58.946949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.945044    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z" event={"ID":"f2daf8c6-d6d4-4e56-ab2c-03ba401448d9","Type":"ContainerDied","Data":"e5c114a5d6f29cd4482c32d1e402321c8863451c8d80bd3c72d886b90bec8975"}
Jul 23 15:48:58.946949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.945101    2523 scope.go:117] "RemoveContainer" containerID="ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"
Jul 23 15:48:58.946949 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.945302    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"
Jul 23 15:48:58.956239 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.956220    2523 scope.go:117] "RemoveContainer" containerID="6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"
Jul 23 15:48:58.963756 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.963739    2523 scope.go:117] "RemoveContainer" containerID="ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"
Jul 23 15:48:58.964076 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:48:58.964057    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e\": container with ID starting with ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e not found: ID does not exist" containerID="ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"
Jul 23 15:48:58.964130 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.964084    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e"} err="failed to get container status \"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e\": rpc error: code = NotFound desc = could not find container \"ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e\": container with ID starting with ea81abd3e4789a059424b92bde8b0db16be59fa54fc888f6d1382ed67945953e not found: ID does not exist"
Jul 23 15:48:58.964130 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.964102    2523 scope.go:117] "RemoveContainer" containerID="6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"
Jul 23 15:48:58.964393 ip-10-0-133-217 kubenswrapper[2523]: E0723 15:48:58.964374    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc\": container with ID starting with 6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc not found: ID does not exist" containerID="6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"
Jul 23 15:48:58.964430 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.964399    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc"} err="failed to get container status \"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc\": rpc error: code = NotFound desc = could not find container \"6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc\": container with ID starting with 6f2b999bffd40b66dc3d12601e90055a66e5e46b28f5310fab7012d10adc75dc not found: ID does not exist"
Jul 23 15:48:58.967636 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.967616    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:48:58.974927 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:58.974907    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d05e2c-openshift-default-589c96dfcf-vw97z"]
Jul 23 15:48:59.026054 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026027    2523 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-data\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026054 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026051    2523 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-envoy\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026054 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026059    2523 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-token\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026068    2523 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-workload-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026077    2523 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istio-podinfo\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026087    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4slvz\" (UniqueName: \"kubernetes.io/projected/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-kube-api-access-4slvz\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026096    2523 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-istiod-ca-cert\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:48:59.026223 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:48:59.026105    2523 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9-credential-socket\") on node \"ip-10-0-133-217.ec2.internal\" DevicePath \"\""
Jul 23 15:49:00.131712 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:00.131676    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" path="/var/lib/kubelet/pods/f2daf8c6-d6d4-4e56-ab2c-03ba401448d9/volumes"
Jul 23 15:49:00.636605 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:00.636563    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-f8fkh_e0555c21-7c21-48e0-ab44-a0a191de0a5e/manager/0.log"
Jul 23 15:49:00.642227 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:00.642210    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-f8fkh_e0555c21-7c21-48e0-ab44-a0a191de0a5e/copy-manifests/0.log"
Jul 23 15:49:01.384240 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:01.384212    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746995-bkldl_4f46289b-15ff-406a-8c79-391e26ad3509/cleanup/0.log"
Jul 23 15:49:01.498908 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:01.498883    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747010-mmbf9_1f1c8a1b-be69-4977-a01e-8846561ea7f0/cleanup/0.log"
Jul 23 15:49:03.114799 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:03.114770    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dbd6cbcbf-mdc7k_ce294bfc-50e8-4980-ac1a-830879eed8f0/authorino/0.log"
Jul 23 15:49:03.237729 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:03.237694    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-924p6_4c2462be-9ee6-40d0-97db-d0d844b31d6a/manager/0.log"
Jul 23 15:49:03.601197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:03.601165    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fbhm9_a2a97d38-20bd-4480-8bbc-91c65780ab46/registry-server/0.log"
Jul 23 15:49:03.861819 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:03.861737    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z579x_b6f84a1a-5018-41c0-af53-677a9cd55a68/limitador/0.log"
Jul 23 15:49:04.367760 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:04.367730    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p8r82_45ba99cc-1307-45a7-ae73-acf0af9633a8/istio-proxy/0.log"
Jul 23 15:49:04.826189 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:04.826158    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/1.log"
Jul 23 15:49:05.679773 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:05.679747    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dgd6q_7edbab82-bd5d-41a0-a17e-6ac86adbf718/main/0.log"
Jul 23 15:49:16.083127 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:16.083093    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fqs4c_ec40c980-8f31-4ffd-890d-bdfcd871c998/global-pull-secret-syncer/0.log"
Jul 23 15:49:16.234516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:16.234473    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-khjpc_8f0b7248-1943-448d-a504-5d22539e15ae/konnectivity-agent/0.log"
Jul 23 15:49:16.304602 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:16.304569    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-217.ec2.internal_6cc9923be72664a1d868fb9f3e40b0d0/haproxy/0.log"
Jul 23 15:49:21.020384 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:21.020292    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dbd6cbcbf-mdc7k_ce294bfc-50e8-4980-ac1a-830879eed8f0/authorino/0.log"
Jul 23 15:49:21.053452 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:21.053419    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-924p6_4c2462be-9ee6-40d0-97db-d0d844b31d6a/manager/0.log"
Jul 23 15:49:21.170969 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:21.170933    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fbhm9_a2a97d38-20bd-4480-8bbc-91c65780ab46/registry-server/0.log"
Jul 23 15:49:21.402567 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:21.402539    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z579x_b6f84a1a-5018-41c0-af53-677a9cd55a68/limitador/0.log"
Jul 23 15:49:23.660895 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:23.660871    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95jbc_118778e3-23a6-424d-b179-36e526175992/node-exporter/0.log"
Jul 23 15:49:23.691500 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:23.691464    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95jbc_118778e3-23a6-424d-b179-36e526175992/kube-rbac-proxy/0.log"
Jul 23 15:49:23.713203 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:23.713176    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95jbc_118778e3-23a6-424d-b179-36e526175992/init-textfile/0.log"
Jul 23 15:49:24.011371 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.011346    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/prometheus/0.log"
Jul 23 15:49:24.034277 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.034251    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/config-reloader/0.log"
Jul 23 15:49:24.060151 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.060124    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/thanos-sidecar/0.log"
Jul 23 15:49:24.082020 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.081999    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/kube-rbac-proxy-web/0.log"
Jul 23 15:49:24.114282 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.114263    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/kube-rbac-proxy/0.log"
Jul 23 15:49:24.136752 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.136726    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/kube-rbac-proxy-thanos/0.log"
Jul 23 15:49:24.163603 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:24.163579    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a147af4e-83b6-4dc4-b8bd-0fc6528790ef/init-config-reloader/0.log"
Jul 23 15:49:26.333859 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.333817    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"]
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334257    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334276    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334294    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334302    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334326    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.334333 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334334    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334348    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" containerName="test-curl-7749-140687783331856"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334357    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" containerName="test-curl-7749-140687783331856"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334368    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334384    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334469    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334481    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334508    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2daf8c6-d6d4-4e56-ab2c-03ba401448d9" containerName="istio-proxy"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334517    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d82f2b5-84cc-4bf7-a35b-b9be62305737" containerName="test-curl-7749-140687783331856"
Jul 23 15:49:26.334670 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.334526    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f67cfe6-9456-40ae-b4de-3cc00aa88ec3" containerName="istio-proxy"
Jul 23 15:49:26.337659 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.337637    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.340243 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.340225    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l4h4\"/\"openshift-service-ca.crt\""
Jul 23 15:49:26.341054 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.341035    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l4h4\"/\"kube-root-ca.crt\""
Jul 23 15:49:26.341127 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.341035    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l4h4\"/\"default-dockercfg-bddm9\""
Jul 23 15:49:26.345126 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.345106    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"]
Jul 23 15:49:26.457281 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.457250    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-proc\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.457456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.457297    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-podres\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.457456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.457317    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6v69\" (UniqueName: \"kubernetes.io/projected/4069aa79-79d7-4962-86c4-f3e728526df8-kube-api-access-b6v69\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.457456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.457435    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-lib-modules\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.457589 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.457472    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-sys\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558220 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558191    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-podres\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558227    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6v69\" (UniqueName: \"kubernetes.io/projected/4069aa79-79d7-4962-86c4-f3e728526df8-kube-api-access-b6v69\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558271    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-lib-modules\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558292    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-sys\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558346 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558330    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-proc\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558365    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-podres\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558383    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-sys\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558420    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-proc\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.558516 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.558425    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4069aa79-79d7-4962-86c4-f3e728526df8-lib-modules\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.566833 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.566813    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6v69\" (UniqueName: \"kubernetes.io/projected/4069aa79-79d7-4962-86c4-f3e728526df8-kube-api-access-b6v69\") pod \"perf-node-gather-daemonset-spcpp\" (UID: \"4069aa79-79d7-4962-86c4-f3e728526df8\") " pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.648098 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.648014    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:26.778253 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:26.778179    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"]
Jul 23 15:49:26.784440 ip-10-0-133-217 kubenswrapper[2523]: W0723 15:49:26.784412    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4069aa79_79d7_4962_86c4_f3e728526df8.slice/crio-8e88d8f81ec9e16d16a352a4a46310e7ecbb65098f53965c633616568c57693e WatchSource:0}: Error finding container 8e88d8f81ec9e16d16a352a4a46310e7ecbb65098f53965c633616568c57693e: Status 404 returned error can't find the container with id 8e88d8f81ec9e16d16a352a4a46310e7ecbb65098f53965c633616568c57693e
Jul 23 15:49:27.073587 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:27.073555    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp" event={"ID":"4069aa79-79d7-4962-86c4-f3e728526df8","Type":"ContainerStarted","Data":"3152aad84e3c472f52f6e15b1f56ef53e0423476f6f00e3ae6fa50dfc83f9f3b"}
Jul 23 15:49:27.073790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:27.073605    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp" event={"ID":"4069aa79-79d7-4962-86c4-f3e728526df8","Type":"ContainerStarted","Data":"8e88d8f81ec9e16d16a352a4a46310e7ecbb65098f53965c633616568c57693e"}
Jul 23 15:49:27.073790 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:27.073653    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:27.092123 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:27.092065    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp" podStartSLOduration=1.092044536 podStartE2EDuration="1.092044536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:49:27.091682688 +0000 UTC m=+2941.386420167" watchObservedRunningTime="2026-07-23 15:49:27.092044536 +0000 UTC m=+2941.386782015"
Jul 23 15:49:28.536532 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:28.536502    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l97lp_74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65/dns/0.log"
Jul 23 15:49:28.555382 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:28.555348    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l97lp_74a3dde8-a6bf-452f-a7c7-a77d0c2e9c65/kube-rbac-proxy/0.log"
Jul 23 15:49:28.732765 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:28.732736    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nd6dn_98ba62c1-586b-47ae-a2d4-4c82d9045ac6/dns-node-resolver/0.log"
Jul 23 15:49:29.372084 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:29.372056    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k97lp_7d3c1d29-521f-491e-a4d7-ef091d6e40d6/node-ca/0.log"
Jul 23 15:49:30.365631 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:30.365603    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p8r82_45ba99cc-1307-45a7-ae73-acf0af9633a8/istio-proxy/0.log"
Jul 23 15:49:30.691675 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:30.691592    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/0.log"
Jul 23 15:49:30.715865 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:30.715838    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/1.log"
Jul 23 15:49:31.522667 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:31.522628    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82kvd_3ba3f3e4-cfca-47ea-87dd-d5453fe3bb74/serve-healthcheck-canary/0.log"
Jul 23 15:49:32.121374 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:32.121344    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9vpk_597dd3de-d57f-4e38-b6df-e5abc9dddc2a/kube-rbac-proxy/0.log"
Jul 23 15:49:32.145674 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:32.145646    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9vpk_597dd3de-d57f-4e38-b6df-e5abc9dddc2a/exporter/0.log"
Jul 23 15:49:32.165200 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:32.165175    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c9vpk_597dd3de-d57f-4e38-b6df-e5abc9dddc2a/extractor/0.log"
Jul 23 15:49:33.088883 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:33.088850    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l4h4/perf-node-gather-daemonset-spcpp"
Jul 23 15:49:35.077601 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:35.077568    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-f8fkh_e0555c21-7c21-48e0-ab44-a0a191de0a5e/manager/0.log"
Jul 23 15:49:35.097373 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:35.097354    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75984d86c4-f8fkh_e0555c21-7c21-48e0-ab44-a0a191de0a5e/copy-manifests/0.log"
Jul 23 15:49:36.410260 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:36.410234    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p8r82_45ba99cc-1307-45a7-ae73-acf0af9633a8/istio-proxy/0.log"
Jul 23 15:49:36.573119 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:36.573090    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68b858458d-mzz2f_5945ab33-efad-4fc3-a2a5-ea76ea4e240a/manager/0.log"
Jul 23 15:49:36.687611 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:36.687527    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/0.log"
Jul 23 15:49:36.712264 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:36.712233    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/1.log"
Jul 23 15:49:37.964831 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:37.964745    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4p8r82_45ba99cc-1307-45a7-ae73-acf0af9633a8/istio-proxy/0.log"
Jul 23 15:49:38.249197 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:38.249119    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/0.log"
Jul 23 15:49:38.276530 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:38.276478    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hpdjn_78a6f7e9-88ee-462b-977d-2050585637f4/istio-proxy/1.log"
Jul 23 15:49:41.383103 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:41.383067    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-xr8ck_26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f/migrator/0.log"
Jul 23 15:49:41.402992 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:41.402964    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-xr8ck_26ebc79d-a1dc-4a79-8a46-7e35ab2ade7f/graceful-termination/0.log"
Jul 23 15:49:42.785910 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.785881    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/kube-multus-additional-cni-plugins/0.log"
Jul 23 15:49:42.804059 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.804030    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/egress-router-binary-copy/0.log"
Jul 23 15:49:42.821948 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.821920    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/cni-plugins/0.log"
Jul 23 15:49:42.840142 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.840119    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/bond-cni-plugin/0.log"
Jul 23 15:49:42.858880 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.858858    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/routeoverride-cni/0.log"
Jul 23 15:49:42.878456 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.878431    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/whereabouts-cni-bincopy/0.log"
Jul 23 15:49:42.897310 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:42.897292    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8prkm_a8d7a2eb-d25e-4edb-8217-ff970458541e/whereabouts-cni/0.log"
Jul 23 15:49:43.222591 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:43.222518    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qbv4w_b96bc61d-0254-49f5-b82f-3d6cb779d334/kube-multus/0.log"
Jul 23 15:49:43.411870 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:43.411845    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vsppp_14ed8da3-d298-4724-ab4e-0ec0913769ed/network-metrics-daemon/0.log"
Jul 23 15:49:43.428762 ip-10-0-133-217 kubenswrapper[2523]: I0723 15:49:43.428737    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vsppp_14ed8da3-d298-4724-ab4e-0ec0913769ed/kube-rbac-proxy/0.log"