Jul 29 01:12:37.037817 ip-10-0-140-185 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:12:37.471687 ip-10-0-140-185 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:37.471687 ip-10-0-140-185 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:12:37.471687 ip-10-0-140-185 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:37.471687 ip-10-0-140-185 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:12:37.471687 ip-10-0-140-185 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:12:37.473685 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.473560    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:12:37.477439 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477421    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.477439 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477439    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477444    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477447    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477451    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477453    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477457    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477459    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477462    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477465    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477468    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477471    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477474    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477477    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477480    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477483    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477486    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477490    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477493    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477495    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477499    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.477506 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477502    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477505    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477508    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477511    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477514    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477517    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477521    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477524    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477527    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477529    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477533    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477536    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477539    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477542    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477545    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477547    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477550    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477553    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477555    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.478044 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477558    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477561    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477564    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477568    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477572    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477588    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477593    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477596    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477599    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477602    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477607    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477611    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477614    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477618    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477622    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477624    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477627    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477630    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477633    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.478535 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477636    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477639    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477642    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477644    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477647    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477650    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477652    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477655    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477658    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477661    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477663    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477666    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477670    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477672    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477675    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477678    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477680    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477684    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477687    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477690    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.479059 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477693    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477696    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477700    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477704    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477708    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477711    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477714    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477720    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477724    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477727    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477730    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477733    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477737    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477739    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477742    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477746    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477748    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477752    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477754    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.477757    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.479584 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479088    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479097    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479101    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479105    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479108    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479111    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479114    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479117    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479120    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479123    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479126    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479128    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479131    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479134    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479139    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479142    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479145    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479148    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479151    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479154    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.480106 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479157    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479160    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479163    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479166    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479169    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479171    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479174    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479177    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479181    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479183    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479186    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479189    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479192    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479195    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479198    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479200    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479203    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479206    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479209    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.480665 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479212    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479215    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479218    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479220    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479223    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479226    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479228    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479231    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479234    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479237    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479240    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479243    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479246    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479249    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479252    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479255    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479258    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479260    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479266    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479270    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.481154 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479273    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479276    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479279    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479282    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479285    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479288    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479292    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479294    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479297    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479300    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479303    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479307    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479318    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479321    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479324    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479327    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479330    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479334    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479338    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.481699 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479341    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479345    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479348    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479351    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479355    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479358    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479361    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479364    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479367    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479370    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479373    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479376    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479379    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479382    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479385    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479387    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479390    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479392    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479395    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479398    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.482202 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479400    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479843    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479849    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479852    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479854    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479858    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479861    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479864    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479867    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479869    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479873    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479878    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479881    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479884    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479887    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479890    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479893    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479896    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479899    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479901    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.482747 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479904    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479907    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479910    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479913    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479916    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479918    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479921    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479923    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479926    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479929    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479932    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479935    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479937    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479940    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479943    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479946    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479949    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479952    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479956    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.483283 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479959    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479963    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479967    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479970    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479976    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479980    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479984    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479987    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479990    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479993    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.479997    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480000    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480003    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480006    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480009    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480012    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480014    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480019    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480022    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.483812 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480025    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480029    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480032    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480035    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480038    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480040    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480043    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480046    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480049    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480051    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480054    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480057    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480059    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480063    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480066    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480069    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480071    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480075    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480078    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480081    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.484319 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480083    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480086    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480090    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480094    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480097    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480099    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480102    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480105    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480107    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480111    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480114    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480117    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480120    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480123    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480125    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480128    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480131    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480133    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480136    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480139    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.484853 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480141    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480144    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480221    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480229    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480237    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480242    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480247    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480250    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480255    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480260    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480263    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480267    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480270    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480274    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480277    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480283    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480286    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480289    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480292    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480295    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480300    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480303    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480306    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480309    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:12:37.485412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480313    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480317    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480320    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480323    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480327    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480330    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480333    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480336    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480339    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480342    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480346    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480349    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480352    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480355    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480358    2564 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480362    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480367    2564 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480371    2564 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480374    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480377    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480380    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480385    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480388    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480393    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480396    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:12:37.486046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480400    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480403    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480406    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480409    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480413    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480416    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480419    2564 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480423    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480426    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480429    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480433    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480436    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480439    2564 flags.go:64] FLAG: --help="false"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480442    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480445    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480448    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480451    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480455    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480458    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480461    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480464    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480467    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480470    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:12:37.486752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480474    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480477    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480480    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480483    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480486    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480490    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480493    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480497    2564 flags.go:64] FLAG: --lock-file=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480500    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480503    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480507    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480513    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480516    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480519    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480522    2564 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480524    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480528    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480531    2564 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480534    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480538    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480541    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480546    2564 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480549    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480552    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480555    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:12:37.487400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480559    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480562    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480565    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480568    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480588    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480592    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480595    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480598    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480603    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480609    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480612    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480615    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480618    2564 flags.go:64] FLAG: --port="10250"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480621    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480626    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a0414e49a1cc35d9"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480630    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480633    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480636    2564 flags.go:64] FLAG: --register-node="true"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480639    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480643    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480646    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480649    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480652    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480656    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480659    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:12:37.488090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480662    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480665    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480669    2564 flags.go:64] FLAG: --runonce="false"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480672    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480675    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480679    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480682    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480687    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480690    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480694    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480698    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480701    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480704    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480707    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480710    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480714    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480717    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480721    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480726    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480729    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480732    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480738    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480741    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480744    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480747    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:12:37.488870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480750    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480753    2564 flags.go:64] FLAG: --v="2"
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480757    2564 flags.go:64] FLAG: --version="false"
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480761    2564 flags.go:64] FLAG: --vmodule=""
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480765    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.480769    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480894    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480898    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480901    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480905    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480908    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480910    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480913    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480916    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480920    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480923    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480926    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480929    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480933    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480935    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480938    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.489521 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480941    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480944    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480947    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480950    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480953    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480956    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480958    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480962    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480965    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480968    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480971    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480974    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480976    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480979    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480982    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480985    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480987    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480990    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480993    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480996    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.490101 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.480999    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481001    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481004    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481007    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481010    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481014    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481016    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481019    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481022    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481025    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481028    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481031    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481034    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481036    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481039    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481042    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481046    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481049    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481052    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481056    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.490697 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481061    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481064    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481067    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481070    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481073    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481076    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481079    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481083    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481086    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481089    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481092    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481095    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481097    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481100    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481103    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481106    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481108    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481112    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481115    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.491216 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481118    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481121    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481124    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481126    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481129    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481132    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481135    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481137    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481140    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481143    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481146    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481149    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481153    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481156    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481159    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481162    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481165    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481168    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481171    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481174    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.491851 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481178    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481182    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481185    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481188    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.481191    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.481918    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.489504    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.489521    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.490328    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.490336    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490421    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490427    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490432    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490436    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.492700 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490440    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490443    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490447    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490450    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490453    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490456    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490460    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490463    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490472    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490475    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490478    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490481    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490484    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490486    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490489    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490492    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490495    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490498    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490501    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490503    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.493142 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490506    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490509    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490511    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490524    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490527    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490532    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490535    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490538    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490541    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490544    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490547    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490550    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490553    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490556    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490560    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490564    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490567    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490570    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490573    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490576    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.493692 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490581    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490593    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490599    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490603    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490605    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490608    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490611    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490614    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490617    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490620    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490623    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490626    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490628    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490631    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490634    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490637    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490639    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490642    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490645    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490648    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.494220 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490651    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490653    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490656    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490659    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490662    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490665    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490667    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490670    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490673    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490676    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490679    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490681    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490684    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490687    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490699    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490702    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490705    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490708    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490711    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.494797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490714    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490716    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490719    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490722    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490725    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490728    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490730    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490733    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490736    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490741    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490745    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490748    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490751    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490755    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490758    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.495292 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490761    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.490767    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490949    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490955    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490958    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490961    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490964    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490967    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490970    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490973    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490976    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490980    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490982    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490991    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490994    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:12:37.495712 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490997    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.490999    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491002    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491005    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491007    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491010    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491013    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491016    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491019    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491021    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491024    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491027    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491030    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491034    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491039    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491042    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491052    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491055    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491057    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491061    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:12:37.496126 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491063    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491066    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491069    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491072    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491074    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491077    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491080    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491082    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491085    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491090    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491100    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491111    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491114    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491117    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491120    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491123    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491126    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491129    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491132    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:12:37.496674 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491136    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491138    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491141    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491144    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491147    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491151    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491154    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491156    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491159    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491162    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491165    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491167    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491170    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491173    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491176    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491178    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491181    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491183    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491186    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491188    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:12:37.497173 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491191    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491194    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491197    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491199    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491202    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491211    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491214    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491216    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491219    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491222    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491225    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491228    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491231    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491234    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491237    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491239    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491242    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491245    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491248    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491250    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:12:37.497709 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491253    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491256    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491258    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491261    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491264    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491267    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:37.491269    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.491275    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.491409    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.495178    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.497072    2564 server.go:1019] "Starting client certificate rotation"
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.497182    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:12:37.498227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.497216    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:12:37.501157 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.501142    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:12:37.502542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.502521    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:12:37.517353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.517333    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:12:37.519396 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.519379    2564 log.go:25] "Validated CRI v1 image API"
Jul 29 01:12:37.521001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.520986    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:12:37.524815 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.524789    2564 fs.go:135] Filesystem UUIDs: map[30f050b8-87c8-451d-8392-50083c55c874:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e84a2ad6-4650-4740-9884-bd71f34a1ba3:/dev/nvme0n1p3]
Jul 29 01:12:37.524888 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.524814    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:12:37.528471 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.528442    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:12:37.532774 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.532621    2564 manager.go:216] Machine: {Timestamp:2026-07-29 01:12:37.531059682 +0000 UTC m=+0.372807577 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100010 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212b644b44d4ab976b93b400c6df17 SystemUUID:ec212b64-4b44-d4ab-976b-93b400c6df17 BootID:11ebdf0d-50ba-4619-80a9-d4f2ef1d2430 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:f2:43:e2:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:f2:43:e2:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:50:00:a9:87:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:12:37.532774 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.532768    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:12:37.532912 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.532850    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:12:37.535597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.535565    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:12:37.535773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.535600    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-185.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:12:37.537738 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.537726    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:12:37.537773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.537740    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:12:37.537773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.537748    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:12:37.538706 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.538691    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:12:37.539558 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.539547    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:12:37.542502 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542489    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:12:37.542648 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542638    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:12:37.542691 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542670    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:12:37.542691 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542686    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:12:37.542766 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542702    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:12:37.542766 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542712    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:12:37.542766 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.542720    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:12:37.543402 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.543383    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:12:37.543474 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.543421    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:12:37.547459 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.547426    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qmp2x"
Jul 29 01:12:37.547734 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.547720    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:12:37.549810 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.549792    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:12:37.549903 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.549834    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:12:37.551469 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551456    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551473    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551479    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551486    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551495    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551502    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551514    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551523    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551531    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:12:37.551535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551537    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:12:37.551817 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551547    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:12:37.551817 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.551552    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:12:37.553455 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.553438    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:12:37.553498 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.553461    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:12:37.555510 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.555489    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qmp2x"
Jul 29 01:12:37.556425 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.556402    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:12:37.556598 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.556582    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-185.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:12:37.556731 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.556710    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:12:37.557262 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.557250    2564 server.go:1268] "Started kubelet"
Jul 29 01:12:37.557366 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.557323    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:12:37.557473 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.557418    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:12:37.557522 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.557498    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:12:37.558284 ip-10-0-140-185 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:12:37.559504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.559485    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:12:37.559934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.559904    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:12:37.562877 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.562849    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:12:37.567048 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567027    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:12:37.567153 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567044    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:12:37.567210 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.567158    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.567934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567916    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:12:37.567934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567916    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:12:37.568063 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567943    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:12:37.568063 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.567921    2564 factory.go:55] Registering systemd factory
Jul 29 01:12:37.568063 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568020    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:12:37.568200 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568144    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:12:37.568200 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568152    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:12:37.568282 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568263    2564 factory.go:153] Registering CRI-O factory
Jul 29 01:12:37.568282 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568276    2564 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:12:37.568368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568331    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:12:37.568368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568360    2564 factory.go:103] Registering Raw factory
Jul 29 01:12:37.568474 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.568375    2564 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:12:37.569208 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.569064    2564 manager.go:349] Starting recovery of all containers
Jul 29 01:12:37.571366 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.571347    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:37.574648 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.574628    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-185.ec2.internal\" not found" node="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.584812 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.584796    2564 manager.go:354] Recovery completed
Jul 29 01:12:37.589178 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.589164    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.591085 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591068    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.591157 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591104    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.591157 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591120    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.591851 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591833    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:12:37.591851 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591846    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.591991 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591848    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:12:37.591991 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.591889    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:12:37.592656 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.592633    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.592753 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.592676    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.592753 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.592694    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.593846 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.593834    2564 policy_none.go:49] "None policy: Start"
Jul 29 01:12:37.593894 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.593851    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:12:37.593894 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.593863    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:12:37.595094 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.595083    2564 policy_none.go:47] "Start"
Jul 29 01:12:37.635285 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635260    2564 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:12:37.635419 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.635301    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:12:37.635419 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635314    2564 server.go:87] "Starting device plugin registration server"
Jul 29 01:12:37.635678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635665    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:12:37.635725 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635681    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:12:37.635894 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635880    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:12:37.636026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635959    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:12:37.636026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.635967    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:12:37.636702 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.636672    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:12:37.636773 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.636742    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.736864 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.736804    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.742690 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.742668    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.742824 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.742710    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.742824 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.742729    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.742824 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.742767    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.752544 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.752521    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.752627 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.752550    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-185.ec2.internal\": node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.766737 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.766717    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.797724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.797681    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:12:37.798889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.798875    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:12:37.798953 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.798917    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:12:37.798953 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.798943    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:12:37.799033 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.798977    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:12:37.801334 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.801312    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:37.869537 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.869487    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.901080 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.901028    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"]
Jul 29 01:12:37.901152 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.901145    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.903325 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.903308    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.903406 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.903340    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.903406 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.903351    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.904619 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.904606    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.904741 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.904726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.904783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.904758    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.905448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905432    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.905547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905465    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.905547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905435    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.905547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905477    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.905547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905491    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.905547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.905503    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.906752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.906739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.906806 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.906763    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:12:37.907591 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.907574    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:12:37.907662 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.907601    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:12:37.907662 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.907618    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:12:37.939449 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.939428    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-185.ec2.internal\" not found" node="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.944345 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.944326    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-185.ec2.internal\" not found" node="ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.969726 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:37.969702    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:37.969839 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.969765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.969839 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.969787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92aa1923735291b61478f523669c7af8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"92aa1923735291b61478f523669c7af8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:37.969839 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:37.969806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070734 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.070635    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.070734 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070734 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070734 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92aa1923735291b61478f523669c7af8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"92aa1923735291b61478f523669c7af8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070989 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070989 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070756    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/92aa1923735291b61478f523669c7af8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"92aa1923735291b61478f523669c7af8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.070989 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.070760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96f53b3100180b7e57940a1d1a844aea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"96f53b3100180b7e57940a1d1a844aea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.174852 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.174797    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.243545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.243488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.248655 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.248622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:38.275428 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.275389    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.375686 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.375579    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.476700 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.476666    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.496278 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.496245    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:12:38.496431 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.496412    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:12:38.496474 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.496445    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:12:38.561088 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.561034    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:07:38 +0000 UTC" deadline="2028-04-29 11:00:13.529299438 +0000 UTC"
Jul 29 01:12:38.561088 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.561078    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15369h47m34.968225421s"
Jul 29 01:12:38.577475 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.577448    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.678476 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.678378    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.762318 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.762290    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:38.778917 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.778876    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.818077 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:38.818042    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92aa1923735291b61478f523669c7af8.slice/crio-b716fe1ff853b947920cd967a732e8270448c6e3a83f9d5577e7675d2ce1b732 WatchSource:0}: Error finding container b716fe1ff853b947920cd967a732e8270448c6e3a83f9d5577e7675d2ce1b732: Status 404 returned error can't find the container with id b716fe1ff853b947920cd967a732e8270448c6e3a83f9d5577e7675d2ce1b732
Jul 29 01:12:38.819135 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:38.819111    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f53b3100180b7e57940a1d1a844aea.slice/crio-b923a3f3086e8e8d7bfb8a9f49e22fc6fb5893714d4c51f435635b3a8e8e8bc7 WatchSource:0}: Error finding container b923a3f3086e8e8d7bfb8a9f49e22fc6fb5893714d4c51f435635b3a8e8e8bc7: Status 404 returned error can't find the container with id b923a3f3086e8e8d7bfb8a9f49e22fc6fb5893714d4c51f435635b3a8e8e8bc7
Jul 29 01:12:38.824496 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:38.824476    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:12:38.879345 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.879300    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:38.980142 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:38.980046    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:39.080689 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.080655    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found"
Jul 29 01:12:39.143812 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.143777    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:39.168260 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.168228    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:39.181094 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.180867    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:12:39.182978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.182251    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"
Jul 29 01:12:39.190810 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.190789    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:12:39.547212 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.547170    2564 apiserver.go:52] "Watching apiserver"
Jul 29 01:12:39.556071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.556028    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:12:39.556573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.556523    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-48frw","openshift-network-operator/iptables-alerter-bpjfl","openshift-ovn-kubernetes/ovnkube-node-jxjmw","kube-system/global-pull-secret-syncer-pvzzv","kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9jhsb","openshift-image-registry/node-ca-gl4ch","openshift-multus/multus-additional-cni-plugins-9gtcl","openshift-multus/multus-gbwvv","openshift-multus/network-metrics-daemon-4rbht","kube-system/konnectivity-agent-c64gs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2","openshift-dns/node-resolver-7mfs5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal"]
Jul 29 01:12:39.558699 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.558664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.560447 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.560416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.561400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.561377    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:12:39.561808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.561775    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.561911 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.561839    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.561978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.561923    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fk7s9\""
Jul 29 01:12:39.562952 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.562392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.563383 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.563240    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bv5fs\""
Jul 29 01:12:39.563383 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.563258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:12:39.563383 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.563270    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:12:39.565008 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.564863    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.565358 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.565338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.565437 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.565410    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:39.566302 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.566391 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566345    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:12:39.566559 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566468    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bs558\""
Jul 29 01:12:39.566649 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566554    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:12:39.566729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:12:39.567071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.566904    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:12:39.567896 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.567447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.567896 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.567582    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:12:39.569840 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.569803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.570186 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570165    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:12:39.570413 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570341    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-49mch\""
Jul 29 01:12:39.570722 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.570807 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570765    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:12:39.570983 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570711    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:12:39.570983 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.570913    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.572100 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.572073    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.572408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.572378    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.572852 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.572814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fp5nd\""
Jul 29 01:12:39.573039 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.573021    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.574680 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.574650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.575280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.574999    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:12:39.575280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.575234    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2v7k4\""
Jul 29 01:12:39.577672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.577115    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.577672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.577389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wslv\""
Jul 29 01:12:39.577672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.577405    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.577672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.577619    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.579630 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.579610    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.581526 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.579746    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:39.581749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.581715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.581857 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.581761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:12:39.582205 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.581761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.583034 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.582539    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:12:39.583219 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583157    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jqfq4\""
Jul 29 01:12:39.583293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-host\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.583606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-netns\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.583606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-etc-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.583606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-bin\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-env-overrides\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-os-release\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.583957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-conf\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-systemd\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-node-log\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-script-lib\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-dbus\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.584415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-var-lib-kubelet\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-slash\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-system-cni-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cnibin\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48q8\" (UniqueName: \"kubernetes.io/projected/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-kube-api-access-n48q8\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysconfig\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shsww\" (UniqueName: \"kubernetes.io/projected/25154cae-3136-4774-83df-0274c832c6d3-kube-api-access-shsww\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-systemd-units\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-var-lib-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585062 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.584999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-ovn\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585682 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.585079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.585682 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.585124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-modprobe-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586134 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.585526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-kubernetes\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586348 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-run\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-host\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.586448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:39.586587 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-serviceca\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.586587 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed690a15-659f-4bf7-9a02-7f0ac2f29205-agent-certs\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.586704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-config\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.586704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-sys\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586704 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.586663    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:39.586865 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-etc-tuned\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586865 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-tmp\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.586978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed690a15-659f-4bf7-9a02-7f0ac2f29205-konnectivity-ca\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.586978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.586960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-systemd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587097 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-netd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587182 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-kubelet-config\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.587261 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-lib-modules\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.587261 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwl7j\" (UniqueName: \"kubernetes.io/projected/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-kube-api-access-pwl7j\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.587368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-log-socket\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-kubelet\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb67k\" (UniqueName: \"kubernetes.io/projected/f74d2f1c-2311-4de9-9c42-aee318c589c7-kube-api-access-fb67k\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.587545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.587418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.589944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.589769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.592491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.592447    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:12:39.592491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.592468    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:12:39.592676 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.592589    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v4zf\""
Jul 29 01:12:39.592676 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.592604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:12:39.599610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.599586    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kzpl"
Jul 29 01:12:39.607611 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.607583    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5kzpl"
Jul 29 01:12:39.669847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.669789    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:12:39.688139 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-system-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-hostroot\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shsww\" (UniqueName: \"kubernetes.io/projected/25154cae-3136-4774-83df-0274c832c6d3-kube-api-access-shsww\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-systemd-units\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-var-lib-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-ovn\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-bin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688310 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j59zb\" (UniqueName: \"kubernetes.io/projected/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-kube-api-access-j59zb\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcd99\" (UniqueName: \"kubernetes.io/projected/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-kube-api-access-zcd99\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-run\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-serviceca\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-config\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-etc-tuned\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-var-lib-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed690a15-659f-4bf7-9a02-7f0ac2f29205-konnectivity-ca\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-netd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-systemd-units\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-kubelet-config\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-run\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-daemon-config\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-multus-certs\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-ovn\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.688693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f43299-4d43-4302-9b9f-9711d73ac59c-iptables-alerter-script\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb67k\" (UniqueName: \"kubernetes.io/projected/f74d2f1c-2311-4de9-9c42-aee318c589c7-kube-api-access-fb67k\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-netd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-kubelet-config\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.688979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-hosts-file\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689004    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-netns\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-etc-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-bin\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-os-release\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-serviceca\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-socket-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-cni-bin\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.689504 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-multus\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-systemd\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-os-release\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-netns\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed690a15-659f-4bf7-9a02-7f0ac2f29205-konnectivity-ca\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-config\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689422    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-netns\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-systemd\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-etc-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.689545    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.689676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:40.189642265 +0000 UTC m=+3.031390179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-var-lib-kubelet\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cnibin\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.690379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-var-lib-kubelet\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-openvswitch\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n48q8\" (UniqueName: \"kubernetes.io/projected/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-kube-api-access-n48q8\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.689997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cnibin\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysconfig\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-binary-copy\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-sys-fs\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysconfig\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cnibin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cni-binary-copy\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.691227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-tmp-dir\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4b2\" (UniqueName: \"kubernetes.io/projected/20f43299-4d43-4302-9b9f-9711d73ac59c-kube-api-access-8t4b2\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-modprobe-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690418    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-kubernetes\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-host\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed690a15-659f-4bf7-9a02-7f0ac2f29205-agent-certs\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-modprobe-d\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-sys\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-tmp\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-kubernetes\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-host\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-systemd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxwfv\" (UniqueName: \"kubernetes.io/projected/30ee7c33-2828-449b-b57a-8a296d86a97b-kube-api-access-jxwfv\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-etc-kubernetes\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-lib-modules\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwl7j\" (UniqueName: \"kubernetes.io/projected/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-kube-api-access-pwl7j\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-log-socket\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-os-release\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-socket-dir-parent\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-kubelet\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-registration-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-device-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-k8s-cni-cncf-io\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-host\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-env-overrides\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-conf-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.690998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-sys\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691017    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f43299-4d43-4302-9b9f-9711d73ac59c-host-slash\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-conf\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-node-log\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-lib-modules\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-script-lib\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-host\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.692647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-kubelet\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691116    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-node-log\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-dbus\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25154cae-3136-4774-83df-0274c832c6d3-etc-sysctl-conf\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-kubelet\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vncrj\" (UniqueName: \"kubernetes.io/projected/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-kube-api-access-vncrj\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-slash\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-system-cni-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae66d154-203d-4bc9-bab1-374aa5460475-dbus\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-env-overrides\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-host-slash\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-system-cni-dir\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-log-socket\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovnkube-script-lib\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.691828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f74d2f1c-2311-4de9-9c42-aee318c589c7-run-systemd\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.693283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.692156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.694069 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.692162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.694069 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.693102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-etc-tuned\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.694069 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.693120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25154cae-3136-4774-83df-0274c832c6d3-tmp\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.694069 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.693134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f74d2f1c-2311-4de9-9c42-aee318c589c7-ovn-node-metrics-cert\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.694286 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.694200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed690a15-659f-4bf7-9a02-7f0ac2f29205-agent-certs\") pod \"konnectivity-agent-c64gs\" (UID: \"ed690a15-659f-4bf7-9a02-7f0ac2f29205\") " pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.701847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.701805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb67k\" (UniqueName: \"kubernetes.io/projected/f74d2f1c-2311-4de9-9c42-aee318c589c7-kube-api-access-fb67k\") pod \"ovnkube-node-jxjmw\" (UID: \"f74d2f1c-2311-4de9-9c42-aee318c589c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.702637 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.702558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shsww\" (UniqueName: \"kubernetes.io/projected/25154cae-3136-4774-83df-0274c832c6d3-kube-api-access-shsww\") pod \"tuned-9jhsb\" (UID: \"25154cae-3136-4774-83df-0274c832c6d3\") " pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.703422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.703372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwl7j\" (UniqueName: \"kubernetes.io/projected/2705e66e-d0e1-4f2a-8bf6-18248372d4ba-kube-api-access-pwl7j\") pod \"node-ca-gl4ch\" (UID: \"2705e66e-d0e1-4f2a-8bf6-18248372d4ba\") " pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.704424 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.704400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48q8\" (UniqueName: \"kubernetes.io/projected/2f70949d-dcd7-43f0-8c99-f390bfaf2fe3-kube-api-access-n48q8\") pod \"multus-additional-cni-plugins-9gtcl\" (UID: \"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3\") " pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.792163 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-kubelet\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vncrj\" (UniqueName: \"kubernetes.io/projected/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-kube-api-access-vncrj\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792234    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-kubelet\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-system-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-hostroot\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-bin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j59zb\" (UniqueName: \"kubernetes.io/projected/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-kube-api-access-j59zb\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcd99\" (UniqueName: \"kubernetes.io/projected/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-kube-api-access-zcd99\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-hostroot\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-daemon-config\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-bin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-system-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-multus-certs\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f43299-4d43-4302-9b9f-9711d73ac59c-iptables-alerter-script\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-hosts-file\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-socket-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-multus\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-netns\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-multus-certs\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.792763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-cni-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-netns\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.792900    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-sys-fs\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cnibin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.792979    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:12:40.292957807 +0000 UTC m=+3.134705715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.792993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-var-lib-cni-multus\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cni-binary-copy\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-hosts-file\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-tmp-dir\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-sys-fs\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-socket-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4b2\" (UniqueName: \"kubernetes.io/projected/20f43299-4d43-4302-9b9f-9711d73ac59c-kube-api-access-8t4b2\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxwfv\" (UniqueName: \"kubernetes.io/projected/30ee7c33-2828-449b-b57a-8a296d86a97b-kube-api-access-jxwfv\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.793454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-etc-kubernetes\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-os-release\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-daemon-config\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-etc-kubernetes\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-socket-dir-parent\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-os-release\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cnibin\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-socket-dir-parent\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-registration-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-device-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-k8s-cni-cncf-io\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-tmp-dir\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-conf-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f43299-4d43-4302-9b9f-9711d73ac59c-host-slash\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-registration-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-multus-conf-dir\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794199 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f43299-4d43-4302-9b9f-9711d73ac59c-host-slash\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.794818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-host-run-k8s-cni-cncf-io\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30ee7c33-2828-449b-b57a-8a296d86a97b-device-dir\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.794818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-cni-binary-copy\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.794818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.793736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f43299-4d43-4302-9b9f-9711d73ac59c-iptables-alerter-script\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.799612 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.799538    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:39.799612 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.799566    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:39.799612 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.799580    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:39.799837 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:39.799672    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:40.299653579 +0000 UTC m=+3.141401484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:39.802407 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.802377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcd99\" (UniqueName: \"kubernetes.io/projected/c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6-kube-api-access-zcd99\") pod \"node-resolver-7mfs5\" (UID: \"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6\") " pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.803196 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.803167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j59zb\" (UniqueName: \"kubernetes.io/projected/bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6-kube-api-access-j59zb\") pod \"multus-gbwvv\" (UID: \"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6\") " pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.804408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.804345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vncrj\" (UniqueName: \"kubernetes.io/projected/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-kube-api-access-vncrj\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:39.804408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.804356    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"96f53b3100180b7e57940a1d1a844aea","Type":"ContainerStarted","Data":"b923a3f3086e8e8d7bfb8a9f49e22fc6fb5893714d4c51f435635b3a8e8e8bc7"}
Jul 29 01:12:39.805261 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.805214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxwfv\" (UniqueName: \"kubernetes.io/projected/30ee7c33-2828-449b-b57a-8a296d86a97b-kube-api-access-jxwfv\") pod \"aws-ebs-csi-driver-node-v29h2\" (UID: \"30ee7c33-2828-449b-b57a-8a296d86a97b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.805365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.805321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4b2\" (UniqueName: \"kubernetes.io/projected/20f43299-4d43-4302-9b9f-9711d73ac59c-kube-api-access-8t4b2\") pod \"iptables-alerter-bpjfl\" (UID: \"20f43299-4d43-4302-9b9f-9711d73ac59c\") " pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.805844 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.805804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" event={"ID":"92aa1923735291b61478f523669c7af8","Type":"ContainerStarted","Data":"b716fe1ff853b947920cd967a732e8270448c6e3a83f9d5577e7675d2ce1b732"}
Jul 29 01:12:39.825314 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.825291    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:39.871920 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.871881    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gl4ch"
Jul 29 01:12:39.882633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.882602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:12:39.893722 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.893697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:12:39.901676 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.901654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9gtcl"
Jul 29 01:12:39.909577 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.909547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jhsb"
Jul 29 01:12:39.916680 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.916657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gbwvv"
Jul 29 01:12:39.925615 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.925589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7mfs5"
Jul 29 01:12:39.935655 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.935618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpjfl"
Jul 29 01:12:39.942637 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.942616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2"
Jul 29 01:12:39.958353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:39.958320    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:12:40.197304 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.197219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:40.197495 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.197398    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:40.197495 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.197473    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:41.197454904 +0000 UTC m=+4.039202810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:40.298217 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.298182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:40.298385 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.298352    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:40.298439 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.298428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:12:41.298408049 +0000 UTC m=+4.140155935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:40.399082 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.399035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:40.399302 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.399206    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:40.399302 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.399253    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:40.399302 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.399265    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:40.399472 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.399333    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:41.399310251 +0000 UTC m=+4.241058160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:40.610545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.610437    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:07:40 +0000 UTC" deadline="2028-01-01 03:37:26.621379991 +0000 UTC"
Jul 29 01:12:40.610545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.610467    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12506h24m46.010916413s"
Jul 29 01:12:40.799783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.799747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:40.799922 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:40.799760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:40.799922 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.799860    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:40.800011 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:40.799932    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:40.839981 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.839888    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded690a15_659f_4bf7_9a02_7f0ac2f29205.slice/crio-e9b1647fb5602f28a89b1595e61e231770111f96dae29ea753198b9e2643b111 WatchSource:0}: Error finding container e9b1647fb5602f28a89b1595e61e231770111f96dae29ea753198b9e2643b111: Status 404 returned error can't find the container with id e9b1647fb5602f28a89b1595e61e231770111f96dae29ea753198b9e2643b111
Jul 29 01:12:40.842134 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.841976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25154cae_3136_4774_83df_0274c832c6d3.slice/crio-eb1bbf1b771bb824ec75be3cf4f23ac92063fd8fa9c7c7ec07b2a8aa0759a150 WatchSource:0}: Error finding container eb1bbf1b771bb824ec75be3cf4f23ac92063fd8fa9c7c7ec07b2a8aa0759a150: Status 404 returned error can't find the container with id eb1bbf1b771bb824ec75be3cf4f23ac92063fd8fa9c7c7ec07b2a8aa0759a150
Jul 29 01:12:40.846040 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.846005    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74d2f1c_2311_4de9_9c42_aee318c589c7.slice/crio-ff3c57c711f80283423a094fea80630d5d83e048f10bec1fcef86dd9964aaf97 WatchSource:0}: Error finding container ff3c57c711f80283423a094fea80630d5d83e048f10bec1fcef86dd9964aaf97: Status 404 returned error can't find the container with id ff3c57c711f80283423a094fea80630d5d83e048f10bec1fcef86dd9964aaf97
Jul 29 01:12:40.846933 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.846901    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4f5fa0_2d04_4844_8a6d_3f31d9d025b6.slice/crio-196f8d7cb283b8b51049349e56727c870738e4c8553e8c16abf1291fcac4f2e6 WatchSource:0}: Error finding container 196f8d7cb283b8b51049349e56727c870738e4c8553e8c16abf1291fcac4f2e6: Status 404 returned error can't find the container with id 196f8d7cb283b8b51049349e56727c870738e4c8553e8c16abf1291fcac4f2e6
Jul 29 01:12:40.847218 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.847190    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f43299_4d43_4302_9b9f_9711d73ac59c.slice/crio-5d239400b1f53d20013c74fac3eb7c8dc0c5a78558f26ff81ceade43e5aeea86 WatchSource:0}: Error finding container 5d239400b1f53d20013c74fac3eb7c8dc0c5a78558f26ff81ceade43e5aeea86: Status 404 returned error can't find the container with id 5d239400b1f53d20013c74fac3eb7c8dc0c5a78558f26ff81ceade43e5aeea86
Jul 29 01:12:40.857037 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:12:40.856806    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f70949d_dcd7_43f0_8c99_f390bfaf2fe3.slice/crio-05bd1405cfba7bf7cf75a5fc050971c2c24da5d4f67816757d534a007a2f39a9 WatchSource:0}: Error finding container 05bd1405cfba7bf7cf75a5fc050971c2c24da5d4f67816757d534a007a2f39a9: Status 404 returned error can't find the container with id 05bd1405cfba7bf7cf75a5fc050971c2c24da5d4f67816757d534a007a2f39a9
Jul 29 01:12:41.206990 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.206874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:41.207151 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.207043    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:41.207151 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.207129    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:43.207107312 +0000 UTC m=+6.048855198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:41.307412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.307372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:41.307624 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.307610    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:41.308079 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.307688    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:12:43.307665546 +0000 UTC m=+6.149413497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:41.408939 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.408206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:41.408939 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.408396    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:41.408939 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.408419    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:41.408939 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.408433    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:41.408939 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.408500    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:43.408479809 +0000 UTC m=+6.250227714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:41.610724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.610652    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:07:40 +0000 UTC" deadline="2028-02-09 01:46:00.853826044 +0000 UTC"
Jul 29 01:12:41.610724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.610719    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13440h33m19.243110765s"
Jul 29 01:12:41.802425 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.801869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:41.802425 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:41.802012    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:41.839720 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.839680    2564 generic.go:356] "Generic (PLEG): container finished" podID="96f53b3100180b7e57940a1d1a844aea" containerID="807d5299010ef3c73de6f9137fef90ff1d5d7d7521cac521599473cae71b1bc9" exitCode=0
Jul 29 01:12:41.839908 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.839787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"96f53b3100180b7e57940a1d1a844aea","Type":"ContainerDied","Data":"807d5299010ef3c73de6f9137fef90ff1d5d7d7521cac521599473cae71b1bc9"}
Jul 29 01:12:41.849462 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.849403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbwvv" event={"ID":"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6","Type":"ContainerStarted","Data":"196f8d7cb283b8b51049349e56727c870738e4c8553e8c16abf1291fcac4f2e6"}
Jul 29 01:12:41.870985 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.870946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2" event={"ID":"30ee7c33-2828-449b-b57a-8a296d86a97b","Type":"ContainerStarted","Data":"06c6977c54d9788997122bb779bb03ce2d0cfcbfd70d8881ee4806e129853a31"}
Jul 29 01:12:41.881020 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.880987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gl4ch" event={"ID":"2705e66e-d0e1-4f2a-8bf6-18248372d4ba","Type":"ContainerStarted","Data":"c02b5eeb1bd01332f4d0104ac012d539adfbd3ac2da90a3e25f2a99455e61249"}
Jul 29 01:12:41.892490 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.892359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mfs5" event={"ID":"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6","Type":"ContainerStarted","Data":"487bc175314a462522b80f4c3c657b32ed0444618cff1a679197517b9e0a1cce"}
Jul 29 01:12:41.905792 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.905694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpjfl" event={"ID":"20f43299-4d43-4302-9b9f-9711d73ac59c","Type":"ContainerStarted","Data":"5d239400b1f53d20013c74fac3eb7c8dc0c5a78558f26ff81ceade43e5aeea86"}
Jul 29 01:12:41.922185 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.922146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"ff3c57c711f80283423a094fea80630d5d83e048f10bec1fcef86dd9964aaf97"}
Jul 29 01:12:41.944111 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.944071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c64gs" event={"ID":"ed690a15-659f-4bf7-9a02-7f0ac2f29205","Type":"ContainerStarted","Data":"e9b1647fb5602f28a89b1595e61e231770111f96dae29ea753198b9e2643b111"}
Jul 29 01:12:41.947269 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.947168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" event={"ID":"92aa1923735291b61478f523669c7af8","Type":"ContainerStarted","Data":"aa2d0c38dec916230168846e23310481150114b8efd695a1812359af4bd37cca"}
Jul 29 01:12:41.958541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.958504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerStarted","Data":"05bd1405cfba7bf7cf75a5fc050971c2c24da5d4f67816757d534a007a2f39a9"}
Jul 29 01:12:41.962693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.962636    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" podStartSLOduration=2.962616315 podStartE2EDuration="2.962616315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:41.962437807 +0000 UTC m=+4.804185714" watchObservedRunningTime="2026-07-29 01:12:41.962616315 +0000 UTC m=+4.804364223"
Jul 29 01:12:41.972913 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:41.972881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jhsb" event={"ID":"25154cae-3136-4774-83df-0274c832c6d3","Type":"ContainerStarted","Data":"eb1bbf1b771bb824ec75be3cf4f23ac92063fd8fa9c7c7ec07b2a8aa0759a150"}
Jul 29 01:12:42.800456 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:42.800031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:42.800456 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:42.800176    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:42.800456 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:42.800258    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:42.800456 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:42.800339    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:42.989677 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:42.989636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"96f53b3100180b7e57940a1d1a844aea","Type":"ContainerStarted","Data":"ed2a39834084533a80be52052bbf105012257be7188be97303b8d682d1480cba"}
Jul 29 01:12:43.006760 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:43.006698    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" podStartSLOduration=4.006678369 podStartE2EDuration="4.006678369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:43.006388852 +0000 UTC m=+5.848136760" watchObservedRunningTime="2026-07-29 01:12:43.006678369 +0000 UTC m=+5.848426278"
Jul 29 01:12:43.225323 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:43.225233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:43.225507 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.225420    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:43.225598 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.225568    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.225465235 +0000 UTC m=+10.067213144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:43.325810 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:43.325772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:43.325999 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.325933    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:43.326074 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.326005    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.325976018 +0000 UTC m=+10.167723904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:43.426591 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:43.426542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:43.426871 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.426844    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:43.426967 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.426873    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:43.426967 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.426886    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:43.426967 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.426952    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:47.426930257 +0000 UTC m=+10.268678142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:43.803001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:43.802237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:43.803001 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:43.802400    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:44.800073 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:44.800031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:44.800270 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:44.800229    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:44.800863 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:44.800700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:44.800863 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:44.800808    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:45.799749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:45.799651    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:45.800257 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:45.799800    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:46.800739 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:46.800067    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:46.800739 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:46.800187    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:46.800739 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:46.800580    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:46.800739 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:46.800688    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:47.257668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:47.257577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:47.257883 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.257766    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:47.257883 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.257848    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:55.257826133 +0000 UTC m=+18.099574018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:47.359040 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:47.359000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:47.359203 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.359159    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:47.359258 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.359226    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:12:55.359207162 +0000 UTC m=+18.200955062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:47.459926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:47.459879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:47.460108 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.460076    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:47.460108 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.460099    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:47.460218 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.460112    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:47.460218 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.460171    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:55.460152874 +0000 UTC m=+18.301900773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:47.801150 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:47.800692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:47.801150 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:47.800816    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:48.800076 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:48.799915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:48.800076 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:48.800041    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:48.800323 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:48.800146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:48.800323 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:48.800250    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:49.799930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:49.799895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:49.800378 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:49.800057    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:50.800023 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:50.799990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:50.800023 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:50.800029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:50.800493 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:50.800110    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:50.800493 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:50.800245    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:51.799366 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:51.799335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:51.799541 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:51.799437    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:52.799403 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:52.799371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:52.799853 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:52.799372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:52.799853 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:52.799485    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:52.799853 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:52.799594    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:53.800122 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:53.800077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:53.800552 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:53.800228    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:54.799762 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:54.799723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:54.799976 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:54.799724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:54.799976 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:54.799865    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:54.799976 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:54.799903    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:55.316289 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:55.316254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:55.316819 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.316431    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:55.316819 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.316526    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:11.316491753 +0000 UTC m=+34.158239643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:12:55.417554 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:55.417495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:55.417727 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.417657    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:55.417782 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.417738    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:13:11.417721492 +0000 UTC m=+34.259469373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:12:55.518133 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:55.518098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:55.518323 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.518299    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:12:55.518379 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.518330    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:12:55.518379 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.518345    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:55.518456 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.518412    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:11.51839386 +0000 UTC m=+34.360141757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:12:55.800281 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:55.800197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:55.800440 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:55.800342    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:56.799826 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:56.799792    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:56.800292 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:56.799916    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:56.800292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:56.799969    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:56.800292 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:56.800084    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:57.800526 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:57.800482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:57.800998 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:57.800627    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:12:58.799394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:58.799356    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:12:58.799612 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:58.799422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:12:58.799612 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:58.799571    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:12:58.799733 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:58.799667    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:12:59.802934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:12:59.802415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:12:59.802934 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:12:59.802688    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:00.023572 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.023360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2" event={"ID":"30ee7c33-2828-449b-b57a-8a296d86a97b","Type":"ContainerStarted","Data":"26c932a8df9ad82f384d3e4fb20f516f778d5404dec89cac3920dd4ad082754a"}
Jul 29 01:13:00.024798 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.024771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gl4ch" event={"ID":"2705e66e-d0e1-4f2a-8bf6-18248372d4ba","Type":"ContainerStarted","Data":"155d7bef8336b69849cecbdef395814e2f8d1149a98904521ad4ff6411ae53a7"}
Jul 29 01:13:00.026326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.026297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7mfs5" event={"ID":"c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6","Type":"ContainerStarted","Data":"cc4cb3683c9ff372dc9be68745f7bbcefc460aca0e994a9bacf998c20ad9deda"}
Jul 29 01:13:00.028051 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.028028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"43fdb53dfc63cd2f2e3b1b345d1d6864f25f7b635ece0d23672edb574462cb31"}
Jul 29 01:13:00.028148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.028128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"135911347e8fa9230664bc8a8583366d487e886168571ca831f6cab2eab905d2"}
Jul 29 01:13:00.029493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.029468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c64gs" event={"ID":"ed690a15-659f-4bf7-9a02-7f0ac2f29205","Type":"ContainerStarted","Data":"2e38f3e198f58277cba759b27cc478268aa572e0b46e576c6a486d489d40dbde"}
Jul 29 01:13:00.030955 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.030928    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="7d4d6ccea818f5906b521aa1efdd65a0b17b427f628d04278b672e37159722c9" exitCode=0
Jul 29 01:13:00.031037 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.031004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"7d4d6ccea818f5906b521aa1efdd65a0b17b427f628d04278b672e37159722c9"}
Jul 29 01:13:00.035277 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.035255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jhsb" event={"ID":"25154cae-3136-4774-83df-0274c832c6d3","Type":"ContainerStarted","Data":"85a606d787cf8ee1c5fe60795eaa2ac23ace197e1921a71d87e45c8b360d19b7"}
Jul 29 01:13:00.037065 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.037040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gbwvv" event={"ID":"bc4f5fa0-2d04-4844-8a6d-3f31d9d025b6","Type":"ContainerStarted","Data":"98aaa0863d30cad32a17de290e0acfe4bfcce81d3547ce594cdef2661e7c5a85"}
Jul 29 01:13:00.043181 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.043143    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gl4ch" podStartSLOduration=3.200746374 podStartE2EDuration="22.043131644s" totalImagesPullingTime="18.84238527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:00.043081459 +0000 UTC m=+22.884829415" watchObservedRunningTime="2026-07-29 01:13:00.043131644 +0000 UTC m=+22.884879577"
Jul 29 01:13:00.083954 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.083895    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9jhsb" podStartSLOduration=3.225983614 podStartE2EDuration="22.083874071s" totalImagesPullingTime="18.857890457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:00.083036433 +0000 UTC m=+22.924784336" watchObservedRunningTime="2026-07-29 01:13:00.083874071 +0000 UTC m=+22.925621975"
Jul 29 01:13:00.103440 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.103369    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gbwvv" podStartSLOduration=3.191547865 podStartE2EDuration="22.1033455s" totalImagesPullingTime="18.911797635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:00.102375552 +0000 UTC m=+22.944123465" watchObservedRunningTime="2026-07-29 01:13:00.1033455 +0000 UTC m=+22.945093403"
Jul 29 01:13:00.142254 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.142197    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c64gs" podStartSLOduration=3.28191682 podStartE2EDuration="22.142182318s" totalImagesPullingTime="18.860265498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:00.141935613 +0000 UTC m=+22.983683515" watchObservedRunningTime="2026-07-29 01:13:00.142182318 +0000 UTC m=+22.983930220"
Jul 29 01:13:00.142457 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.142366    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7mfs5" podStartSLOduration=3.284966868 podStartE2EDuration="22.14235896s" totalImagesPullingTime="18.857392092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:00.120307017 +0000 UTC m=+22.962054921" watchObservedRunningTime="2026-07-29 01:13:00.14235896 +0000 UTC m=+22.984106865"
Jul 29 01:13:00.799749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.799713    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:00.799749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:00.799747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:00.800207 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:00.799853    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:00.800207 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:00.799999    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:01.041973 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.041936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpjfl" event={"ID":"20f43299-4d43-4302-9b9f-9711d73ac59c","Type":"ContainerStarted","Data":"6ca69e34c3a1faa804dc371f1c927c2e6374374e597da049f3b0d78dec43b7ee"}
Jul 29 01:13:01.046926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.046890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"e1c0431cc21a53275e6884a7f7fa856390ce3b0bed91af49dcbc1e211e24193a"}
Jul 29 01:13:01.047052 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.046983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"eb5e65d72c79765aefe0a5c61c9b6363036443d867516ea86f499daff5f90cc0"}
Jul 29 01:13:01.047052 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.047033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"d5bfe493a48e7b4f1c2d511f59d9a7c4e86822d0091ea856ce25c1df2c7e979b"}
Jul 29 01:13:01.047147 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.047080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"a8e28f9c86ce4f44db9219462a99d2247052fa62aeb17d89f58bbdb601903a76"}
Jul 29 01:13:01.267313 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.267285    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:13:01.649189 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.649106    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:13:01.267307901Z","UUID":"96caf2fd-b31c-43b2-aabd-f50fbf843bd7","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:13:01.650682 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.650662    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:13:01.650818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.650706    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:13:01.800685 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:01.800647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:01.800859 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:01.800796    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:02.051246 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:02.051151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2" event={"ID":"30ee7c33-2828-449b-b57a-8a296d86a97b","Type":"ContainerStarted","Data":"9f3ae4ea76044c972464d7099cb24c11c910a1d67795c0864e50317ff7e53dc0"}
Jul 29 01:13:02.065265 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:02.065208    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bpjfl" podStartSLOduration=5.2044624 podStartE2EDuration="24.065186629s" totalImagesPullingTime="18.860724229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:02.064809604 +0000 UTC m=+24.906557506" watchObservedRunningTime="2026-07-29 01:13:02.065186629 +0000 UTC m=+24.906934535"
Jul 29 01:13:02.799589 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:02.799367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:02.799722 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:02.799402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:02.799722 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:02.799646    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:02.799795 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:02.799744    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:03.057589 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.057510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"2aeedac767e25cf9a2af5b6ef73729d351d3dce5a66fcabf26a93cbf7ca27646"}
Jul 29 01:13:03.059794 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.059761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2" event={"ID":"30ee7c33-2828-449b-b57a-8a296d86a97b","Type":"ContainerStarted","Data":"e7a23f8b21bd913da1f8c31b6e401d353e420a71eba317655cd553ec76dc49c0"}
Jul 29 01:13:03.078456 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.078408    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v29h2" podStartSLOduration=3.833755009 podStartE2EDuration="25.078393136s" totalImagesPullingTime="21.244638127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:03.078026142 +0000 UTC m=+25.919774044" watchObservedRunningTime="2026-07-29 01:13:03.078393136 +0000 UTC m=+25.920141048"
Jul 29 01:13:03.113097 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.113059    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:13:03.113756 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.113734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:13:03.799397 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:03.799367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:03.799636 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:03.799524    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:04.062240 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:04.062161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:13:04.062886 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:04.062697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c64gs"
Jul 29 01:13:04.799743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:04.799315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:04.799743 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:04.799627    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:04.799743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:04.799364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:04.800094 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:04.799796    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:05.067332 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.067215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" event={"ID":"f74d2f1c-2311-4de9-9c42-aee318c589c7","Type":"ContainerStarted","Data":"ecd1f5132e8a91bc308b70435def949335fc5284ef649bea7d8705c0a5183b08"}
Jul 29 01:13:05.067875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.067522    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:05.067875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.067605    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:05.068997 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.068971    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="844680745c04216499e6414594e03254b385dfcce8fc98ee3bbf9dae9b0547e6" exitCode=0
Jul 29 01:13:05.069101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.069025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"844680745c04216499e6414594e03254b385dfcce8fc98ee3bbf9dae9b0547e6"}
Jul 29 01:13:05.083541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.083522    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:05.102458 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.102411    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw" podStartSLOduration=8.190986954 podStartE2EDuration="27.102396158s" totalImagesPullingTime="18.911409204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:05.101976935 +0000 UTC m=+27.943724837" watchObservedRunningTime="2026-07-29 01:13:05.102396158 +0000 UTC m=+27.944144060"
Jul 29 01:13:05.799368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:05.799284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:05.799641 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:05.799418    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:06.073024 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.072941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:06.087769 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.087745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:06.711677 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.711416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4rbht"]
Jul 29 01:13:06.711847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.711791    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:06.711941 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:06.711917    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:06.714330 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.714296    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48frw"]
Jul 29 01:13:06.714475 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.714408    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:06.714582 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:06.714521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:06.714987 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.714963    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvzzv"]
Jul 29 01:13:06.715093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:06.715057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:06.715174 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:06.715149    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:07.076762 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:07.076684    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="ab3bb0d5b26d53fe7f8b0000222a10a4ce9e8ab1d6044a5d40d5acc57098d1d3" exitCode=0
Jul 29 01:13:07.077186 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:07.076765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"ab3bb0d5b26d53fe7f8b0000222a10a4ce9e8ab1d6044a5d40d5acc57098d1d3"}
Jul 29 01:13:08.799556 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:08.799523    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:08.800273 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:08.799566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:08.800273 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:08.799526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:08.800273 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:08.799634    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:08.800273 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:08.799738    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:08.800273 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:08.799811    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:09.084636 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:09.084557    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="f73ef6d4cdbfac5782f3ae3e5f8d5eac1a2065166b313462a42f8da9ae805939" exitCode=0
Jul 29 01:13:09.084636 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:09.084599    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"f73ef6d4cdbfac5782f3ae3e5f8d5eac1a2065166b313462a42f8da9ae805939"}
Jul 29 01:13:10.799169 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:10.799139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:10.799169 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:10.799165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:10.799868 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:10.799270    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rbht" podUID="ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f"
Jul 29 01:13:10.799868 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:10.799311    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pvzzv" podUID="ae66d154-203d-4bc9-bab1-374aa5460475"
Jul 29 01:13:10.799868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:10.799347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:10.799868 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:10.799437    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-48frw" podUID="dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4"
Jul 29 01:13:11.341728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:11.341676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:11.341911 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.341820    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:13:11.341911 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.341886    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret podName:ae66d154-203d-4bc9-bab1-374aa5460475 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.341869198 +0000 UTC m=+66.183617098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret") pod "global-pull-secret-syncer-pvzzv" (UID: "ae66d154-203d-4bc9-bab1-374aa5460475") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:13:11.442427 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:11.442346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:11.442575 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.442494    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:13:11.442614 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.442578    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs podName:ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.442563242 +0000 UTC m=+66.284311122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs") pod "network-metrics-daemon-4rbht" (UID: "ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:13:11.543709 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:11.543672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:11.543870 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.543816    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:13:11.543870 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.543834    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:13:11.543870 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.543843    2564 projected.go:196] Error preparing data for projected volume kube-api-access-bqzrj for pod openshift-network-diagnostics/network-check-target-48frw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:13:11.543991 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:11.543898    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj podName:dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.543880887 +0000 UTC m=+66.385628781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bqzrj" (UniqueName: "kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj") pod "network-check-target-48frw" (UID: "dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:13:12.241407 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.241375    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mfs5_c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6/dns-node-resolver/0.log"
Jul 29 01:13:12.520565 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.520469    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeReady"
Jul 29 01:13:12.520731 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.520634    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:13:12.560879 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.560851    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xvjff"]
Jul 29 01:13:12.563463 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.563439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.566394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.566004    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:13:12.566394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.566194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8mzz\""
Jul 29 01:13:12.566394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.566358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:13:12.567061 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.567036    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2b7vw"]
Jul 29 01:13:12.569175 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.569158    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.571372 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.571351    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:12.571571 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.571552    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:12.571639 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.571621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:12.571844 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.571824    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:12.571945 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.571928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z5fvs\""
Jul 29 01:13:12.577228 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.577199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvjff"]
Jul 29 01:13:12.580098 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.580076    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2b7vw"]
Jul 29 01:13:12.583134 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.582794    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5g9sb"]
Jul 29 01:13:12.584898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.584880    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.587226 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.587207    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:13:12.587616 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.587459    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:13:12.587616 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.587520    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:13:12.587616 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.587534    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7zbhk\""
Jul 29 01:13:12.598547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.598523    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5g9sb"]
Jul 29 01:13:12.651704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-data-volume\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.651704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.651942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-config-volume\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.651942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.651942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkh2\" (UniqueName: \"kubernetes.io/projected/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-kube-api-access-pjkh2\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.651942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.652130 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.651945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmg2\" (UniqueName: \"kubernetes.io/projected/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-api-access-gzmg2\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.652130 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.652041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-tmp-dir\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.652130 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.652079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-crio-socket\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.752620 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-crio-socket\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.752799 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-data-volume\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.752799 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.752799 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-crio-socket\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.752799 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw789\" (UniqueName: \"kubernetes.io/projected/de7bf872-8bee-47e0-8dbc-a365d94c4852-kube-api-access-xw789\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.752808    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-config-volume\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.752869    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:13.252849705 +0000 UTC m=+36.094597600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.752886    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkh2\" (UniqueName: \"kubernetes.io/projected/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-kube-api-access-pjkh2\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bf872-8bee-47e0-8dbc-a365d94c4852-cert\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.752942    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:13.25293002 +0000 UTC m=+36.094677920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.753016 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.752995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmg2\" (UniqueName: \"kubernetes.io/projected/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-api-access-gzmg2\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.753382 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.753024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-data-volume\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.753382 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.753036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-tmp-dir\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.753382 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.753132    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:12.753382 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:12.753169    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls podName:8d2757b5-86c6-4e3c-b2b7-e0c0b126b961 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:13.253156081 +0000 UTC m=+36.094903976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls") pod "dns-default-xvjff" (UID: "8d2757b5-86c6-4e3c-b2b7-e0c0b126b961") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:12.753382 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.753349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-tmp-dir\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.753644 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.753385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-config-volume\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.763856 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.763828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkh2\" (UniqueName: \"kubernetes.io/projected/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-kube-api-access-pjkh2\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:12.764015 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.763999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmg2\" (UniqueName: \"kubernetes.io/projected/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-api-access-gzmg2\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:12.799994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.799877    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:12.799994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.799905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:12.799994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.799888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:12.802865 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.802846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:13:12.802991 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.802909    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:13:12.803353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.803216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:13:12.803353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.803225    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:13:12.803353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.803229    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbzfd\""
Jul 29 01:13:12.803353 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.803305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-82b2w\""
Jul 29 01:13:12.853601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.853574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bf872-8bee-47e0-8dbc-a365d94c4852-cert\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.853768 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.853630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw789\" (UniqueName: \"kubernetes.io/projected/de7bf872-8bee-47e0-8dbc-a365d94c4852-kube-api-access-xw789\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.856417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.856393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de7bf872-8bee-47e0-8dbc-a365d94c4852-cert\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.862214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.862185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw789\" (UniqueName: \"kubernetes.io/projected/de7bf872-8bee-47e0-8dbc-a365d94c4852-kube-api-access-xw789\") pod \"ingress-canary-5g9sb\" (UID: \"de7bf872-8bee-47e0-8dbc-a365d94c4852\") " pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:12.895613 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:12.895586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5g9sb"
Jul 29 01:13:13.086619 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.084555    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5g9sb"]
Jul 29 01:13:13.087677 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:13.087649    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7bf872_8bee_47e0_8dbc_a365d94c4852.slice/crio-f8fe08d6de309996ec58bd1b53f3de350c84d0534a3ef728c91a34d78b37fa73 WatchSource:0}: Error finding container f8fe08d6de309996ec58bd1b53f3de350c84d0534a3ef728c91a34d78b37fa73: Status 404 returned error can't find the container with id f8fe08d6de309996ec58bd1b53f3de350c84d0534a3ef728c91a34d78b37fa73
Jul 29 01:13:13.097674 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.097639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerStarted","Data":"c364e304feaa7b57ecc6c9f974da7678657a93b1a5e4e252367f10ce08fe9811"}
Jul 29 01:13:13.098848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.098820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5g9sb" event={"ID":"de7bf872-8bee-47e0-8dbc-a365d94c4852","Type":"ContainerStarted","Data":"f8fe08d6de309996ec58bd1b53f3de350c84d0534a3ef728c91a34d78b37fa73"}
Jul 29 01:13:13.257031 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.256991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.257059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257153    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.257202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257214    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:14.257195935 +0000 UTC m=+37.098943841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257229    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257293    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls podName:8d2757b5-86c6-4e3c-b2b7-e0c0b126b961 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:14.257272931 +0000 UTC m=+37.099020829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls") pod "dns-default-xvjff" (UID: "8d2757b5-86c6-4e3c-b2b7-e0c0b126b961") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:13.257415 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257362    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:13.257768 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:13.257429    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:14.257412549 +0000 UTC m=+37.099160445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:13.624146 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:13.624116    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gl4ch_2705e66e-d0e1-4f2a-8bf6-18248372d4ba/node-ca/0.log"
Jul 29 01:13:14.104352 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.104315    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="c364e304feaa7b57ecc6c9f974da7678657a93b1a5e4e252367f10ce08fe9811" exitCode=0
Jul 29 01:13:14.104539 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.104357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"c364e304feaa7b57ecc6c9f974da7678657a93b1a5e4e252367f10ce08fe9811"}
Jul 29 01:13:14.236819 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.236662    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9gj7s"]
Jul 29 01:13:14.238593 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.238573    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.241105 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.241084    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 01:13:14.241197 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.241172    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 01:13:14.241263 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.241235    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 01:13:14.241536 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.241520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 01:13:14.241628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.241548    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-52tbr\""
Jul 29 01:13:14.244673 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.244652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9gj7s"]
Jul 29 01:13:14.265148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.265124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.265166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.265223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265224    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265310    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265339    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:16.265305018 +0000 UTC m=+39.107052923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265368    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls podName:8d2757b5-86c6-4e3c-b2b7-e0c0b126b961 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:16.265348031 +0000 UTC m=+39.107095935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls") pod "dns-default-xvjff" (UID: "8d2757b5-86c6-4e3c-b2b7-e0c0b126b961") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265427    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:14.265531 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:14.265464    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:16.26545268 +0000 UTC m=+39.107200579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:14.366411 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.366324    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvgl\" (UniqueName: \"kubernetes.io/projected/2aa6e279-baab-45f7-8027-ab8b8979ee33-kube-api-access-qrvgl\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.366411 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.366373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-key\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.366631 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.366448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-cabundle\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.467832 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.467799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-key\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.468013 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.467882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-cabundle\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.468013 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.468010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvgl\" (UniqueName: \"kubernetes.io/projected/2aa6e279-baab-45f7-8027-ab8b8979ee33-kube-api-access-qrvgl\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.468676 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.468650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-cabundle\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.471738 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.471717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2aa6e279-baab-45f7-8027-ab8b8979ee33-signing-key\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.475849 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.475828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvgl\" (UniqueName: \"kubernetes.io/projected/2aa6e279-baab-45f7-8027-ab8b8979ee33-kube-api-access-qrvgl\") pod \"service-ca-658d7b7c78-9gj7s\" (UID: \"2aa6e279-baab-45f7-8027-ab8b8979ee33\") " pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.580169 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.580134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s"
Jul 29 01:13:14.715607 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:14.715573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-9gj7s"]
Jul 29 01:13:14.719030 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:14.719003    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa6e279_baab_45f7_8027_ab8b8979ee33.slice/crio-bed0a7abbf9b7699d0afac4f93d5b62ce6005713697b3149d82681e1c7b819f4 WatchSource:0}: Error finding container bed0a7abbf9b7699d0afac4f93d5b62ce6005713697b3149d82681e1c7b819f4: Status 404 returned error can't find the container with id bed0a7abbf9b7699d0afac4f93d5b62ce6005713697b3149d82681e1c7b819f4
Jul 29 01:13:15.110603 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:15.110564    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f70949d-dcd7-43f0-8c99-f390bfaf2fe3" containerID="aeccc213e71075ec00cfd21e2122ed67029505a672563e236b6ccbfebfe64630" exitCode=0
Jul 29 01:13:15.110775 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:15.110616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerDied","Data":"aeccc213e71075ec00cfd21e2122ed67029505a672563e236b6ccbfebfe64630"}
Jul 29 01:13:15.112322 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:15.112299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s" event={"ID":"2aa6e279-baab-45f7-8027-ab8b8979ee33","Type":"ContainerStarted","Data":"bed0a7abbf9b7699d0afac4f93d5b62ce6005713697b3149d82681e1c7b819f4"}
Jul 29 01:13:16.119634 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.119316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" event={"ID":"2f70949d-dcd7-43f0-8c99-f390bfaf2fe3","Type":"ContainerStarted","Data":"71da06cca826497bcb9ffbb8cbcb50f931869378d45d14e86b6f6bc90a483d32"}
Jul 29 01:13:16.121001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.120974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5g9sb" event={"ID":"de7bf872-8bee-47e0-8dbc-a365d94c4852","Type":"ContainerStarted","Data":"5623878b23fea34813674294fc3ef63287aa17efe68a2f8be2ba3f42479e8084"}
Jul 29 01:13:16.145595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.145518    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9gtcl" podStartSLOduration=8.637514739 podStartE2EDuration="38.145477376s" totalImagesPullingTime="29.507962637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:16.143697424 +0000 UTC m=+38.985445327" watchObservedRunningTime="2026-07-29 01:13:16.145477376 +0000 UTC m=+38.987225279"
Jul 29 01:13:16.159363 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.159311    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5g9sb" podStartSLOduration=1.5835192949999999 podStartE2EDuration="4.159297057s" totalImagesPullingTime="2.575777762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:16.158679499 +0000 UTC m=+39.000427403" watchObservedRunningTime="2026-07-29 01:13:16.159297057 +0000 UTC m=+39.001044954"
Jul 29 01:13:16.286110 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.286068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:16.286290 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286213    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:16.286290 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.286236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:16.286290 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286284    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:20.286262976 +0000 UTC m=+43.128010889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:16.286444 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286317    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:16.286444 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:16.286322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:16.286444 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286369    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:20.286353512 +0000 UTC m=+43.128101411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:16.286687 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286671    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:16.286753 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:16.286718    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls podName:8d2757b5-86c6-4e3c-b2b7-e0c0b126b961 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:20.286704567 +0000 UTC m=+43.128452463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls") pod "dns-default-xvjff" (UID: "8d2757b5-86c6-4e3c-b2b7-e0c0b126b961") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:18.127325 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:18.127286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s" event={"ID":"2aa6e279-baab-45f7-8027-ab8b8979ee33","Type":"ContainerStarted","Data":"32c53234ddbf90d5e7726c1aa9c9847556e3b71b0e062749bb8f14a812c04f92"}
Jul 29 01:13:18.145774 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:18.145714    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-9gj7s" podStartSLOduration=1.3405263 podStartE2EDuration="4.145694172s" totalImagesPullingTime="2.805167872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:18.145373755 +0000 UTC m=+40.987121658" watchObservedRunningTime="2026-07-29 01:13:18.145694172 +0000 UTC m=+40.987442078"
Jul 29 01:13:20.319368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:20.319325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:20.319383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:20.319429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:20.319544    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:20.319563    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:20.319622    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls podName:ac04d27e-e3e8-4d01-94c5-2e5be91676a0 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.319603718 +0000 UTC m=+51.161351618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2b7vw" (UID: "ac04d27e-e3e8-4d01-94c5-2e5be91676a0") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:20.319788 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:20.319638    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls podName:8d2757b5-86c6-4e3c-b2b7-e0c0b126b961 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:28.319629387 +0000 UTC m=+51.161377274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls") pod "dns-default-xvjff" (UID: "8d2757b5-86c6-4e3c-b2b7-e0c0b126b961") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:20.320004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:20.319884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:28.378293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.378251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:28.378883 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.378447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:28.381537 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.381514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d2757b5-86c6-4e3c-b2b7-e0c0b126b961-metrics-tls\") pod \"dns-default-xvjff\" (UID: \"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961\") " pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:28.381668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.381561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac04d27e-e3e8-4d01-94c5-2e5be91676a0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2b7vw\" (UID: \"ac04d27e-e3e8-4d01-94c5-2e5be91676a0\") " pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:28.475650 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.475613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:28.482881 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.482857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2b7vw"
Jul 29 01:13:28.654163 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.654133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvjff"]
Jul 29 01:13:28.657782 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:28.657757    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2757b5_86c6_4e3c_b2b7_e0c0b126b961.slice/crio-5da9117aff8cab655672c37dc7bdce48b3f538d722a3e667ef92f3e5835e6619 WatchSource:0}: Error finding container 5da9117aff8cab655672c37dc7bdce48b3f538d722a3e667ef92f3e5835e6619: Status 404 returned error can't find the container with id 5da9117aff8cab655672c37dc7bdce48b3f538d722a3e667ef92f3e5835e6619
Jul 29 01:13:28.681566 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:28.681537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2b7vw"]
Jul 29 01:13:28.684021 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:28.684000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac04d27e_e3e8_4d01_94c5_2e5be91676a0.slice/crio-b45e4df09a4a1c4518deab328f4d7704ac508f06c33d01b7552ad262532e18b5 WatchSource:0}: Error finding container b45e4df09a4a1c4518deab328f4d7704ac508f06c33d01b7552ad262532e18b5: Status 404 returned error can't find the container with id b45e4df09a4a1c4518deab328f4d7704ac508f06c33d01b7552ad262532e18b5
Jul 29 01:13:29.155887 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:29.155847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2b7vw" event={"ID":"ac04d27e-e3e8-4d01-94c5-2e5be91676a0","Type":"ContainerStarted","Data":"b45e4df09a4a1c4518deab328f4d7704ac508f06c33d01b7552ad262532e18b5"}
Jul 29 01:13:29.157015 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:29.156990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjff" event={"ID":"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961","Type":"ContainerStarted","Data":"5da9117aff8cab655672c37dc7bdce48b3f538d722a3e667ef92f3e5835e6619"}
Jul 29 01:13:34.170574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.170532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2b7vw" event={"ID":"ac04d27e-e3e8-4d01-94c5-2e5be91676a0","Type":"ContainerStarted","Data":"4d0184fe339a17b63c1fefd66a147e1f28e80ffb8ec5806e8da7993a2c3de748"}
Jul 29 01:13:34.172143 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.172119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjff" event={"ID":"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961","Type":"ContainerStarted","Data":"1617626676a0ba0643899c754308d7e0c14a245407defd8520b2419673f74ab6"}
Jul 29 01:13:34.172251 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.172162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjff" event={"ID":"8d2757b5-86c6-4e3c-b2b7-e0c0b126b961","Type":"ContainerStarted","Data":"f36dc20c9b0e38083185db9de0ceb0f860790284bb312c140f02ff1874340ce5"}
Jul 29 01:13:34.172251 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.172198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:34.190046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.190000    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xvjff" podStartSLOduration=16.877181295 podStartE2EDuration="22.18998697s" totalImagesPullingTime="5.312805675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:34.188605343 +0000 UTC m=+57.030353268" watchObservedRunningTime="2026-07-29 01:13:34.18998697 +0000 UTC m=+57.031734873"
Jul 29 01:13:34.509685 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.508736    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"]
Jul 29 01:13:34.511789 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.511767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.514453 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.514398    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"]
Jul 29 01:13:34.515758 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.515696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gf6vp\""
Jul 29 01:13:34.516077 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.516050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 01:13:34.516275 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.516255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 01:13:34.518004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.517253    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 01:13:34.518004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.517333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.518004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.517492    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 01:13:34.523898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.523000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 01:13:34.523898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.523205    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 01:13:34.523898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.523421    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 01:13:34.523898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.523675    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 01:13:34.527917 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.526654    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"]
Jul 29 01:13:34.534061 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.534008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"]
Jul 29 01:13:34.630386 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4scj\" (UniqueName: \"kubernetes.io/projected/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-kube-api-access-h4scj\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.630601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.630601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.630601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.630601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29458\" (UniqueName: \"kubernetes.io/projected/101a99f0-5039-4311-8135-137b01430707-kube-api-access-29458\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.630601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/101a99f0-5039-4311-8135-137b01430707-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.630865 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.630865 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.630786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731402 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4scj\" (UniqueName: \"kubernetes.io/projected/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-kube-api-access-h4scj\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29458\" (UniqueName: \"kubernetes.io/projected/101a99f0-5039-4311-8135-137b01430707-kube-api-access-29458\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.731597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/101a99f0-5039-4311-8135-137b01430707-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.731800 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.731800 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.731648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.732697 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.732646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.735163 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.735142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.735625 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.735596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.735739 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.735727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-hub\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.741762 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.741672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-ca\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.741762 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.741736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/101a99f0-5039-4311-8135-137b01430707-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.746519 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.745392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29458\" (UniqueName: \"kubernetes.io/projected/101a99f0-5039-4311-8135-137b01430707-kube-api-access-29458\") pod \"managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w\" (UID: \"101a99f0-5039-4311-8135-137b01430707\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.747131 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.747084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4scj\" (UniqueName: \"kubernetes.io/projected/dd51eda3-d765-4ffa-a95b-26b45ee5dec2-kube-api-access-h4scj\") pod \"cluster-proxy-proxy-agent-545c7b45f6-zknzh\" (UID: \"dd51eda3-d765-4ffa-a95b-26b45ee5dec2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:34.850072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.849994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"
Jul 29 01:13:34.855813 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:34.855719    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"
Jul 29 01:13:35.015489 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:35.015423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w"]
Jul 29 01:13:35.018975 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:35.018943    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod101a99f0_5039_4311_8135_137b01430707.slice/crio-e7f748159eefbf63e5eec60e91597cc87fe55d33030b98478377fe47041aa309 WatchSource:0}: Error finding container e7f748159eefbf63e5eec60e91597cc87fe55d33030b98478377fe47041aa309: Status 404 returned error can't find the container with id e7f748159eefbf63e5eec60e91597cc87fe55d33030b98478377fe47041aa309
Jul 29 01:13:35.032889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:35.032864    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh"]
Jul 29 01:13:35.036822 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:35.036790    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd51eda3_d765_4ffa_a95b_26b45ee5dec2.slice/crio-5f118e8818145af2fa06c78b60d06af71c9566e6146844013d8497791972e2c6 WatchSource:0}: Error finding container 5f118e8818145af2fa06c78b60d06af71c9566e6146844013d8497791972e2c6: Status 404 returned error can't find the container with id 5f118e8818145af2fa06c78b60d06af71c9566e6146844013d8497791972e2c6
Jul 29 01:13:35.176413 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:35.176329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh" event={"ID":"dd51eda3-d765-4ffa-a95b-26b45ee5dec2","Type":"ContainerStarted","Data":"5f118e8818145af2fa06c78b60d06af71c9566e6146844013d8497791972e2c6"}
Jul 29 01:13:35.178098 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:35.178065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w" event={"ID":"101a99f0-5039-4311-8135-137b01430707","Type":"ContainerStarted","Data":"e7f748159eefbf63e5eec60e91597cc87fe55d33030b98478377fe47041aa309"}
Jul 29 01:13:38.098914 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:38.098888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxjmw"
Jul 29 01:13:41.197772 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.197728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2b7vw" event={"ID":"ac04d27e-e3e8-4d01-94c5-2e5be91676a0","Type":"ContainerStarted","Data":"c75a6e09c79fd9913b5d270ba812f15e9f5cc21e7569bfcebc69e66e74fb70bf"}
Jul 29 01:13:41.200129 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.200096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh" event={"ID":"dd51eda3-d765-4ffa-a95b-26b45ee5dec2","Type":"ContainerStarted","Data":"22f5e5264709a0741ee5549fb29f051bfe9e482e659fcce1e438054cf9a59e1b"}
Jul 29 01:13:41.200263 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.200138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh" event={"ID":"dd51eda3-d765-4ffa-a95b-26b45ee5dec2","Type":"ContainerStarted","Data":"3646c42ffcbb1e879d27040efe63cf721e4cbfb276e2beec0910ee66410da912"}
Jul 29 01:13:41.200263 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.200155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh" event={"ID":"dd51eda3-d765-4ffa-a95b-26b45ee5dec2","Type":"ContainerStarted","Data":"f09c4ebb74f45a475e021a5985d5163a80675283435928837021a71323d329ba"}
Jul 29 01:13:41.201699 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.201664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w" event={"ID":"101a99f0-5039-4311-8135-137b01430707","Type":"ContainerStarted","Data":"51cab2b1deec3f347a0f7b6e0b93bee6ae435d2787ccc215a3a542fb403db958"}
Jul 29 01:13:41.232891 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.232850    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fdbd67ffb-fjv4w" podStartSLOduration=2.074940695 podStartE2EDuration="7.232835544s" totalImagesPullingTime="5.157894849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:41.232060428 +0000 UTC m=+64.073808330" watchObservedRunningTime="2026-07-29 01:13:41.232835544 +0000 UTC m=+64.074583449"
Jul 29 01:13:41.233120 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:41.233094    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-545c7b45f6-zknzh" podStartSLOduration=2.082008281 podStartE2EDuration="7.233084177s" totalImagesPullingTime="5.151075896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:41.218337562 +0000 UTC m=+64.060085464" watchObservedRunningTime="2026-07-29 01:13:41.233084177 +0000 UTC m=+64.074832083"
Jul 29 01:13:43.407700 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.407656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:43.410967 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.410936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:13:43.420529 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.420486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae66d154-203d-4bc9-bab1-374aa5460475-original-pull-secret\") pod \"global-pull-secret-syncer-pvzzv\" (UID: \"ae66d154-203d-4bc9-bab1-374aa5460475\") " pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:43.508292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.508257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:43.511416 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.511392    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:13:43.521311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.521284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f-metrics-certs\") pod \"network-metrics-daemon-4rbht\" (UID: \"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f\") " pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:43.608773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.608740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:43.611707 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.611690    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:13:43.622517 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.622480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:13:43.632412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.632391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzrj\" (UniqueName: \"kubernetes.io/projected/dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4-kube-api-access-bqzrj\") pod \"network-check-target-48frw\" (UID: \"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4\") " pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:43.711473 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.711449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pvzzv"
Jul 29 01:13:43.720985 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.720965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-82b2w\""
Jul 29 01:13:43.726672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.726649    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbzfd\""
Jul 29 01:13:43.728716 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.728695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:43.734931 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.734913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rbht"
Jul 29 01:13:43.862842 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.862813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pvzzv"]
Jul 29 01:13:43.867036 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:43.866665    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae66d154_203d_4bc9_bab1_374aa5460475.slice/crio-25eb18692768d1b84d5e32e95bd25402dacaa7a60361793eb867dab8833595eb WatchSource:0}: Error finding container 25eb18692768d1b84d5e32e95bd25402dacaa7a60361793eb867dab8833595eb: Status 404 returned error can't find the container with id 25eb18692768d1b84d5e32e95bd25402dacaa7a60361793eb867dab8833595eb
Jul 29 01:13:43.879369 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.879336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-48frw"]
Jul 29 01:13:43.882677 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:43.882652    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5fad5b_91e7_4be8_8a5b_599ddb2f92f4.slice/crio-bfb892e24c348a43e2f7ef61ab24d74a7562f1b198be14ea6ee54919cec3e173 WatchSource:0}: Error finding container bfb892e24c348a43e2f7ef61ab24d74a7562f1b198be14ea6ee54919cec3e173: Status 404 returned error can't find the container with id bfb892e24c348a43e2f7ef61ab24d74a7562f1b198be14ea6ee54919cec3e173
Jul 29 01:13:43.896019 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:43.895997    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4rbht"]
Jul 29 01:13:43.898979 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:43.898956    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4b3be7_178d_4c78_b294_3b7b3d9d1d8f.slice/crio-eb7dc7a7d6d01328c61c4e30cfd91067ba1bdc8e6d0b4fc54f105b9fc143e0db WatchSource:0}: Error finding container eb7dc7a7d6d01328c61c4e30cfd91067ba1bdc8e6d0b4fc54f105b9fc143e0db: Status 404 returned error can't find the container with id eb7dc7a7d6d01328c61c4e30cfd91067ba1bdc8e6d0b4fc54f105b9fc143e0db
Jul 29 01:13:44.180944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.180873    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xvjff"
Jul 29 01:13:44.213678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.213644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48frw" event={"ID":"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4","Type":"ContainerStarted","Data":"bfb892e24c348a43e2f7ef61ab24d74a7562f1b198be14ea6ee54919cec3e173"}
Jul 29 01:13:44.214756 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.214730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvzzv" event={"ID":"ae66d154-203d-4bc9-bab1-374aa5460475","Type":"ContainerStarted","Data":"25eb18692768d1b84d5e32e95bd25402dacaa7a60361793eb867dab8833595eb"}
Jul 29 01:13:44.216775 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.216724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2b7vw" event={"ID":"ac04d27e-e3e8-4d01-94c5-2e5be91676a0","Type":"ContainerStarted","Data":"d4e328499a2dfda4e679e3d0518602e1896edd18d296af957ccc050812ff8af0"}
Jul 29 01:13:44.217907 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.217888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rbht" event={"ID":"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f","Type":"ContainerStarted","Data":"eb7dc7a7d6d01328c61c4e30cfd91067ba1bdc8e6d0b4fc54f105b9fc143e0db"}
Jul 29 01:13:44.240702 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:44.240648    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2b7vw" podStartSLOduration=17.302602697 podStartE2EDuration="32.240632128s" totalImagesPullingTime="14.938029431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:44.239578344 +0000 UTC m=+67.081326269" watchObservedRunningTime="2026-07-29 01:13:44.240632128 +0000 UTC m=+67.082380029"
Jul 29 01:13:46.231191 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:46.231143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rbht" event={"ID":"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f","Type":"ContainerStarted","Data":"311c26870540452b0d9a42577d1b969b5d25e4663c7b0f692fcf2b353cf205ba"}
Jul 29 01:13:46.231670 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:46.231217    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rbht" event={"ID":"ee4b3be7-178d-4c78-b294-3b7b3d9d1d8f","Type":"ContainerStarted","Data":"971af9b8867f20ae6461877539e9e82451cfd186b859122e270f83c223a5f58b"}
Jul 29 01:13:46.249933 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:46.249447    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4rbht" podStartSLOduration=66.795846226 podStartE2EDuration="1m8.249426299s" totalImagesPullingTime="1.453580073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:46.247943527 +0000 UTC m=+69.089691444" watchObservedRunningTime="2026-07-29 01:13:46.249426299 +0000 UTC m=+69.091174200"
Jul 29 01:13:49.243589 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:49.243547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-48frw" event={"ID":"dc5fad5b-91e7-4be8-8a5b-599ddb2f92f4","Type":"ContainerStarted","Data":"fe1bcd69e06331151b406299874999cd3cdae0b5746822a5b7e1d10e1b530eac"}
Jul 29 01:13:49.244022 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:49.243663    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:13:49.244966 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:49.244943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pvzzv" event={"ID":"ae66d154-203d-4bc9-bab1-374aa5460475","Type":"ContainerStarted","Data":"b4fd577a630e624cb038f356629c9d58edf06d61b43fc7fdb8ab9e2e3995a42a"}
Jul 29 01:13:49.274825 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:49.274783    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-48frw" podStartSLOduration=66.7660803 podStartE2EDuration="1m11.274770356s" totalImagesPullingTime="4.508690056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:49.258376608 +0000 UTC m=+72.100124512" watchObservedRunningTime="2026-07-29 01:13:49.274770356 +0000 UTC m=+72.116518259"
Jul 29 01:13:51.310019 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.309962    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pvzzv" podStartSLOduration=68.782695708 podStartE2EDuration="1m13.309942959s" totalImagesPullingTime="4.527247251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:49.274148439 +0000 UTC m=+72.115896341" watchObservedRunningTime="2026-07-29 01:13:51.309942959 +0000 UTC m=+74.151690861"
Jul 29 01:13:51.310799 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.310783    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qjgwt"]
Jul 29 01:13:51.313230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.313195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.316599 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.316578    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:13:51.317381 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9pv8q\""
Jul 29 01:13:51.317491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:13:51.317570 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:13:51.317621 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317567    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:13:51.317670 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:13:51.317737 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.317719    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:13:51.368752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkjc\" (UniqueName: \"kubernetes.io/projected/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-kube-api-access-qlkjc\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.368878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.368878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-wtmp\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.368878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.368878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-metrics-client-ca\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.369003 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-sys\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.369003 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.368921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-tls\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.369064 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.369004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-textfile\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.369064 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.369027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-root\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469748 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-sys\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-tls\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-textfile\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-root\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469827    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-sys\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.469901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkjc\" (UniqueName: \"kubernetes.io/projected/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-kube-api-access-qlkjc\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-root\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.469998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-wtmp\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-metrics-client-ca\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470414 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-wtmp\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470414 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-textfile\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470697 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-metrics-client-ca\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.470835 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.470774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.472574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.472552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-tls\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.472658 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.472618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.479907 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.479890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkjc\" (UniqueName: \"kubernetes.io/projected/fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5-kube-api-access-qlkjc\") pod \"node-exporter-qjgwt\" (UID: \"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5\") " pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.624235 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:51.624145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qjgwt"
Jul 29 01:13:51.635797 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:51.635763    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd22e5df_f6f0_44b7_ac1d_4c1b4769c4c5.slice/crio-3a5727f576ff459c67d70f9f5d6abc9263262ae249088b0e3bdc2e7c7e6cf131 WatchSource:0}: Error finding container 3a5727f576ff459c67d70f9f5d6abc9263262ae249088b0e3bdc2e7c7e6cf131: Status 404 returned error can't find the container with id 3a5727f576ff459c67d70f9f5d6abc9263262ae249088b0e3bdc2e7c7e6cf131
Jul 29 01:13:52.258772 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:52.258728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjgwt" event={"ID":"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5","Type":"ContainerStarted","Data":"3a5727f576ff459c67d70f9f5d6abc9263262ae249088b0e3bdc2e7c7e6cf131"}
Jul 29 01:13:53.263641 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:53.263611    2564 generic.go:356] "Generic (PLEG): container finished" podID="fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5" containerID="4d4649485508e157abdc752ed108447acf3c10cbb29a9c2cc483313b3af73009" exitCode=0
Jul 29 01:13:53.264023 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:53.263679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjgwt" event={"ID":"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5","Type":"ContainerDied","Data":"4d4649485508e157abdc752ed108447acf3c10cbb29a9c2cc483313b3af73009"}
Jul 29 01:13:54.270027 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:54.269991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjgwt" event={"ID":"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5","Type":"ContainerStarted","Data":"32ae4bb8397740ccca48f4e93d39ff858f82f5d6cda4d5cf565642610a7c6ad1"}
Jul 29 01:13:54.270484 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:54.270051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjgwt" event={"ID":"fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5","Type":"ContainerStarted","Data":"bb1171638d53147c62a1614335d237953274987ee1b6929c1e45620dd4880914"}
Jul 29 01:13:54.293393 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:54.293349    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qjgwt" podStartSLOduration=2.247618861 podStartE2EDuration="3.293337323s" totalImagesPullingTime="984.069636ms" totalInitContainerRuntime="61.648826ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:54.293064126 +0000 UTC m=+77.134812054" watchObservedRunningTime="2026-07-29 01:13:54.293337323 +0000 UTC m=+77.135085225"
Jul 29 01:13:56.076453 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.076420    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"]
Jul 29 01:13:56.078599 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.078584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.081143 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.081119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 01:13:56.081273 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.081182    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9pgvk\""
Jul 29 01:13:56.086958 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.086935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"]
Jul 29 01:13:56.203057 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.203026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqzc\" (UniqueName: \"kubernetes.io/projected/584fe601-cf41-4130-aa3f-45180f03c0e5-kube-api-access-5gqzc\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.203215 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.203128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.303798 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.303770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.303798 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.303804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqzc\" (UniqueName: \"kubernetes.io/projected/584fe601-cf41-4130-aa3f-45180f03c0e5-kube-api-access-5gqzc\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.304005 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:56.303919    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 01:13:56.304005 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:13:56.303993    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert podName:584fe601-cf41-4130-aa3f-45180f03c0e5 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:56.803974406 +0000 UTC m=+79.645722286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-8cv7n" (UID: "584fe601-cf41-4130-aa3f-45180f03c0e5") : secret "monitoring-plugin-cert" not found
Jul 29 01:13:56.312255 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.312229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqzc\" (UniqueName: \"kubernetes.io/projected/584fe601-cf41-4130-aa3f-45180f03c0e5-kube-api-access-5gqzc\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.589115 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.589079    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7b7c97d774-khbft"]
Jul 29 01:13:56.591314 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.591299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.594697 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.594668    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 01:13:56.594805 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.594790    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7fd27\""
Jul 29 01:13:56.595128 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.595110    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 01:13:56.595219 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.595170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 01:13:56.595396 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.595381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 01:13:56.595574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.595555    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 01:13:56.601422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.601403    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 01:13:56.608809 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.608787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7c97d774-khbft"]
Jul 29 01:13:56.706956 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.706911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.706956 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.706958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.706980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.707044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-metrics-client-ca\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.707096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dtq\" (UniqueName: \"kubernetes.io/projected/69598438-0f24-4882-ac97-edea77b479d8-kube-api-access-h7dtq\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.707132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-serving-certs-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.707169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-federate-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.707214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.707208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-telemeter-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.807907 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.807871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-federate-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.807907 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.807912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-telemeter-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.807936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.807960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.807981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-metrics-client-ca\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dtq\" (UniqueName: \"kubernetes.io/projected/69598438-0f24-4882-ac97-edea77b479d8-kube-api-access-h7dtq\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808160 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-serving-certs-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.808877 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-serving-certs-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.809049 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.808941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-metrics-client-ca\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.809162 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.809133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69598438-0f24-4882-ac97-edea77b479d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.810718 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.810688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.810987 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.810970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/584fe601-cf41-4130-aa3f-45180f03c0e5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-8cv7n\" (UID: \"584fe601-cf41-4130-aa3f-45180f03c0e5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:56.811116 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.811095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-telemeter-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.811187 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.811168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-federate-client-tls\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.811226 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.811169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69598438-0f24-4882-ac97-edea77b479d8-secret-telemeter-client\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.816683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.816662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dtq\" (UniqueName: \"kubernetes.io/projected/69598438-0f24-4882-ac97-edea77b479d8-kube-api-access-h7dtq\") pod \"telemeter-client-7b7c97d774-khbft\" (UID: \"69598438-0f24-4882-ac97-edea77b479d8\") " pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.901515 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.901432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft"
Jul 29 01:13:56.987923 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:56.987889    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:57.032994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:57.032968    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7b7c97d774-khbft"]
Jul 29 01:13:57.034520 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:57.034473    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69598438_0f24_4882_ac97_edea77b479d8.slice/crio-e244fb5d41a23ec52dd7613a405f4415a06ca2de86d514df0d09a5e5173e3441 WatchSource:0}: Error finding container e244fb5d41a23ec52dd7613a405f4415a06ca2de86d514df0d09a5e5173e3441: Status 404 returned error can't find the container with id e244fb5d41a23ec52dd7613a405f4415a06ca2de86d514df0d09a5e5173e3441
Jul 29 01:13:57.113267 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:57.113238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"]
Jul 29 01:13:57.116391 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:13:57.116365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584fe601_cf41_4130_aa3f_45180f03c0e5.slice/crio-1e6fa700233b19701cb7918d939baed6f39d0cb88ad1aec0adb2a6ddfae1d832 WatchSource:0}: Error finding container 1e6fa700233b19701cb7918d939baed6f39d0cb88ad1aec0adb2a6ddfae1d832: Status 404 returned error can't find the container with id 1e6fa700233b19701cb7918d939baed6f39d0cb88ad1aec0adb2a6ddfae1d832
Jul 29 01:13:57.282961 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:57.282919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n" event={"ID":"584fe601-cf41-4130-aa3f-45180f03c0e5","Type":"ContainerStarted","Data":"1e6fa700233b19701cb7918d939baed6f39d0cb88ad1aec0adb2a6ddfae1d832"}
Jul 29 01:13:57.284110 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:57.284089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft" event={"ID":"69598438-0f24-4882-ac97-edea77b479d8","Type":"ContainerStarted","Data":"e244fb5d41a23ec52dd7613a405f4415a06ca2de86d514df0d09a5e5173e3441"}
Jul 29 01:13:59.294075 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:59.294041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n" event={"ID":"584fe601-cf41-4130-aa3f-45180f03c0e5","Type":"ContainerStarted","Data":"15915031bb4c189aa55dc5a012ddc9253f176cb0591ccc35c24e81e7af05632a"}
Jul 29 01:13:59.294595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:59.294223    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:59.295819 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:59.295782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft" event={"ID":"69598438-0f24-4882-ac97-edea77b479d8","Type":"ContainerStarted","Data":"cf7b7434ae62e6dc5d0044214616bbcbcc9e0c2f27d7cc85bebd142a47b3b8a0"}
Jul 29 01:13:59.299225 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:59.299203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n"
Jul 29 01:13:59.308770 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:13:59.308719    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-8cv7n" podStartSLOduration=1.642488049 podStartE2EDuration="3.30870083s" totalImagesPullingTime="1.666212781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:59.308339229 +0000 UTC m=+82.150087130" watchObservedRunningTime="2026-07-29 01:13:59.30870083 +0000 UTC m=+82.150448732"
Jul 29 01:14:00.300781 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:14:00.300744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft" event={"ID":"69598438-0f24-4882-ac97-edea77b479d8","Type":"ContainerStarted","Data":"58ecbccd61e9b3142f858eccd58adb5b444c48906a7bd1b0206e091836c50efe"}
Jul 29 01:14:00.301148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:14:00.300828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft" event={"ID":"69598438-0f24-4882-ac97-edea77b479d8","Type":"ContainerStarted","Data":"c7aeae0a5f99a74dba52891e5dbd704b8bbada598364b051427ad5e64c5711fc"}
Jul 29 01:14:00.328402 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:14:00.328341    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7b7c97d774-khbft" podStartSLOduration=1.609937214 podStartE2EDuration="4.328321132s" totalImagesPullingTime="2.718383918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:00.326444602 +0000 UTC m=+83.168192517" watchObservedRunningTime="2026-07-29 01:14:00.328321132 +0000 UTC m=+83.170069038"
Jul 29 01:14:20.251030 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:14:20.250998    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-48frw"
Jul 29 01:15:13.287050 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.287014    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:13.290797 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.290781    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.293363 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.293339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 01:15:13.293837 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.293778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 01:15:13.294100 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.294079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 01:15:13.294724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.294344    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5s7r7\""
Jul 29 01:15:13.294724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.294085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 01:15:13.294724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.294461    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 01:15:13.294934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.294749    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 01:15:13.295312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.295127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 01:15:13.295399 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.295369    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 01:15:13.301444 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.301425    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 01:15:13.308123 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.308102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:13.359100 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359068    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359100 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359354 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359354 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359354 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-web-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359354 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359354 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tz55\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-kube-api-access-9tz55\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-out\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.359626 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.359582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460021 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.459982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-web-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460188 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tz55\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-kube-api-access-9tz55\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-out\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460470 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.460897 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.461059 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.460872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463195 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/76e9f3ab-f970-4f07-a563-dacf9fde63c8-config-out\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-web-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.463875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.463865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.464223 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.464200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.464291 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.464263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76e9f3ab-f970-4f07-a563-dacf9fde63c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.465464 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.465441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.465791 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.465768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/76e9f3ab-f970-4f07-a563-dacf9fde63c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.471429 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.471401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tz55\" (UniqueName: \"kubernetes.io/projected/76e9f3ab-f970-4f07-a563-dacf9fde63c8-kube-api-access-9tz55\") pod \"alertmanager-main-0\" (UID: \"76e9f3ab-f970-4f07-a563-dacf9fde63c8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.602727 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.602639    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 01:15:13.741924 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:13.741898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 01:15:13.743451 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:15:13.743423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e9f3ab_f970_4f07_a563_dacf9fde63c8.slice/crio-d5341fe20e87b0ec77e3dd3c382cf40bb10cd6a88b731d02bcb9a46678b42fec WatchSource:0}: Error finding container d5341fe20e87b0ec77e3dd3c382cf40bb10cd6a88b731d02bcb9a46678b42fec: Status 404 returned error can't find the container with id d5341fe20e87b0ec77e3dd3c382cf40bb10cd6a88b731d02bcb9a46678b42fec
Jul 29 01:15:14.552197 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:14.552161    2564 generic.go:356] "Generic (PLEG): container finished" podID="76e9f3ab-f970-4f07-a563-dacf9fde63c8" containerID="8e60e347120d62d57890011a974ef8bdf24054a2a0c4fa073792d8e52b22eacd" exitCode=0
Jul 29 01:15:14.552705 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:14.552231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerDied","Data":"8e60e347120d62d57890011a974ef8bdf24054a2a0c4fa073792d8e52b22eacd"}
Jul 29 01:15:14.552705 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:14.552308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"d5341fe20e87b0ec77e3dd3c382cf40bb10cd6a88b731d02bcb9a46678b42fec"}
Jul 29 01:15:16.563427 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:16.563339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"5a8966ec52252cc6d68a5daee76df067739802909d223c08658f97e5253cff4a"}
Jul 29 01:15:16.563785 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:16.563438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"dd08564f38d21f4c32f11487eb618005a1b33e37d755dc3e23e3ff06f732ec50"}
Jul 29 01:15:16.563785 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:16.563465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"0f9374282c1d8d861d38ada9f3e9a081172e97eceeddb4c2aa653acab063c6e0"}
Jul 29 01:15:16.563785 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:16.563487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"23f0ac5f342e4facd8110b8123682f26b8a1740c5e47ee2586c7403185c0780e"}
Jul 29 01:15:16.563785 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:16.563535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"0dc2df5bed694d433cefc1b41c714076d1c1faa4d3de29010dd1ba00b6860d8a"}
Jul 29 01:15:17.570542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:17.570497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"76e9f3ab-f970-4f07-a563-dacf9fde63c8","Type":"ContainerStarted","Data":"c0b34e657468c1fd2d1800ef6b7416b54b2d202e3b98afd5c4d8e82b8669c324"}
Jul 29 01:15:17.596780 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:15:17.596717    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.364664704 podStartE2EDuration="4.596700538s" totalImagesPullingTime="2.215393835s" totalInitContainerRuntime="16.641999ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:17.59500213 +0000 UTC m=+160.436750032" watchObservedRunningTime="2026-07-29 01:15:17.596700538 +0000 UTC m=+160.438448438"
Jul 29 01:17:06.241267 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.241173    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"]
Jul 29 01:17:06.244306 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.244285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.247569 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.247546    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 01:17:06.248557 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.248540    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:17:06.248637 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.248541    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jfp4g\""
Jul 29 01:17:06.255355 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.255334    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"]
Jul 29 01:17:06.414254 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.414219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.414436 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.414273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nflsz\" (UniqueName: \"kubernetes.io/projected/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-kube-api-access-nflsz\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.515292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.515193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.515292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.515252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nflsz\" (UniqueName: \"kubernetes.io/projected/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-kube-api-access-nflsz\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.515607 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.515588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.524369 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.524343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nflsz\" (UniqueName: \"kubernetes.io/projected/f2c6eb71-1bf7-4f81-903a-84b1b1da2bee-kube-api-access-nflsz\") pod \"openshift-lws-operator-fd8ccff4c-t8kp7\" (UID: \"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.553793 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.553762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"
Jul 29 01:17:06.685760 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.685731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7"]
Jul 29 01:17:06.688814 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:17:06.688792    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2c6eb71_1bf7_4f81_903a_84b1b1da2bee.slice/crio-71235011fd07553552d5d663a4853c396d9b510b8a2bf4c5a1aa08903c1b856d WatchSource:0}: Error finding container 71235011fd07553552d5d663a4853c396d9b510b8a2bf4c5a1aa08903c1b856d: Status 404 returned error can't find the container with id 71235011fd07553552d5d663a4853c396d9b510b8a2bf4c5a1aa08903c1b856d
Jul 29 01:17:06.944854 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:06.944768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7" event={"ID":"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee","Type":"ContainerStarted","Data":"71235011fd07553552d5d663a4853c396d9b510b8a2bf4c5a1aa08903c1b856d"}
Jul 29 01:17:09.958018 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:09.957972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7" event={"ID":"f2c6eb71-1bf7-4f81-903a-84b1b1da2bee","Type":"ContainerStarted","Data":"98c20ab60016772a8a0f7c1a575b151bcf4fc50016efa65e3000f1721feaeb63"}
Jul 29 01:17:09.975414 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:09.975358    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t8kp7" podStartSLOduration=1.6343998 podStartE2EDuration="3.975342226s" totalImagesPullingTime="2.340942426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:09.97501866 +0000 UTC m=+272.816766564" watchObservedRunningTime="2026-07-29 01:17:09.975342226 +0000 UTC m=+272.817090128"
Jul 29 01:17:27.074068 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.074033    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"]
Jul 29 01:17:27.077335 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.077316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.081672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.081640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 01:17:27.081789 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.081640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jg6qw\""
Jul 29 01:17:27.081789 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.081647    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 01:17:27.081789 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.081688    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 01:17:27.100364 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.100338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"]
Jul 29 01:17:27.162740 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.162705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.162911 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.162751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77bf2aeb-6b53-4976-9f79-ab67e46f003c-manager-config\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.162911 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.162811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-metrics-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.162911 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.162853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddc4\" (UniqueName: \"kubernetes.io/projected/77bf2aeb-6b53-4976-9f79-ab67e46f003c-kube-api-access-sddc4\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.263704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.263670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77bf2aeb-6b53-4976-9f79-ab67e46f003c-manager-config\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.263909 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.263714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-metrics-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.263909 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.263756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddc4\" (UniqueName: \"kubernetes.io/projected/77bf2aeb-6b53-4976-9f79-ab67e46f003c-kube-api-access-sddc4\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.263909 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.263809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.264418 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.264388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/77bf2aeb-6b53-4976-9f79-ab67e46f003c-manager-config\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.266232 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.266204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-metrics-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.266337 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.266321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77bf2aeb-6b53-4976-9f79-ab67e46f003c-cert\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.273651 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.273632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddc4\" (UniqueName: \"kubernetes.io/projected/77bf2aeb-6b53-4976-9f79-ab67e46f003c-kube-api-access-sddc4\") pod \"lws-controller-manager-856ff8b689-jkjsb\" (UID: \"77bf2aeb-6b53-4976-9f79-ab67e46f003c\") " pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.386259 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.386176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:27.538001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:27.537846    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"]
Jul 29 01:17:27.540397 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:17:27.540370    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bf2aeb_6b53_4976_9f79_ab67e46f003c.slice/crio-85f283e148e5f2c5590f4481badaea018ac0e62949ebf80ab33d81f74ba6f12f WatchSource:0}: Error finding container 85f283e148e5f2c5590f4481badaea018ac0e62949ebf80ab33d81f74ba6f12f: Status 404 returned error can't find the container with id 85f283e148e5f2c5590f4481badaea018ac0e62949ebf80ab33d81f74ba6f12f
Jul 29 01:17:28.020014 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.019980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb" event={"ID":"77bf2aeb-6b53-4976-9f79-ab67e46f003c","Type":"ContainerStarted","Data":"85f283e148e5f2c5590f4481badaea018ac0e62949ebf80ab33d81f74ba6f12f"}
Jul 29 01:17:28.261459 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.261426    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"]
Jul 29 01:17:28.265292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.265274    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.269874 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.269849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.270000 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.269919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.270000 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.269948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.270000 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.269954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:17:28.270000 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.269976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvhln\" (UniqueName: \"kubernetes.io/projected/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-kube-api-access-vvhln\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.270242 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.270041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.270299 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.270264    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:17:28.270350 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.270311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ksqq\""
Jul 29 01:17:28.270401 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.270367    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:17:28.270910 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.270894    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:17:28.288562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.288294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"]
Jul 29 01:17:28.370963 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.370928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.371145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.370975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.371145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.371031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.371145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.371066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.371145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.371110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvhln\" (UniqueName: \"kubernetes.io/projected/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-kube-api-access-vvhln\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.371592 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.371531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-manifests\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.373777 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.373747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-tmp\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.373777 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.373769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.374204 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.374183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.383102 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.383067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvhln\" (UniqueName: \"kubernetes.io/projected/bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d-kube-api-access-vvhln\") pod \"opendatahub-operator-controller-manager-6f677d9b6b-spf82\" (UID: \"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d\") " pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.581737 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.581648    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:28.753905 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:28.753751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"]
Jul 29 01:17:28.757250 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:17:28.757208    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb264a9_c9be_4aa2_bbc3_fc6e6819ee6d.slice/crio-599d8bde216bc86e264468cb68e4d3e3b0e0b444f5cc220ddffd28f2d8bf09f3 WatchSource:0}: Error finding container 599d8bde216bc86e264468cb68e4d3e3b0e0b444f5cc220ddffd28f2d8bf09f3: Status 404 returned error can't find the container with id 599d8bde216bc86e264468cb68e4d3e3b0e0b444f5cc220ddffd28f2d8bf09f3
Jul 29 01:17:29.025746 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:29.025713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82" event={"ID":"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d","Type":"ContainerStarted","Data":"599d8bde216bc86e264468cb68e4d3e3b0e0b444f5cc220ddffd28f2d8bf09f3"}
Jul 29 01:17:30.034374 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:30.034336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb" event={"ID":"77bf2aeb-6b53-4976-9f79-ab67e46f003c","Type":"ContainerStarted","Data":"6ebf513418e0e5c25a01397a378b5f653992804685c13b5374272e0c68f34461"}
Jul 29 01:17:30.034847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:30.034510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:30.058127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:30.057970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb" podStartSLOduration=1.428739147 podStartE2EDuration="3.057950103s" totalImagesPullingTime="1.629210956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:30.056900194 +0000 UTC m=+292.898648099" watchObservedRunningTime="2026-07-29 01:17:30.057950103 +0000 UTC m=+292.899698007"
Jul 29 01:17:32.043047 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:32.043012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82" event={"ID":"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d","Type":"ContainerStarted","Data":"354a25ca2d87f18e11834a6c5febc2bac20fd924ad15730b50398579cbfc1c03"}
Jul 29 01:17:33.048244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:33.048212    2564 generic.go:356] "Generic (PLEG): container finished" podID="bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d" containerID="354a25ca2d87f18e11834a6c5febc2bac20fd924ad15730b50398579cbfc1c03" exitCode=0
Jul 29 01:17:33.048710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:33.048258    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82" event={"ID":"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d","Type":"ContainerDied","Data":"354a25ca2d87f18e11834a6c5febc2bac20fd924ad15730b50398579cbfc1c03"}
Jul 29 01:17:34.054725 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:34.054688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82" event={"ID":"bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d","Type":"ContainerStarted","Data":"45ba65e2f4770cbb68e8fbac59b3d7d4b74036e1627efe2c0942923e566aa385"}
Jul 29 01:17:34.055128 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:34.054799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:34.077933 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:34.077802    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82" podStartSLOduration=1.8547185069999998 podStartE2EDuration="6.0777821s" totalImagesPullingTime="3.20769187s" totalInitContainerRuntime="1.015371723s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:34.076262237 +0000 UTC m=+296.918010150" watchObservedRunningTime="2026-07-29 01:17:34.0777821 +0000 UTC m=+296.919530003"
Jul 29 01:17:37.589122 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:37.589092    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:17:41.040641 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:41.040608    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856ff8b689-jkjsb"
Jul 29 01:17:45.064605 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:45.064575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f677d9b6b-spf82"
Jul 29 01:17:55.413429 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.413395    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"]
Jul 29 01:17:55.421246 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.421224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.425201 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.425180    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 01:17:55.425714 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.425696    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 01:17:55.425857 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.425837    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:17:55.425969 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.425901    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 01:17:55.425969 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.425926    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:17:55.426176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.426163    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7jm8k\""
Jul 29 01:17:55.426227 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.426190    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 01:17:55.482244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482399 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k77g\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-kube-api-access-2k77g\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482399 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482399 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482399 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482584 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.482584 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.482464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.486380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.486350    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"]
Jul 29 01:17:55.583686 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.583889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k77g\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-kube-api-access-2k77g\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.583889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.583889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.583889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.583889 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.584157 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.583896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.584539 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.584495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.586145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.586117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.586145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.586132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.586465 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.586442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.586546 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.586533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.591878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.591856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k77g\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-kube-api-access-2k77g\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.592154 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.592138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e4cd9f9-0136-480e-8deb-5e3eaae21bd7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-x2bp5\" (UID: \"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.731252 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.731220    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:55.867127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.867096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"]
Jul 29 01:17:55.870628 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:17:55.870602    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4cd9f9_0136_480e_8deb_5e3eaae21bd7.slice/crio-9710cd306ce9b5cbf190f530bf75b5b9803929d32e0619da923134a2bab2abc0 WatchSource:0}: Error finding container 9710cd306ce9b5cbf190f530bf75b5b9803929d32e0619da923134a2bab2abc0: Status 404 returned error can't find the container with id 9710cd306ce9b5cbf190f530bf75b5b9803929d32e0619da923134a2bab2abc0
Jul 29 01:17:55.872583 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:55.872563    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:17:56.148280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:56.148198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5" event={"ID":"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7","Type":"ContainerStarted","Data":"9710cd306ce9b5cbf190f530bf75b5b9803929d32e0619da923134a2bab2abc0"}
Jul 29 01:17:58.248788 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:58.248748    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:17:58.249191 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:58.248830    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:17:59.164150 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:59.164116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5" event={"ID":"4e4cd9f9-0136-480e-8deb-5e3eaae21bd7","Type":"ContainerStarted","Data":"80188fbb656a73b66a2392148829ff90ecee1cf0ffd6a850ae116922f3375b26"}
Jul 29 01:17:59.164348 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:59.164334    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:59.165993 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:59.165970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5"
Jul 29 01:17:59.193728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:17:59.193618    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-x2bp5" podStartSLOduration=1.8178812309999999 podStartE2EDuration="4.193601864s" totalImagesPullingTime="2.375720633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:59.191826966 +0000 UTC m=+322.033574869" watchObservedRunningTime="2026-07-29 01:17:59.193601864 +0000 UTC m=+322.035349768"
Jul 29 01:20:17.074390 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.074355    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:20:17.076570 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.076553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.080912 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.080889    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 01:20:17.081017 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.080974    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 01:20:17.085218 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.085197    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 01:20:17.089996 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.089982    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t5xr4\""
Jul 29 01:20:17.105007 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.104981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:20:17.132071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.132038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7601482-7113-4ccc-8119-1845b7f973cc-config-file\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.132273 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.132098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xptkb\" (UniqueName: \"kubernetes.io/projected/a7601482-7113-4ccc-8119-1845b7f973cc-kube-api-access-xptkb\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.134319 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.134295    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:20:17.232773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.232734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7601482-7113-4ccc-8119-1845b7f973cc-config-file\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.232966 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.232783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xptkb\" (UniqueName: \"kubernetes.io/projected/a7601482-7113-4ccc-8119-1845b7f973cc-kube-api-access-xptkb\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.233348 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.233325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7601482-7113-4ccc-8119-1845b7f973cc-config-file\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.246115 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.246085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xptkb\" (UniqueName: \"kubernetes.io/projected/a7601482-7113-4ccc-8119-1845b7f973cc-kube-api-access-xptkb\") pod \"limitador-limitador-54d6d988d5-d7xz8\" (UID: \"a7601482-7113-4ccc-8119-1845b7f973cc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.386686 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.386598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:17.522372 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.522340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:20:17.525642 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:20:17.525617    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7601482_7113_4ccc_8119_1845b7f973cc.slice/crio-ada051eaad586178d4960e413e92663ad6a18c1be0f0f72307449a877e498c3f WatchSource:0}: Error finding container ada051eaad586178d4960e413e92663ad6a18c1be0f0f72307449a877e498c3f: Status 404 returned error can't find the container with id ada051eaad586178d4960e413e92663ad6a18c1be0f0f72307449a877e498c3f
Jul 29 01:20:17.709739 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:17.709712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8" event={"ID":"a7601482-7113-4ccc-8119-1845b7f973cc","Type":"ContainerStarted","Data":"ada051eaad586178d4960e413e92663ad6a18c1be0f0f72307449a877e498c3f"}
Jul 29 01:20:20.726394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:20.726362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8" event={"ID":"a7601482-7113-4ccc-8119-1845b7f973cc","Type":"ContainerStarted","Data":"20f787e04970d34b3ea4e2a4113f81b0bcec3520bc4fc73dad41e346b421f079"}
Jul 29 01:20:20.726780 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:20.726493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:20:20.748839 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:20.748794    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8" podStartSLOduration=1.417997197 podStartE2EDuration="3.748781702s" totalImagesPullingTime="2.330784505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:20.748077788 +0000 UTC m=+463.589825690" watchObservedRunningTime="2026-07-29 01:20:20.748781702 +0000 UTC m=+463.590529604"
Jul 29 01:20:31.731446 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:20:31.731416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"
Jul 29 01:21:33.534956 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:21:33.534754    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:21:55.213424 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:21:55.213391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:22:14.736679 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:14.736638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:22:31.616286 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:31.616247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:22:44.233577 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:44.233540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:22:50.123995 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.123959    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"]
Jul 29 01:22:50.127146 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.127130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.129878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.129857    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:22:50.131156 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.131137    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:22:50.131156 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.131152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-42t29\""
Jul 29 01:22:50.131323 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.131269    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 01:22:50.136180 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.136158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"]
Jul 29 01:22:50.195092 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.195268 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0df4b13-235c-4e50-aa04-8936cdeaf384-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.195268 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv2wk\" (UniqueName: \"kubernetes.io/projected/d0df4b13-235c-4e50-aa04-8936cdeaf384-kube-api-access-mv2wk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.195268 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.195397 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.195397 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.195358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0df4b13-235c-4e50-aa04-8936cdeaf384-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv2wk\" (UniqueName: \"kubernetes.io/projected/d0df4b13-235c-4e50-aa04-8936cdeaf384-kube-api-access-mv2wk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296166    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296627 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296627 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.296706 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.296668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.298541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.298523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0df4b13-235c-4e50-aa04-8936cdeaf384-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.298807 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.298789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0df4b13-235c-4e50-aa04-8936cdeaf384-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.304882 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.304859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv2wk\" (UniqueName: \"kubernetes.io/projected/d0df4b13-235c-4e50-aa04-8936cdeaf384-kube-api-access-mv2wk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbcp2\" (UID: \"d0df4b13-235c-4e50-aa04-8936cdeaf384\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.438628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.438535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:22:50.568041 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:50.568019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"]
Jul 29 01:22:50.570537 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:22:50.570487    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0df4b13_235c_4e50_aa04_8936cdeaf384.slice/crio-c39d017867c3360e2bb200ce2276be72019222e43dd4cad4922d5fce3ebe1fee WatchSource:0}: Error finding container c39d017867c3360e2bb200ce2276be72019222e43dd4cad4922d5fce3ebe1fee: Status 404 returned error can't find the container with id c39d017867c3360e2bb200ce2276be72019222e43dd4cad4922d5fce3ebe1fee
Jul 29 01:22:51.353493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:51.353456    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2" event={"ID":"d0df4b13-235c-4e50-aa04-8936cdeaf384","Type":"ContainerStarted","Data":"c39d017867c3360e2bb200ce2276be72019222e43dd4cad4922d5fce3ebe1fee"}
Jul 29 01:22:52.359874 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:52.359843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2" event={"ID":"d0df4b13-235c-4e50-aa04-8936cdeaf384","Type":"ContainerStarted","Data":"947f41a10f263c7a84ef8381dfe6ffbbfc2fc83d87c3d6e20e1a906bd8ffc8bb"}
Jul 29 01:22:52.378787 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:52.378732    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2" podStartSLOduration=1.363723669 podStartE2EDuration="2.378715592s" totalImagesPullingTime="1.014991923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:52.376790472 +0000 UTC m=+615.218538397" watchObservedRunningTime="2026-07-29 01:22:52.378715592 +0000 UTC m=+615.220463496"
Jul 29 01:22:53.024560 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:22:53.024490    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:23:00.439787 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:23:00.439701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:23:00.439787 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:23:00.439774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:23:00.452437 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:23:00.452409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:23:01.410659 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:23:01.410627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbcp2"
Jul 29 01:23:05.426671 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:23:05.426636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:24:31.120477 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:24:31.120398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:24:41.024680 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:24:41.024645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:24:51.324732 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:24:51.324696    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:25:51.040361 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.040328    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:25:51.043668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.043647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.047586 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.047567    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:25:51.047586 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.047567    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:25:51.047755 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.047597    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z4mq5\""
Jul 29 01:25:51.053041 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.053000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:25:51.231446 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.231407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.231652 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.231458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qphx\" (UniqueName: \"kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.332359 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.332277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.332359 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.332322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qphx\" (UniqueName: \"kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.334798 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.334780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.341127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.341102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qphx\" (UniqueName: \"kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx\") pod \"maas-controller-6dd887db67-pxdtl\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") " pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.353978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.353959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:51.481165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.481134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:25:51.484516 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:25:51.484470    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f56913_cc53_4aca_aa12_2e1ffa822e79.slice/crio-4c2536208fb91a1d92e2ee5052350296cdf2072931c302625f0be09e1f02a73a WatchSource:0}: Error finding container 4c2536208fb91a1d92e2ee5052350296cdf2072931c302625f0be09e1f02a73a: Status 404 returned error can't find the container with id 4c2536208fb91a1d92e2ee5052350296cdf2072931c302625f0be09e1f02a73a
Jul 29 01:25:51.485808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:51.485791    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:25:52.106857 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:52.106784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-pxdtl" event={"ID":"d1f56913-cc53-4aca-aa12-2e1ffa822e79","Type":"ContainerStarted","Data":"4c2536208fb91a1d92e2ee5052350296cdf2072931c302625f0be09e1f02a73a"}
Jul 29 01:25:54.118542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:54.118493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-pxdtl" event={"ID":"d1f56913-cc53-4aca-aa12-2e1ffa822e79","Type":"ContainerStarted","Data":"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"}
Jul 29 01:25:54.119024 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:54.118647    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:25:54.136674 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:25:54.136619    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dd887db67-pxdtl" podStartSLOduration=0.93106687 podStartE2EDuration="3.136599787s" totalImagesPullingTime="2.205532917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:54.136373425 +0000 UTC m=+796.978121328" watchObservedRunningTime="2026-07-29 01:25:54.136599787 +0000 UTC m=+796.978347689"
Jul 29 01:26:05.125229 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:05.125150    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:26:09.767933 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:09.767896    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:26:09.768336 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:09.768097    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6dd887db67-pxdtl" podUID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" containerName="manager" containerID="cri-o://40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc" gracePeriod=30
Jul 29 01:26:10.012214 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.012190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:26:10.072371 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.072282    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert\") pod \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") "
Jul 29 01:26:10.072560 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.072409    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qphx\" (UniqueName: \"kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx\") pod \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\" (UID: \"d1f56913-cc53-4aca-aa12-2e1ffa822e79\") "
Jul 29 01:26:10.074578 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.074538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx" (OuterVolumeSpecName: "kube-api-access-8qphx") pod "d1f56913-cc53-4aca-aa12-2e1ffa822e79" (UID: "d1f56913-cc53-4aca-aa12-2e1ffa822e79"). InnerVolumeSpecName "kube-api-access-8qphx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:26:10.074687 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.074550    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d1f56913-cc53-4aca-aa12-2e1ffa822e79" (UID: "d1f56913-cc53-4aca-aa12-2e1ffa822e79"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:26:10.173302 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.173259    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qphx\" (UniqueName: \"kubernetes.io/projected/d1f56913-cc53-4aca-aa12-2e1ffa822e79-kube-api-access-8qphx\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:26:10.173302 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.173293    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d1f56913-cc53-4aca-aa12-2e1ffa822e79-webhook-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:26:10.186756 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.186723    2564 generic.go:356] "Generic (PLEG): container finished" podID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" containerID="40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc" exitCode=0
Jul 29 01:26:10.186930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.186773    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-pxdtl"
Jul 29 01:26:10.186930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.186788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-pxdtl" event={"ID":"d1f56913-cc53-4aca-aa12-2e1ffa822e79","Type":"ContainerDied","Data":"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"}
Jul 29 01:26:10.186930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.186830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-pxdtl" event={"ID":"d1f56913-cc53-4aca-aa12-2e1ffa822e79","Type":"ContainerDied","Data":"4c2536208fb91a1d92e2ee5052350296cdf2072931c302625f0be09e1f02a73a"}
Jul 29 01:26:10.186930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.186855    2564 scope.go:117] "RemoveContainer" containerID="40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"
Jul 29 01:26:10.195702 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.195681    2564 scope.go:117] "RemoveContainer" containerID="40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"
Jul 29 01:26:10.195973 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:26:10.195951    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc\": container with ID starting with 40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc not found: ID does not exist" containerID="40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"
Jul 29 01:26:10.196044 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.195985    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc"} err="failed to get container status \"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc\": rpc error: code = NotFound desc = could not find container \"40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc\": container with ID starting with 40b06bc256de0fc9bc70fa4ac2be115aeb79a3315e377aa1042160c239beb7bc not found: ID does not exist"
Jul 29 01:26:10.208814 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.208785    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:26:10.210917 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.210893    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dd887db67-pxdtl"]
Jul 29 01:26:10.990235 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.990193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dd887db67-8c85z"]
Jul 29 01:26:10.990715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.990518    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" containerName="manager"
Jul 29 01:26:10.990715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.990529    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" containerName="manager"
Jul 29 01:26:10.990715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.990580    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" containerName="manager"
Jul 29 01:26:10.994628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.994604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:10.997957 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.997940    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:26:10.998294 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.998277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z4mq5\""
Jul 29 01:26:10.999473 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:10.999457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:26:11.002755 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.002733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd887db67-8c85z"]
Jul 29 01:26:11.081551 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.081479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx999\" (UniqueName: \"kubernetes.io/projected/411d001c-586c-45fd-a89e-33360ca1bd15-kube-api-access-vx999\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.081727 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.081615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411d001c-586c-45fd-a89e-33360ca1bd15-webhook-cert\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.182897 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.182860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx999\" (UniqueName: \"kubernetes.io/projected/411d001c-586c-45fd-a89e-33360ca1bd15-kube-api-access-vx999\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.183075 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.182921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411d001c-586c-45fd-a89e-33360ca1bd15-webhook-cert\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.185280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.185255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/411d001c-586c-45fd-a89e-33360ca1bd15-webhook-cert\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.191387 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.191359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx999\" (UniqueName: \"kubernetes.io/projected/411d001c-586c-45fd-a89e-33360ca1bd15-kube-api-access-vx999\") pod \"maas-controller-6dd887db67-8c85z\" (UID: \"411d001c-586c-45fd-a89e-33360ca1bd15\") " pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.306171 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.306074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:11.435768 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.435742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd887db67-8c85z"]
Jul 29 01:26:11.438120 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:26:11.438092    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411d001c_586c_45fd_a89e_33360ca1bd15.slice/crio-d91233e00c1ca773122c9ccf0365ddd77bc34c253df1aa5acfbe7e2c7f0b5a4d WatchSource:0}: Error finding container d91233e00c1ca773122c9ccf0365ddd77bc34c253df1aa5acfbe7e2c7f0b5a4d: Status 404 returned error can't find the container with id d91233e00c1ca773122c9ccf0365ddd77bc34c253df1aa5acfbe7e2c7f0b5a4d
Jul 29 01:26:11.804749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:11.804715    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f56913-cc53-4aca-aa12-2e1ffa822e79" path="/var/lib/kubelet/pods/d1f56913-cc53-4aca-aa12-2e1ffa822e79/volumes"
Jul 29 01:26:12.203597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:12.203477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-8c85z" event={"ID":"411d001c-586c-45fd-a89e-33360ca1bd15","Type":"ContainerStarted","Data":"970418db1d25b4ce0c5fc8d11d1de19b5b143460be4ddfbd8bb4dbdc1d2c1e05"}
Jul 29 01:26:12.203597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:12.203583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd887db67-8c85z" event={"ID":"411d001c-586c-45fd-a89e-33360ca1bd15","Type":"ContainerStarted","Data":"d91233e00c1ca773122c9ccf0365ddd77bc34c253df1aa5acfbe7e2c7f0b5a4d"}
Jul 29 01:26:12.204080 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:12.203618    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:12.228841 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:12.228788    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dd887db67-8c85z" podStartSLOduration=1.826851761 podStartE2EDuration="2.228768589s" totalImagesPullingTime="401.916828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:26:12.22676271 +0000 UTC m=+815.068510845" watchObservedRunningTime="2026-07-29 01:26:12.228768589 +0000 UTC m=+815.070516482"
Jul 29 01:26:23.209659 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:23.209628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dd887db67-8c85z"
Jul 29 01:26:35.923939 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:35.923904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:26:45.243647 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:45.243610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:26:57.230344 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:26:57.230301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:27:13.228415 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:27:13.228381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:27:23.128887 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:27:23.128852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:27:32.925733 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:27:32.925645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:27:41.223489 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:27:41.223440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:27:51.725811 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:27:51.725774    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:28:04.031606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:28:04.031571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:28:14.728384 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:28:14.728346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:28:24.926102 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:28:24.926071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:28:46.919931 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:28:46.919895    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:28:56.222843 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:28:56.222809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:29:20.023997 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:29:20.023959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:29:30.730200 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:29:30.730159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:29:41.075862 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:29:41.075826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:29:58.632681 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:29:58.632645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:30:08.421320 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:30:08.421283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:30:18.525582 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:30:18.525545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:30:27.814335 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:30:27.814306    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:30:37.122697 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:30:37.122617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:32:25.518304 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:32:25.518269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:32:36.823747 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:32:36.823715    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:32:52.020743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:32:52.020708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:01.933284 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:01.933251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:13.431518 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:13.431473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:22.130324 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:22.130283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:33.126684 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:33.126598    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:45.740659 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:45.740619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:33:53.524537 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:33:53.524486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:34:03.419808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:34:03.419773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:34:15.219595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:34:15.219556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:34:22.839552 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:34:22.839513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:34:40.352404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:34:40.352373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:34:49.524787 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:34:49.524751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:35:05.338217 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.338130    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:35:05.341413 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.341396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.344293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.344270    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-379063b9-kserve-self-signed-certs\""
Jul 29 01:35:05.363242 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.363215    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:35:05.417327 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.417494 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.417494 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.417494 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td56s\" (UniqueName: \"kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.417494 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.417657 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.417554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518427 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td56s\" (UniqueName: \"kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.518990 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.518967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.519031 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.519014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.521056 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.521023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.521290 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.521271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.528515 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.528475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td56s\" (UniqueName: \"kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s\") pod \"e2e-same-id-a-379063b9-kserve-88475f679-xljwx\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") " pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.650728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.650644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:05.781560 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:05.781541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:35:05.783976 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:35:05.783943    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8bfb75e_7b1d_4a18_a091_1ec3b66c0ce0.slice/crio-ec031178d64266d60c3ff8c81778df3b649f10a86972fa740e796db6a354ebad WatchSource:0}: Error finding container ec031178d64266d60c3ff8c81778df3b649f10a86972fa740e796db6a354ebad: Status 404 returned error can't find the container with id ec031178d64266d60c3ff8c81778df3b649f10a86972fa740e796db6a354ebad
Jul 29 01:35:06.416238 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:06.416202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" event={"ID":"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0","Type":"ContainerStarted","Data":"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"}
Jul 29 01:35:06.416238 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:06.416241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" event={"ID":"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0","Type":"ContainerStarted","Data":"ec031178d64266d60c3ff8c81778df3b649f10a86972fa740e796db6a354ebad"}
Jul 29 01:35:06.434780 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:06.434730    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" podStartSLOduration=1.434713548 podStartE2EDuration="1.434713548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:35:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:35:06.433752462 +0000 UTC m=+1349.275500365" watchObservedRunningTime="2026-07-29 01:35:06.434713548 +0000 UTC m=+1349.276461451"
Jul 29 01:35:08.249036 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:08.249001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:35:15.651455 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:15.651366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:15.651455 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:15.651450    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:15.663990 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:15.663963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:16.477930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:16.477898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:35:32.541192 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.541158    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:35:32.544591 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.544575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.547847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.547829    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-379063b9-kserve-self-signed-certs\""
Jul 29 01:35:32.559822 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.559798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:35:32.660370 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.660370 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhsl5\" (UniqueName: \"kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.660638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.660638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.660638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.660638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.660610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhsl5\" (UniqueName: \"kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762650 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762726 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.762895 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.762876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.764366 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.764347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.764753 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.764731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.771622 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.771604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhsl5\" (UniqueName: \"kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5\") pod \"e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") " pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.854558 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.854463    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:32.985429 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:32.985394    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:35:32.988330 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:35:32.988306    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a5eb359_9889_47b4_afa0_9f269a421eff.slice/crio-11bb6c588f7f8edf35bf9c85bfba3fb708ccbf6bb49c85c5984b06f02793b170 WatchSource:0}: Error finding container 11bb6c588f7f8edf35bf9c85bfba3fb708ccbf6bb49c85c5984b06f02793b170: Status 404 returned error can't find the container with id 11bb6c588f7f8edf35bf9c85bfba3fb708ccbf6bb49c85c5984b06f02793b170
Jul 29 01:35:33.543380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:33.543346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" event={"ID":"3a5eb359-9889-47b4-afa0-9f269a421eff","Type":"ContainerStarted","Data":"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"}
Jul 29 01:35:33.543380 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:33.543385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" event={"ID":"3a5eb359-9889-47b4-afa0-9f269a421eff","Type":"ContainerStarted","Data":"11bb6c588f7f8edf35bf9c85bfba3fb708ccbf6bb49c85c5984b06f02793b170"}
Jul 29 01:35:33.580713 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:33.580663    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" podStartSLOduration=1.580647075 podStartE2EDuration="1.580647075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:35:33.580078416 +0000 UTC m=+1376.421826322" watchObservedRunningTime="2026-07-29 01:35:33.580647075 +0000 UTC m=+1376.422395021"
Jul 29 01:35:36.739000 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:36.738963    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:35:42.855577 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:42.855531    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:42.856002 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:42.855595    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:42.868065 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:42.868039    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:35:43.595920 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:35:43.595894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:36:22.056308 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:22.056275    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:36:22.759052 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:22.759019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:36:24.824565 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:24.824530    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:36:37.076649 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.076567    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" podUID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" containerName="main" containerID="cri-o://b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda" gracePeriod=45
Jul 29 01:36:37.329375 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.329309    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:36:37.392573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.392752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.392752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392612    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td56s\" (UniqueName: \"kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.392752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.392752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392654    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.392752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs\") pod \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\" (UID: \"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0\") "
Jul 29 01:36:37.393001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home" (OuterVolumeSpecName: "home") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:37.393001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:37.393001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:37.393001 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.392965    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.395034 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.395004    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:36:37.395034 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.395031    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s" (OuterVolumeSpecName: "kube-api-access-td56s") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "kube-api-access-td56s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:36:37.395206 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.395008    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm" (OuterVolumeSpecName: "dshm") pod "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" (UID: "a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:37.494107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.494068    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.494107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.494100    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td56s\" (UniqueName: \"kubernetes.io/projected/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-kube-api-access-td56s\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.494107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.494111    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.494107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.494120    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.494377 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.494128    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:37.778877 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.778837    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" podUID="3a5eb359-9889-47b4-afa0-9f269a421eff" containerName="main" containerID="cri-o://408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f" gracePeriod=45
Jul 29 01:36:37.822168 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.822126    2564 generic.go:356] "Generic (PLEG): container finished" podID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" containerID="b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda" exitCode=0
Jul 29 01:36:37.822329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.822175    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"
Jul 29 01:36:37.822329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.822203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" event={"ID":"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0","Type":"ContainerDied","Data":"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"}
Jul 29 01:36:37.822329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.822243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx" event={"ID":"a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0","Type":"ContainerDied","Data":"ec031178d64266d60c3ff8c81778df3b649f10a86972fa740e796db6a354ebad"}
Jul 29 01:36:37.822329 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.822260    2564 scope.go:117] "RemoveContainer" containerID="b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"
Jul 29 01:36:37.853719 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.853687    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:36:37.859719 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.859695    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-379063b9-kserve-88475f679-xljwx"]
Jul 29 01:36:37.889026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.889004    2564 scope.go:117] "RemoveContainer" containerID="b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"
Jul 29 01:36:37.889354 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:36:37.889331    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda\": container with ID starting with b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda not found: ID does not exist" containerID="b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"
Jul 29 01:36:37.889401 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:37.889367    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda"} err="failed to get container status \"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda\": rpc error: code = NotFound desc = could not find container \"b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda\": container with ID starting with b9194a3da986601dbaa7c5cd7406f5f386f8f52acd1941008a7b42074ead9fda not found: ID does not exist"
Jul 29 01:36:38.014905 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.014877    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:36:38.097870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.097839    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.097870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.097878    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.097912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhsl5\" (UniqueName: \"kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.097930    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.097960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.098201    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home" (OuterVolumeSpecName: "home") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.098230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:38.098365 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.098251    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:38.100044 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.100024    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm" (OuterVolumeSpecName: "dshm") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:38.100140 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.100089    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5" (OuterVolumeSpecName: "kube-api-access-vhsl5") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "kube-api-access-vhsl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:36:38.198855 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198818    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs\") pod \"3a5eb359-9889-47b4-afa0-9f269a421eff\" (UID: \"3a5eb359-9889-47b4-afa0-9f269a421eff\") "
Jul 29 01:36:38.199026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198960    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.199026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198970    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.199026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198978    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhsl5\" (UniqueName: \"kubernetes.io/projected/3a5eb359-9889-47b4-afa0-9f269a421eff-kube-api-access-vhsl5\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.199026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198986    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.199026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.198996    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a5eb359-9889-47b4-afa0-9f269a421eff-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.200830 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.200802    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a5eb359-9889-47b4-afa0-9f269a421eff" (UID: "3a5eb359-9889-47b4-afa0-9f269a421eff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:36:38.299332 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.299298    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5eb359-9889-47b4-afa0-9f269a421eff-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:36:38.828493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.828457    2564 generic.go:356] "Generic (PLEG): container finished" podID="3a5eb359-9889-47b4-afa0-9f269a421eff" containerID="408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f" exitCode=0
Jul 29 01:36:38.828493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.828510    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"
Jul 29 01:36:38.828752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.828525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" event={"ID":"3a5eb359-9889-47b4-afa0-9f269a421eff","Type":"ContainerDied","Data":"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"}
Jul 29 01:36:38.828752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.828557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b" event={"ID":"3a5eb359-9889-47b4-afa0-9f269a421eff","Type":"ContainerDied","Data":"11bb6c588f7f8edf35bf9c85bfba3fb708ccbf6bb49c85c5984b06f02793b170"}
Jul 29 01:36:38.828752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.828575    2564 scope.go:117] "RemoveContainer" containerID="408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"
Jul 29 01:36:38.837034 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.837016    2564 scope.go:117] "RemoveContainer" containerID="408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"
Jul 29 01:36:38.837332 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:36:38.837314    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f\": container with ID starting with 408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f not found: ID does not exist" containerID="408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"
Jul 29 01:36:38.837375 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.837343    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f"} err="failed to get container status \"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f\": rpc error: code = NotFound desc = could not find container \"408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f\": container with ID starting with 408bac5e7103ac0d4b621a1e70be3c00de5c5b7321d6d99785e05f984df5f89f not found: ID does not exist"
Jul 29 01:36:38.849758 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.849726    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:36:38.858195 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:38.854185    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-379063b9-kserve-75477584bc-cgv8b"]
Jul 29 01:36:39.136980 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:39.136882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:36:39.805179 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:39.805139    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a5eb359-9889-47b4-afa0-9f269a421eff" path="/var/lib/kubelet/pods/3a5eb359-9889-47b4-afa0-9f269a421eff/volumes"
Jul 29 01:36:39.805595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:39.805580    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" path="/var/lib/kubelet/pods/a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0/volumes"
Jul 29 01:36:45.833450 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:36:45.833416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:00.430448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:00.430414    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:11.717520 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:11.717474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:21.131723 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:21.131685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:31.419068 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:31.419034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:40.719466 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:40.719428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:37:50.223046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:37:50.223005    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:03.937993 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:03.937904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:13.123863 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:13.123824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:22.628689 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:22.628653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:35.027153 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:35.027122    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:46.418530 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:46.418479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:38:54.223631 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:38:54.223596    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:39:06.731202 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:39:06.731159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:39:18.222461 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:39:18.222426    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:39:29.424575 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:39:29.424465    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:39:42.930301 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:39:42.930265    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:39:51.524037 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:39:51.524001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:40:01.220367 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:01.220328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:40:02.242033 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242000    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:02.242404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242340    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a5eb359-9889-47b4-afa0-9f269a421eff" containerName="main"
Jul 29 01:40:02.242404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242355    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a5eb359-9889-47b4-afa0-9f269a421eff" containerName="main"
Jul 29 01:40:02.242404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242376    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" containerName="main"
Jul 29 01:40:02.242404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242381    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" containerName="main"
Jul 29 01:40:02.242590 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242435    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a5eb359-9889-47b4-afa0-9f269a421eff" containerName="main"
Jul 29 01:40:02.242590 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.242446    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8bfb75e-7b1d-4a18-a091-1ec3b66c0ce0" containerName="main"
Jul 29 01:40:02.245391 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.245374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.249316 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.249292    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ed6c6ab5-openshift-default-dockercfg-zjsgj\""
Jul 29 01:40:02.264486 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.264457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:02.326661 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.326848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vzxm\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.327159 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.327159 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.326884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428084 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428084 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428327 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428327 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428327 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vzxm\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428327 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428614 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428614 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428803 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428855 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428908 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.428957 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.428882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.429081 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.429064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.430763 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.430740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.431124 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.431105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.436421 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.436392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.436668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.436650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vzxm\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm\") pod \"e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") " pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.556667 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.556577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:02.692471 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.692410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:02.694737 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:40:02.694714    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5933f440_2cde_4c1a_9014_d967a62e70ce.slice/crio-c175dd2aeea9137296e160987a57d519227def795cb7d1a3b0d31a617aa0541e WatchSource:0}: Error finding container c175dd2aeea9137296e160987a57d519227def795cb7d1a3b0d31a617aa0541e: Status 404 returned error can't find the container with id c175dd2aeea9137296e160987a57d519227def795cb7d1a3b0d31a617aa0541e
Jul 29 01:40:02.696635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:02.696618    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:40:03.686424 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:03.686390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerStarted","Data":"c175dd2aeea9137296e160987a57d519227def795cb7d1a3b0d31a617aa0541e"}
Jul 29 01:40:06.096885 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:06.096850    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:06.097142 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:06.096923    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:06.097142 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:06.096959    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:06.705197 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:06.705160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerStarted","Data":"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"}
Jul 29 01:40:06.727104 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:06.727051    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podStartSLOduration=1.327312759 podStartE2EDuration="4.727036455s" totalImagesPullingTime="3.399723696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:06.725615874 +0000 UTC m=+1649.567363777" watchObservedRunningTime="2026-07-29 01:40:06.727036455 +0000 UTC m=+1649.568784358"
Jul 29 01:40:07.557077 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:07.557038    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:07.562409 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:07.562373    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:07.709606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:07.709574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:07.710610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:07.710588    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:14.820979 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:14.820946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:40:22.711513 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.711470    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 01:40:22.711843 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.711551    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 01:40:22.780186 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.780155    2564 generic.go:356] "Generic (PLEG): container finished" podID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerID="8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05" exitCode=0
Jul 29 01:40:22.780359 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.780232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerDied","Data":"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"}
Jul 29 01:40:22.780685 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.780668    2564 scope.go:117] "RemoveContainer" containerID="8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"
Jul 29 01:40:22.781665 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.781640    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:22.781723 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.781702    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:22.781758 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:22.781734    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:23.786917 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:23.786883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerStarted","Data":"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"}
Jul 29 01:40:24.556997 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:24.556960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:24.557221 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:24.557196    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 01:40:24.557297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:24.557265    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 01:40:25.557931 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:25.557892    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 01:40:25.558417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:25.557960    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 01:40:26.557805 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:26.557772    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 01:40:26.557978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:26.557857    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 01:40:27.557948 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:27.557908    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 29 01:40:27.558165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:27.557961    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 29 01:40:28.561347 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:28.561318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:28.561747 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:28.561585    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:28.562398 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:28.562382    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:39.334528 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:39.334472    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:39.335069 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:39.334696    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" containerID="cri-o://f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c" gracePeriod=30
Jul 29 01:40:40.350384 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.350354    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:40:40.353777 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.353761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.356466 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.356448    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-6870a9be-gw-openshift-default-dockercfg-p7vtl\""
Jul 29 01:40:40.367042 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.367017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:40:40.479492 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z7nj\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479698 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479698 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479698 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479698 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479698 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.479875 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.479821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.580972 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.580942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.580972 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.580978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z7nj\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581585 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581585 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581714 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581861 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.581915 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.581855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.583957 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.583930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.584081 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.584066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.590479 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.590453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.590479 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.590463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z7nj\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj\") pod \"e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") " pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.665713 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.665624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:40.801997 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.801975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:40:40.804047 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:40:40.804020    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb0750a_e09a_4e0f_bd46_319e8756cd46.slice/crio-c2eaf292b07cba803c54785b11ea4bce767f4ec7902cfdaf2d12a12b9590c3d6 WatchSource:0}: Error finding container c2eaf292b07cba803c54785b11ea4bce767f4ec7902cfdaf2d12a12b9590c3d6: Status 404 returned error can't find the container with id c2eaf292b07cba803c54785b11ea4bce767f4ec7902cfdaf2d12a12b9590c3d6
Jul 29 01:40:40.806342 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.806310    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:40.806433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.806370    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:40.806433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.806399    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:40.861133 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.861109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerStarted","Data":"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"}
Jul 29 01:40:40.861242 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:40.861154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerStarted","Data":"c2eaf292b07cba803c54785b11ea4bce767f4ec7902cfdaf2d12a12b9590c3d6"}
Jul 29 01:40:41.886104 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:41.886054    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podStartSLOduration=1.886038195 podStartE2EDuration="1.886038195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:40:41.885199402 +0000 UTC m=+1684.726947305" watchObservedRunningTime="2026-07-29 01:40:41.886038195 +0000 UTC m=+1684.727786098"
Jul 29 01:40:42.666756 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:42.666713    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:42.672113 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:42.672085    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:42.869795 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:42.869762    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:42.870642 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:42.870625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:43.218736 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:43.218701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:40:43.564582 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:43.564484    2564 patch_prober.go:28] interesting pod/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:40:43.564582 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:43.564566    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:40:44.582860 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.582836    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:44.615412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.615321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.615412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.615379    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.615412 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.615403    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.615916 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.615893    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.616496 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.616496 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616419    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:40:44.616496 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:40:44.616741 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616555    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:40:44.616741 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616644    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.616741 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.616888 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616786    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vzxm\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.616888 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.616866    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs\") pod \"5933f440-2cde-4c1a-9014-d967a62e70ce\" (UID: \"5933f440-2cde-4c1a-9014-d967a62e70ce\") "
Jul 29 01:40:44.617628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.617408    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5933f440-2cde-4c1a-9014-d967a62e70ce-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.617628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.617431    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.617628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.617448    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.618101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.617818    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:40:44.618101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.617881    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:40:44.619182 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.619137    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:40:44.619182 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.619136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:40:44.624299 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.624274    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:40:44.624392 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.624323    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm" (OuterVolumeSpecName: "kube-api-access-4vzxm") pod "5933f440-2cde-4c1a-9014-d967a62e70ce" (UID: "5933f440-2cde-4c1a-9014-d967a62e70ce"). InnerVolumeSpecName "kube-api-access-4vzxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:40:44.718605 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718571    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.718605 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718597    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.718605 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718608    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.718605 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718615    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.718901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718624    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vzxm\" (UniqueName: \"kubernetes.io/projected/5933f440-2cde-4c1a-9014-d967a62e70ce-kube-api-access-4vzxm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.718901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.718634    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5933f440-2cde-4c1a-9014-d967a62e70ce-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:40:44.881222 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.881135    2564 generic.go:356] "Generic (PLEG): container finished" podID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerID="f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c" exitCode=0
Jul 29 01:40:44.881222 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.881208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"
Jul 29 01:40:44.881441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.881224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerDied","Data":"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"}
Jul 29 01:40:44.881441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.881282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj" event={"ID":"5933f440-2cde-4c1a-9014-d967a62e70ce","Type":"ContainerDied","Data":"c175dd2aeea9137296e160987a57d519227def795cb7d1a3b0d31a617aa0541e"}
Jul 29 01:40:44.881441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.881306    2564 scope.go:117] "RemoveContainer" containerID="f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"
Jul 29 01:40:44.890620 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.890604    2564 scope.go:117] "RemoveContainer" containerID="8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"
Jul 29 01:40:44.898411 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.898395    2564 scope.go:117] "RemoveContainer" containerID="f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"
Jul 29 01:40:44.898667 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:40:44.898648    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c\": container with ID starting with f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c not found: ID does not exist" containerID="f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"
Jul 29 01:40:44.898715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.898677    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c"} err="failed to get container status \"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c\": rpc error: code = NotFound desc = could not find container \"f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c\": container with ID starting with f89042f20097f7f89d3dff6c3ed4875f0174a031da3c0728d90f396abffa8b3c not found: ID does not exist"
Jul 29 01:40:44.898715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.898701    2564 scope.go:117] "RemoveContainer" containerID="8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"
Jul 29 01:40:44.898961 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:40:44.898943    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05\": container with ID starting with 8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05 not found: ID does not exist" containerID="8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"
Jul 29 01:40:44.899006 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.898969    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05"} err="failed to get container status \"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05\": rpc error: code = NotFound desc = could not find container \"8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05\": container with ID starting with 8fedfce6514bffc54abc1ee9795c1ef70b17132b90b3efa963702aaed397fa05 not found: ID does not exist"
Jul 29 01:40:44.905624 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.905602    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:44.909748 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:44.909729    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ed6c6ab5-openshift-default-f9684dc44-5xfxj"]
Jul 29 01:40:45.806559 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:45.806031    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" path="/var/lib/kubelet/pods/5933f440-2cde-4c1a-9014-d967a62e70ce/volumes"
Jul 29 01:40:53.331362 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:53.331328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:40:56.942681 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.942649    2564 generic.go:356] "Generic (PLEG): container finished" podID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerID="bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33" exitCode=0
Jul 29 01:40:56.943079 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.942723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerDied","Data":"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"}
Jul 29 01:40:56.943135 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.943078    2564 scope.go:117] "RemoveContainer" containerID="bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"
Jul 29 01:40:56.944051 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.944024    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:56.944104 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.944090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:56.944138 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:56.944119    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:40:57.870254 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:57.870220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:57.948656 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:57.948619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerStarted","Data":"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"}
Jul 29 01:40:58.666724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:58.666645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:40:58.667818 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:58.667785    2564 patch_prober.go:28] interesting pod/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:40:58.667942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:58.667836    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:40:59.666364 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:59.666327    2564 patch_prober.go:28] interesting pod/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:40:59.666794 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:40:59.666384    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:41:00.666871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:00.666835    2564 patch_prober.go:28] interesting pod/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:41:00.667260 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:00.666890    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:41:01.666879 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:01.666840    2564 patch_prober.go:28] interesting pod/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:41:01.667258 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:01.666917    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:41:02.670717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:02.670688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:41:02.671140 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:02.670966    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:41:02.671695 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:02.671675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:41:15.339871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:15.339841    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:41:15.340417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:15.340051    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" containerID="cri-o://7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6" gracePeriod=30
Jul 29 01:41:16.082629 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.082588    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:16.082963 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.082945    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.082963 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.082964    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.083093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.082981    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.083093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.082987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.083093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.083053    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.083093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.083061    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5933f440-2cde-4c1a-9014-d967a62e70ce" containerName="istio-proxy"
Jul 29 01:41:16.086014 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.085993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.088727 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.088699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a3670250-openshift-default-dockercfg-5688h\""
Jul 29 01:41:16.098161 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.098138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:16.198127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198296 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198296 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198296 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198296 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj6s6\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198441 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.198566 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.198434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299464 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299464 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299690 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299690 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj6s6\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299690 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299846 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.299934 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.300014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.300033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300072 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.299820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.300575 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.300553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.302025 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.302005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.302245 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.302225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.307439 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.307414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.307557 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.307541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj6s6\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6\") pod \"e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") " pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.396664 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.396577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:16.525440 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.525342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:16.527512 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:41:16.527475    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575476c0_045a_4ece_a700_809e982b980a.slice/crio-0ba450a6188bb7aae0bd9909e5590524b95c78f9a6c56986ef938a561b36e2e1 WatchSource:0}: Error finding container 0ba450a6188bb7aae0bd9909e5590524b95c78f9a6c56986ef938a561b36e2e1: Status 404 returned error can't find the container with id 0ba450a6188bb7aae0bd9909e5590524b95c78f9a6c56986ef938a561b36e2e1
Jul 29 01:41:16.529628 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.529599    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:16.529702 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.529669    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:16.529702 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:16.529695    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:17.040387 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.040351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerStarted","Data":"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"}
Jul 29 01:41:17.040612 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.040406    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerStarted","Data":"0ba450a6188bb7aae0bd9909e5590524b95c78f9a6c56986ef938a561b36e2e1"}
Jul 29 01:41:17.068423 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.068372    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podStartSLOduration=1.06835408 podStartE2EDuration="1.06835408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:17.066756525 +0000 UTC m=+1719.908504448" watchObservedRunningTime="2026-07-29 01:41:17.06835408 +0000 UTC m=+1719.910101983"
Jul 29 01:41:17.397636 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.397553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:17.402491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.402469    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:17.673755 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.673676    2564 patch_prober.go:28] interesting pod/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:41:17.673755 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:17.673735    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:41:18.044985 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:18.044956    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:18.046030 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:18.046012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:18.731281 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:18.731245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:41:20.604023 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.603967    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:41:20.739356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739322    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739359    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739434    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z7nj\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739585    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739633 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739641    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data\") pod \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\" (UID: \"3eb0750a-e09a-4e0f-bd46-319e8756cd46\") "
Jul 29 01:41:20.739926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739851    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:20.740025 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.739939    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:20.740106 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.740079    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:20.740168 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.740099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:20.740742 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.740714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data" (OuterVolumeSpecName: "istio-data") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:20.741794 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.741765    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:20.741794 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.741780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj" (OuterVolumeSpecName: "kube-api-access-6z7nj") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "kube-api-access-6z7nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:20.741944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.741793    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token" (OuterVolumeSpecName: "istio-token") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:20.741944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.741811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3eb0750a-e09a-4e0f-bd46-319e8756cd46" (UID: "3eb0750a-e09a-4e0f-bd46-319e8756cd46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:41:20.841103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841058    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841099    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841108    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841117    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z7nj\" (UniqueName: \"kubernetes.io/projected/3eb0750a-e09a-4e0f-bd46-319e8756cd46-kube-api-access-6z7nj\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841127    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841136    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841145    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841153    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:20.841368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:20.841160    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb0750a-e09a-4e0f-bd46-319e8756cd46-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:21.060486 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.060448    2564 generic.go:356] "Generic (PLEG): container finished" podID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerID="7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6" exitCode=0
Jul 29 01:41:21.060672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.060543    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"
Jul 29 01:41:21.060672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.060540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerDied","Data":"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"}
Jul 29 01:41:21.060672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.060603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29" event={"ID":"3eb0750a-e09a-4e0f-bd46-319e8756cd46","Type":"ContainerDied","Data":"c2eaf292b07cba803c54785b11ea4bce767f4ec7902cfdaf2d12a12b9590c3d6"}
Jul 29 01:41:21.060672 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.060628    2564 scope.go:117] "RemoveContainer" containerID="7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"
Jul 29 01:41:21.069300 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.069284    2564 scope.go:117] "RemoveContainer" containerID="bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"
Jul 29 01:41:21.076587 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.076569    2564 scope.go:117] "RemoveContainer" containerID="7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"
Jul 29 01:41:21.076845 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:41:21.076826    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6\": container with ID starting with 7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6 not found: ID does not exist" containerID="7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"
Jul 29 01:41:21.076913 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.076858    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6"} err="failed to get container status \"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6\": rpc error: code = NotFound desc = could not find container \"7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6\": container with ID starting with 7b2797c83895fee038dd9fea48185a07c703ad4d76eb5b01b1206cf297329be6 not found: ID does not exist"
Jul 29 01:41:21.076913 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.076884    2564 scope.go:117] "RemoveContainer" containerID="bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"
Jul 29 01:41:21.077119 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:41:21.077099    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33\": container with ID starting with bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33 not found: ID does not exist" containerID="bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"
Jul 29 01:41:21.077165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.077126    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33"} err="failed to get container status \"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33\": rpc error: code = NotFound desc = could not find container \"bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33\": container with ID starting with bb35916beb87d950fecae49488b809a5cb6c27a76e3b75e9ee7cab60e272ba33 not found: ID does not exist"
Jul 29 01:41:21.085624 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.085605    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:41:21.087732 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.087711    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-6870a9be-gw-openshift-default-7894bc47b4-dkc29"]
Jul 29 01:41:21.804844 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:21.804806    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" path="/var/lib/kubelet/pods/3eb0750a-e09a-4e0f-bd46-319e8756cd46/volumes"
Jul 29 01:41:28.923181 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:28.923141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:41:33.046620 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.046582    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 29 01:41:33.047050 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.046652    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 29 01:41:33.115185 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.115153    2564 generic.go:356] "Generic (PLEG): container finished" podID="575476c0-045a-4ece-a700-809e982b980a" containerID="c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299" exitCode=0
Jul 29 01:41:33.115350 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.115228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerDied","Data":"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"}
Jul 29 01:41:33.115699 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.115683    2564 scope.go:117] "RemoveContainer" containerID="c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"
Jul 29 01:41:33.116766 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.116739    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:33.116824 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.116805    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:33.116858 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:33.116843    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:34.124837 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:34.124798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerStarted","Data":"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"}
Jul 29 01:41:34.397393 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:34.397294    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:34.397656 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:34.397632    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 29 01:41:34.397711 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:34.397681    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 29 01:41:35.397190 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:35.397144    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 29 01:41:35.397715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:35.397208    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 29 01:41:36.397715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:36.397673    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 29 01:41:36.398120 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:36.397741    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 29 01:41:37.397409 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:37.397375    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 29 01:41:37.397621 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:37.397426    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 29 01:41:38.401221 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:38.401182    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:38.401658 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:38.401640    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:38.402555 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:38.402535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:50.658083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:50.658047    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:50.658728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:50.658281    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" containerID="cri-o://cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6" gracePeriod=30
Jul 29 01:41:51.351381 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.351345    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:41:51.351764 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.351746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:41:51.351764 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.351765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:41:51.351906 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.351833    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:41:51.354624 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.354607    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.357163 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.357143    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4cab099e-openshift-default-dockercfg-jx8vc\""
Jul 29 01:41:51.366024 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.365995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:41:51.414663 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414663 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87b9\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.414925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.415226 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.414945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.515942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.515910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.515942 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.515945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.515973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.515997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87b9\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516448 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516581 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516762 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516849 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.516945 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.516929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.518408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.518384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.518815 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.518796    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.527152 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.527130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.527293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.527275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87b9\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9\") pod \"e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") " pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.665748 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.665653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:51.819375 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.819342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:41:51.822560 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:41:51.822534    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59850930_03b1_4067_b3ed_4415af6a037d.slice/crio-8c728374fd9a871cf4a9166b9e6a1d9a1f50d7415dfe05ffad42470456aa31aa WatchSource:0}: Error finding container 8c728374fd9a871cf4a9166b9e6a1d9a1f50d7415dfe05ffad42470456aa31aa: Status 404 returned error can't find the container with id 8c728374fd9a871cf4a9166b9e6a1d9a1f50d7415dfe05ffad42470456aa31aa
Jul 29 01:41:51.824885 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.824846    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:51.824979 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.824927    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:51.824979 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:51.824967    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:41:52.204893 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:52.204855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerStarted","Data":"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"}
Jul 29 01:41:52.205088 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:52.204909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerStarted","Data":"8c728374fd9a871cf4a9166b9e6a1d9a1f50d7415dfe05ffad42470456aa31aa"}
Jul 29 01:41:52.224656 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:52.224581    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podStartSLOduration=1.224560385 podStartE2EDuration="1.224560385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:41:52.223264008 +0000 UTC m=+1755.065011912" watchObservedRunningTime="2026-07-29 01:41:52.224560385 +0000 UTC m=+1755.066308289"
Jul 29 01:41:52.666859 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:52.666815    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:52.671745 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:52.671719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:53.030249 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:53.030204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:41:53.209576 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:53.209545    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:53.210513 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:53.210481    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:41:53.404255 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:53.404174    2564 patch_prober.go:28] interesting pod/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:41:53.404255 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:53.404242    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:41:55.912586 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.912555    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:55.957176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957090    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957227    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj6s6\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957251    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957346    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data\") pod \"575476c0-045a-4ece-a700-809e982b980a\" (UID: \"575476c0-045a-4ece-a700-809e982b980a\") "
Jul 29 01:41:55.957901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:41:55.957958 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.957923    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:55.958065 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.958015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:55.958152 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.958064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:55.958461 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.958435    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data" (OuterVolumeSpecName: "istio-data") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:55.959677 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.959603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:41:55.959677 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.959653    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:41:55.959677 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.959673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6" (OuterVolumeSpecName: "kube-api-access-qj6s6") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "kube-api-access-qj6s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:55.960039 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:55.960020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token" (OuterVolumeSpecName: "istio-token") pod "575476c0-045a-4ece-a700-809e982b980a" (UID: "575476c0-045a-4ece-a700-809e982b980a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:41:56.058070 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058026    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058070 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058060    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058070 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058069    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058070 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058078    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/575476c0-045a-4ece-a700-809e982b980a-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058086    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/575476c0-045a-4ece-a700-809e982b980a-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058094    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj6s6\" (UniqueName: \"kubernetes.io/projected/575476c0-045a-4ece-a700-809e982b980a-kube-api-access-qj6s6\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058103    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058111    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.058356 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.058119    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/575476c0-045a-4ece-a700-809e982b980a-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:41:56.224550 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.224493    2564 generic.go:356] "Generic (PLEG): container finished" podID="575476c0-045a-4ece-a700-809e982b980a" containerID="cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6" exitCode=0
Jul 29 01:41:56.224733 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.224563    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"
Jul 29 01:41:56.224733 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.224572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerDied","Data":"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"}
Jul 29 01:41:56.224733 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.224614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk" event={"ID":"575476c0-045a-4ece-a700-809e982b980a","Type":"ContainerDied","Data":"0ba450a6188bb7aae0bd9909e5590524b95c78f9a6c56986ef938a561b36e2e1"}
Jul 29 01:41:56.224733 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.224635    2564 scope.go:117] "RemoveContainer" containerID="cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"
Jul 29 01:41:56.237922 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.237899    2564 scope.go:117] "RemoveContainer" containerID="c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"
Jul 29 01:41:56.245710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.245690    2564 scope.go:117] "RemoveContainer" containerID="cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"
Jul 29 01:41:56.246011 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:41:56.245990    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6\": container with ID starting with cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6 not found: ID does not exist" containerID="cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"
Jul 29 01:41:56.246082 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.246025    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6"} err="failed to get container status \"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6\": rpc error: code = NotFound desc = could not find container \"cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6\": container with ID starting with cce503895018a60792726bf24de7a99dac31e6fb1d302b73af14cdce1ef148e6 not found: ID does not exist"
Jul 29 01:41:56.246082 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.246051    2564 scope.go:117] "RemoveContainer" containerID="c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"
Jul 29 01:41:56.246324 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:41:56.246304    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299\": container with ID starting with c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299 not found: ID does not exist" containerID="c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"
Jul 29 01:41:56.246367 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.246331    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299"} err="failed to get container status \"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299\": rpc error: code = NotFound desc = could not find container \"c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299\": container with ID starting with c64db9f30e2c886d3db9e1de463c64e5316abf7c33116dd3fe9ebdb449d06299 not found: ID does not exist"
Jul 29 01:41:56.249819 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.249795    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:56.253737 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:56.253710    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a3670250-openshift-default-c8f5cf7f6-fcqxk"]
Jul 29 01:41:57.804676 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:41:57.804641    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="575476c0-045a-4ece-a700-809e982b980a" path="/var/lib/kubelet/pods/575476c0-045a-4ece-a700-809e982b980a/volumes"
Jul 29 01:42:03.221376 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:03.221332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:42:08.211485 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.211450    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 29 01:42:08.211920 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.211541    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 29 01:42:08.280096 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.280061    2564 generic.go:356] "Generic (PLEG): container finished" podID="59850930-03b1-4067-b3ed-4415af6a037d" containerID="dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9" exitCode=0
Jul 29 01:42:08.280264 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.280129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerDied","Data":"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"}
Jul 29 01:42:08.280530 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.280496    2564 scope.go:117] "RemoveContainer" containerID="dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"
Jul 29 01:42:08.281542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.281493    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:42:08.281606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.281585    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:42:08.281637 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:08.281616    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:42:09.287684 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:09.287649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerStarted","Data":"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"}
Jul 29 01:42:09.666350 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:09.666261    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:09.666533 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:09.666483    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 29 01:42:09.666586 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:09.666566    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 29 01:42:10.666547 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:10.666484    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 29 01:42:10.666944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:10.666572    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 29 01:42:11.666588 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:11.666551    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 29 01:42:11.666979 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:11.666620    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 29 01:42:12.667229 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:12.667139    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 29 01:42:12.667229 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:12.667200    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 29 01:42:13.670331 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:13.670299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:13.670722 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:13.670694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:13.671446 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:13.671429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:24.765105 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:24.765070    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:42:24.765604 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:24.765261    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" containerID="cri-o://becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3" gracePeriod=30
Jul 29 01:42:28.025240 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:28.025200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:42:28.673340 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:28.673265    2564 patch_prober.go:28] interesting pod/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:42:28.673340 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:28.673320    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:42:30.024292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.024265    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:30.066594 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066510    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066594 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066594 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066632    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066669    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066795    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k87b9\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9\") pod \"59850930-03b1-4067-b3ed-4415af6a037d\" (UID: \"59850930-03b1-4067-b3ed-4415af6a037d\") "
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:30.066845 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:30.067244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.066985    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:30.067244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.067087    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.067244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.067125    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.067244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.067137    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.067478 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.067251    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:30.067671 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.067642    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data" (OuterVolumeSpecName: "istio-data") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:30.068951 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.068921    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token" (OuterVolumeSpecName: "istio-token") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:30.068951 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.068945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:42:30.069334 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.069310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9" (OuterVolumeSpecName: "kube-api-access-k87b9") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "kube-api-access-k87b9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:30.069413 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.069308    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59850930-03b1-4067-b3ed-4415af6a037d" (UID: "59850930-03b1-4067-b3ed-4415af6a037d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:42:30.167783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167744    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.167783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167773    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59850930-03b1-4067-b3ed-4415af6a037d-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.167783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167782    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59850930-03b1-4067-b3ed-4415af6a037d-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.167783 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167792    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.168125 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167807    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k87b9\" (UniqueName: \"kubernetes.io/projected/59850930-03b1-4067-b3ed-4415af6a037d-kube-api-access-k87b9\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.168125 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.167818    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59850930-03b1-4067-b3ed-4415af6a037d-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:42:30.397797 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.397706    2564 generic.go:356] "Generic (PLEG): container finished" podID="59850930-03b1-4067-b3ed-4415af6a037d" containerID="becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3" exitCode=0
Jul 29 01:42:30.397797 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.397753    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"
Jul 29 01:42:30.397966 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.397803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerDied","Data":"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"}
Jul 29 01:42:30.397966 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.397860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj" event={"ID":"59850930-03b1-4067-b3ed-4415af6a037d","Type":"ContainerDied","Data":"8c728374fd9a871cf4a9166b9e6a1d9a1f50d7415dfe05ffad42470456aa31aa"}
Jul 29 01:42:30.397966 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.397881    2564 scope.go:117] "RemoveContainer" containerID="becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"
Jul 29 01:42:30.408963 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.408943    2564 scope.go:117] "RemoveContainer" containerID="dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"
Jul 29 01:42:30.417598 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.417580    2564 scope.go:117] "RemoveContainer" containerID="becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"
Jul 29 01:42:30.417893 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:42:30.417868    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3\": container with ID starting with becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3 not found: ID does not exist" containerID="becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"
Jul 29 01:42:30.418004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.417899    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3"} err="failed to get container status \"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3\": rpc error: code = NotFound desc = could not find container \"becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3\": container with ID starting with becb5d697cacc7248f5c6266cfa162c7160b59e1f15cd83acfad544f4dc98fe3 not found: ID does not exist"
Jul 29 01:42:30.418004 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.417919    2564 scope.go:117] "RemoveContainer" containerID="dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"
Jul 29 01:42:30.418174 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:42:30.418155    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9\": container with ID starting with dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9 not found: ID does not exist" containerID="dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"
Jul 29 01:42:30.418218 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.418180    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9"} err="failed to get container status \"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9\": rpc error: code = NotFound desc = could not find container \"dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9\": container with ID starting with dcb345a3e7ea3b6fd0f9bcce323ac0c81938754c5c773dd5beff75dd959706e9 not found: ID does not exist"
Jul 29 01:42:30.421198 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.421173    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:42:30.425830 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:30.425808    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4cab099e-openshift-default-56fc9d86f6-p9mfj"]
Jul 29 01:42:31.805198 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:42:31.805157    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59850930-03b1-4067-b3ed-4415af6a037d" path="/var/lib/kubelet/pods/59850930-03b1-4067-b3ed-4415af6a037d/volumes"
Jul 29 01:43:50.031526 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:43:50.031467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:44:02.324328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:02.324243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:44:08.721243 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:08.721205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:44:12.951337 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951304    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951621    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951634    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951653    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951659    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951669    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951676    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951682    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.951717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951688    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.952071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951768    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb0750a-e09a-4e0f-bd46-319e8756cd46" containerName="istio-proxy"
Jul 29 01:44:12.952071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951777    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:44:12.952071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951783    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.952071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951788    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="59850930-03b1-4067-b3ed-4415af6a037d" containerName="istio-proxy"
Jul 29 01:44:12.952071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.951795    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:44:12.954539 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.954496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:12.957287 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.957267    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bc25d452-openshift-default-dockercfg-7ltvl\""
Jul 29 01:44:12.976009 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:12.975967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:44:13.119307 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119307 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht87t\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119706 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119706 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.119706 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.119651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220071 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht87t\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220891 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220891 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.220996 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.220972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.222555 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.222535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.222756 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.222738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.228727 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.228702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.228840 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.228825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht87t\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t\") pod \"e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") " pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.264268 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.264236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:13.408813 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.408781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:44:13.409471 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:44:13.409445    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff17b6a_133b_445f_967c_a81958a534c3.slice/crio-7dc6dc86d78c11bca42c7601a1242832479ed18d4948d9b9023415b98605ed97 WatchSource:0}: Error finding container 7dc6dc86d78c11bca42c7601a1242832479ed18d4948d9b9023415b98605ed97: Status 404 returned error can't find the container with id 7dc6dc86d78c11bca42c7601a1242832479ed18d4948d9b9023415b98605ed97
Jul 29 01:44:13.411796 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.411767    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:13.411866 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.411854    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:13.411903 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.411881    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:13.829838 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.829798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerStarted","Data":"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"}
Jul 29 01:44:13.830056 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.829859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerStarted","Data":"7dc6dc86d78c11bca42c7601a1242832479ed18d4948d9b9023415b98605ed97"}
Jul 29 01:44:13.852938 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:13.852881    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podStartSLOduration=1.8528645 podStartE2EDuration="1.8528645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:13.851041033 +0000 UTC m=+1896.692788937" watchObservedRunningTime="2026-07-29 01:44:13.8528645 +0000 UTC m=+1896.694612402"
Jul 29 01:44:14.264998 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:14.264958    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:14.269644 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:14.269621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:14.834567 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:14.834534    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:14.835439 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:14.835417    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:17.622542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:17.622492    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:44:25.882449 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.882413    2564 generic.go:356] "Generic (PLEG): container finished" podID="cff17b6a-133b-445f-967c-a81958a534c3" containerID="dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03" exitCode=0
Jul 29 01:44:25.882893 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.882488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerDied","Data":"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"}
Jul 29 01:44:25.882976 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.882943    2564 scope.go:117] "RemoveContainer" containerID="dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"
Jul 29 01:44:25.883996 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.883966    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:25.884049 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.884036    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:25.884092 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:25.884069    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:44:26.889143 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:26.889108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerStarted","Data":"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"}
Jul 29 01:44:27.264571 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:27.264533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:27.265735 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:27.265708    2564 patch_prober.go:28] interesting pod/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 29 01:44:27.265864 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:27.265755    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 29 01:44:28.265335 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:28.265297    2564 patch_prober.go:28] interesting pod/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 29 01:44:28.265740 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:28.265368    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 29 01:44:29.265104 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:29.265065    2564 patch_prober.go:28] interesting pod/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 29 01:44:29.265280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:29.265138    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 29 01:44:29.835484 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:29.835441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:30.265127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:30.265091    2564 patch_prober.go:28] interesting pod/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 29 01:44:30.265305 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:30.265165    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 29 01:44:31.268562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:31.268532    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:31.269712 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:31.269687    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:44:59.519888 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:44:59.519850    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:45:05.294162 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:05.294128    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:45:05.294656 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:05.294355    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy" containerID="cri-o://2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e" gracePeriod=30
Jul 29 01:45:10.537155 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.537127    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:45:10.625176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625086    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625132    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625176 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625166    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625192    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625227    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625264    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625346    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht87t\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t\") pod \"cff17b6a-133b-445f-967c-a81958a534c3\" (UID: \"cff17b6a-133b-445f-967c-a81958a534c3\") "
Jul 29 01:45:10.625749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:45:10.625749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:45:10.625749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625613    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.625749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625632    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.625749 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.625663    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:45:10.626295 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.626248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:45:10.626420 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.626394    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:45:10.627808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.627782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:45:10.627808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.627796    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:45:10.627938 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.627826    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t" (OuterVolumeSpecName: "kube-api-access-ht87t") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "kube-api-access-ht87t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:45:10.627938 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.627830    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cff17b6a-133b-445f-967c-a81958a534c3" (UID: "cff17b6a-133b-445f-967c-a81958a534c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:45:10.726083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726041    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726073    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726083    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht87t\" (UniqueName: \"kubernetes.io/projected/cff17b6a-133b-445f-967c-a81958a534c3-kube-api-access-ht87t\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726095    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726344 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726127    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cff17b6a-133b-445f-967c-a81958a534c3-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726344 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726136    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cff17b6a-133b-445f-967c-a81958a534c3-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:10.726344 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:10.726144    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cff17b6a-133b-445f-967c-a81958a534c3-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:45:11.093660 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.093622    2564 generic.go:356] "Generic (PLEG): container finished" podID="cff17b6a-133b-445f-967c-a81958a534c3" containerID="2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e" exitCode=0
Jul 29 01:45:11.093829 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.093673    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"
Jul 29 01:45:11.093829 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.093675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerDied","Data":"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"}
Jul 29 01:45:11.093829 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.093729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc" event={"ID":"cff17b6a-133b-445f-967c-a81958a534c3","Type":"ContainerDied","Data":"7dc6dc86d78c11bca42c7601a1242832479ed18d4948d9b9023415b98605ed97"}
Jul 29 01:45:11.093829 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.093760    2564 scope.go:117] "RemoveContainer" containerID="2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"
Jul 29 01:45:11.103107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.103090    2564 scope.go:117] "RemoveContainer" containerID="dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"
Jul 29 01:45:11.110479 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.110461    2564 scope.go:117] "RemoveContainer" containerID="2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"
Jul 29 01:45:11.110790 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:45:11.110769    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e\": container with ID starting with 2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e not found: ID does not exist" containerID="2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"
Jul 29 01:45:11.110863 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.110803    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e"} err="failed to get container status \"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e\": rpc error: code = NotFound desc = could not find container \"2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e\": container with ID starting with 2e968e905da0b4097de61c95fa439cd63a65cf83590f8dce5dc90f1bbf8eb68e not found: ID does not exist"
Jul 29 01:45:11.110863 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.110829    2564 scope.go:117] "RemoveContainer" containerID="dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"
Jul 29 01:45:11.111055 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:45:11.111036    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03\": container with ID starting with dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03 not found: ID does not exist" containerID="dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"
Jul 29 01:45:11.111103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.111061    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03"} err="failed to get container status \"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03\": rpc error: code = NotFound desc = could not find container \"dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03\": container with ID starting with dc20318874ea068f8808667f24885fcafbc32e53383b81931d0674c51621ba03 not found: ID does not exist"
Jul 29 01:45:11.128683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.128649    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:45:11.132519 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.132480    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bc25d452-openshift-default-6cfc8df98d-dhjwc"]
Jul 29 01:45:11.805488 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:11.805455    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff17b6a-133b-445f-967c-a81958a534c3" path="/var/lib/kubelet/pods/cff17b6a-133b-445f-967c-a81958a534c3/volumes"
Jul 29 01:45:41.819419 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819387    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819722    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819733    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="575476c0-045a-4ece-a700-809e982b980a" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819745    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819752    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819762    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819769    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:45:41.819926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.819827    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:45:41.822836 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.822812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.825688 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.825666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e744ec49-openshift-default-dockercfg-z99lm\""
Jul 29 01:45:41.835023 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.835000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:45:41.880736 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqbb\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.880940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.881295 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.880965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.981953 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.981918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.981973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqbb\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.982532 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.983040 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.983040 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.982569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.983224 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.983200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.983532 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.983495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.983614 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.983545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.990925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.985963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.990925 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.986105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.992100 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.992068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqbb\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:41.994293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:41.994267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token\") pod \"e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") " pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:42.133649 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:42.133560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:42.272791 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:42.272759    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:45:42.275163 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:45:42.275138    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b856480_5320_4ed1_9ddf_3e0fa2a53acd.slice/crio-06dfa4bc9a173db58deba99f2b0dd9515b258ad1637bbf21d4c0931ee394a233 WatchSource:0}: Error finding container 06dfa4bc9a173db58deba99f2b0dd9515b258ad1637bbf21d4c0931ee394a233: Status 404 returned error can't find the container with id 06dfa4bc9a173db58deba99f2b0dd9515b258ad1637bbf21d4c0931ee394a233
Jul 29 01:45:42.277171 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:42.277144    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:45:42.277243 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:42.277208    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:45:42.277243 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:42.277236    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:45:43.230661 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:43.230624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerStarted","Data":"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"}
Jul 29 01:45:43.231154 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:43.230679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerStarted","Data":"06dfa4bc9a173db58deba99f2b0dd9515b258ad1637bbf21d4c0931ee394a233"}
Jul 29 01:45:43.256675 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:43.256606    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podStartSLOduration=2.256586567 podStartE2EDuration="2.256586567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:43.256204581 +0000 UTC m=+1986.097952484" watchObservedRunningTime="2026-07-29 01:45:43.256586567 +0000 UTC m=+1986.098334470"
Jul 29 01:45:44.134603 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:44.134561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:44.139665 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:44.139639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:44.235043 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:44.235014    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:44.235918 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:44.235897    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:45:51.917947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:51.917910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:45:59.588598 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:59.588078    2564 patch_prober.go:28] interesting pod/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:47170->10.134.0.30:15021: read: connection reset by peer" start-of-body=
Jul 29 01:45:59.588598 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:45:59.588163    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:47170->10.134.0.30:15021: read: connection reset by peer"
Jul 29 01:46:00.306139 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.306107    2564 generic.go:356] "Generic (PLEG): container finished" podID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerID="ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14" exitCode=0
Jul 29 01:46:00.306324 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.306176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerDied","Data":"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"}
Jul 29 01:46:00.306621 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.306607    2564 scope.go:117] "RemoveContainer" containerID="ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"
Jul 29 01:46:00.307657 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.307627    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:46:00.307717 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.307697    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:46:00.307752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:00.307744    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:46:01.315635 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:01.315573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerStarted","Data":"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"}
Jul 29 01:46:02.134593 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:02.134539    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:46:02.134811 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:02.134793    2564 patch_prober.go:28] interesting pod/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 29 01:46:02.134856 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:02.134836    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 29 01:46:03.134339 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:03.134301    2564 patch_prober.go:28] interesting pod/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 29 01:46:03.134769 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:03.134356    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 29 01:46:04.134590 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:04.134549    2564 patch_prober.go:28] interesting pod/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 29 01:46:04.135066 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:04.134608    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 29 01:46:05.134701 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:05.134665    2564 patch_prober.go:28] interesting pod/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 29 01:46:05.135087 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:05.134737    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 29 01:46:06.137307 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:06.137273    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:46:06.137797 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:06.137689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:46:06.138425 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:06.138407    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:46:25.337682 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:25.337644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:46:39.927867 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:39.927803    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:46:58.522203 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:46:58.518181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:47:07.024321 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:07.024276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:47:51.569898 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:51.569860    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:47:51.570444 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:51.570087    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy" containerID="cri-o://1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e" gracePeriod=30
Jul 29 01:47:55.431671 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:55.431632    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:47:56.815853 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.815824    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:47:56.816374 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.816353    2564 generic.go:356] "Generic (PLEG): container finished" podID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerID="1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e" exitCode=0
Jul 29 01:47:56.816442 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.816423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerDied","Data":"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"}
Jul 29 01:47:56.816491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.816479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6" event={"ID":"1b856480-5320-4ed1-9ddf-3e0fa2a53acd","Type":"ContainerDied","Data":"06dfa4bc9a173db58deba99f2b0dd9515b258ad1637bbf21d4c0931ee394a233"}
Jul 29 01:47:56.816558 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.816525    2564 scope.go:117] "RemoveContainer" containerID="1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"
Jul 29 01:47:56.824384 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.824366    2564 scope.go:117] "RemoveContainer" containerID="ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"
Jul 29 01:47:56.831928 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.831884    2564 scope.go:117] "RemoveContainer" containerID="1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"
Jul 29 01:47:56.832187 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:47:56.832169    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e\": container with ID starting with 1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e not found: ID does not exist" containerID="1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"
Jul 29 01:47:56.832246 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.832194    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e"} err="failed to get container status \"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e\": rpc error: code = NotFound desc = could not find container \"1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e\": container with ID starting with 1ffa015bc0f2852231723228e207caa97df42093d1dd0c993ac2bcaf1dd3e28e not found: ID does not exist"
Jul 29 01:47:56.832246 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.832218    2564 scope.go:117] "RemoveContainer" containerID="ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"
Jul 29 01:47:56.832456 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:47:56.832436    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14\": container with ID starting with ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14 not found: ID does not exist" containerID="ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"
Jul 29 01:47:56.832535 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.832460    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14"} err="failed to get container status \"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14\": rpc error: code = NotFound desc = could not find container \"ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14\": container with ID starting with ca81d8e953237d039166c71bac13932005dc9d02a5bb16197c062520122ddd14 not found: ID does not exist"
Jul 29 01:47:56.962105 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962148    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962168    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962184    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962203    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962232    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbqbb\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962312 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962303    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962339    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data\") pod \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\" (UID: \"1b856480-5320-4ed1-9ddf-3e0fa2a53acd\") "
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962489    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962588    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962660    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:56.962694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962679    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:56.962985 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.962709    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:56.963403 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.963380    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:56.964376 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.964348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:56.964642 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.964624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:47:56.964947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.964925    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:47:56.964989 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:56.964971    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb" (OuterVolumeSpecName: "kube-api-access-qbqbb") pod "1b856480-5320-4ed1-9ddf-3e0fa2a53acd" (UID: "1b856480-5320-4ed1-9ddf-3e0fa2a53acd"). InnerVolumeSpecName "kube-api-access-qbqbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:57.064067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064027    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064058    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064068    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064076    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064086    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064095    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbqbb\" (UniqueName: \"kubernetes.io/projected/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-kube-api-access-qbqbb\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.064328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.064103    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b856480-5320-4ed1-9ddf-3e0fa2a53acd-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:47:57.821433 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.821411    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"
Jul 29 01:47:57.839994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.839959    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:47:57.847752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:57.847724    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e744ec49-openshift-default-6dd66747c6-6s7c6"]
Jul 29 01:47:59.805341 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:47:59.805303    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" path="/var/lib/kubelet/pods/1b856480-5320-4ed1-9ddf-3e0fa2a53acd/volumes"
Jul 29 01:48:07.627648 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:07.627611    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:48:47.186244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186204    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186525    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186537    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186556    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186561    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186610    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff17b6a-133b-445f-967c-a81958a534c3" containerName="istio-proxy"
Jul 29 01:48:47.186683 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.186618    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:48:47.189328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.189311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.192716 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.192693    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-70bd38-openshift-default-dockercfg-f79gf\""
Jul 29 01:48:47.208251 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.208224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:48:47.286283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286283 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5sm\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.286710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.286681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387180 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387368 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387629 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387629 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5sm\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387629 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387629 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387867 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387867 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.387974 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.387928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.388047 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.388022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.388145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.388125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.389621 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.389594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.389715 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.389658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.396118 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.396096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.396431 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.396411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5sm\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm\") pod \"e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") " pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.498666 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.498625    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:47.633930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.633894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:48:47.638304 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:48:47.638274    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b91d7e_61f0_49a9_9869_1819e67aa6f2.slice/crio-aa544fef4623bc39efa3996f9097af8a195b0585258abc623aface32f41456ac WatchSource:0}: Error finding container aa544fef4623bc39efa3996f9097af8a195b0585258abc623aface32f41456ac: Status 404 returned error can't find the container with id aa544fef4623bc39efa3996f9097af8a195b0585258abc623aface32f41456ac
Jul 29 01:48:47.640342 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.640314    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:48:47.640408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.640378    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:48:47.640445 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:47.640406    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:48:48.037134 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:48.037091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerStarted","Data":"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"}
Jul 29 01:48:48.037343 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:48.037190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerStarted","Data":"aa544fef4623bc39efa3996f9097af8a195b0585258abc623aface32f41456ac"}
Jul 29 01:48:48.058268 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:48.058202    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podStartSLOduration=1.058184334 podStartE2EDuration="1.058184334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:48.057616759 +0000 UTC m=+2170.899364663" watchObservedRunningTime="2026-07-29 01:48:48.058184334 +0000 UTC m=+2170.899932237"
Jul 29 01:48:48.499456 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:48.499409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:48.504688 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:48.504656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:49.041533 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:49.041490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:49.042405 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:49.042383    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:48:56.427225 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:48:56.427195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:49:04.043736 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.043638    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:04.043736 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.043703    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:04.110545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.110450    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerID="8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59" exitCode=0
Jul 29 01:49:04.110545 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.110493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerDied","Data":"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"}
Jul 29 01:49:04.110927 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.110910    2564 scope.go:117] "RemoveContainer" containerID="8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"
Jul 29 01:49:04.111897 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.111868    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:04.111962 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.111946    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:04.112017 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:04.111981    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:05.117101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:05.117067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerStarted","Data":"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"}
Jul 29 01:49:05.499692 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:05.499655    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:49:05.499928 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:05.499907    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:05.499978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:05.499951    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:06.499328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:06.499295    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:06.499795 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:06.499348    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:07.499673 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:07.499636    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:07.500262 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:07.500231    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:08.498976 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:08.498936    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:08.499190 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:08.498997    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:09.500088 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:09.500046    2564 patch_prober.go:28] interesting pod/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:49:09.500728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:09.500689    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:49:10.503491 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:10.503459    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:49:10.503969 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:10.503810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:49:10.504590 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:10.504568    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:49:15.560719 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.560673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:49:15.561211 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.561133    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b856480-5320-4ed1-9ddf-3e0fa2a53acd" containerName="istio-proxy"
Jul 29 01:49:15.563691 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.563673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.566456 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.566438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-eb1fe1-openshift-default-dockercfg-k7ttj\""
Jul 29 01:49:15.576854 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.576829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:49:15.643220 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmq6\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.643704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.643567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744313 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744313 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744596 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744596 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744596 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmq6\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744596 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744834 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744834 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744834 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744834 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744982 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744982 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.744982 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.744973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.745407 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.745383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.746686 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.746665    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.746978 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.746961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.757232 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.757205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.758497 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.758471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmq6\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6\") pod \"e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") " pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:15.874542 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:15.874429    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:16.011091 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.010938    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:49:16.014759 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:49:16.014636    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e43df4_f768_48cc_8142_97eb62f96b9a.slice/crio-c104cba3933247c85b83a272e608536522dcdc5df6af6828121d5eb07091d445 WatchSource:0}: Error finding container c104cba3933247c85b83a272e608536522dcdc5df6af6828121d5eb07091d445: Status 404 returned error can't find the container with id c104cba3933247c85b83a272e608536522dcdc5df6af6828121d5eb07091d445
Jul 29 01:49:16.016975 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.016942    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:16.017067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.017014    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:16.017067 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.017045    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:16.173485 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.173384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerStarted","Data":"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"}
Jul 29 01:49:16.173485 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.173449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerStarted","Data":"c104cba3933247c85b83a272e608536522dcdc5df6af6828121d5eb07091d445"}
Jul 29 01:49:16.195463 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.195401    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podStartSLOduration=1.195377476 podStartE2EDuration="1.195377476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:49:16.193579592 +0000 UTC m=+2199.035327496" watchObservedRunningTime="2026-07-29 01:49:16.195377476 +0000 UTC m=+2199.037125381"
Jul 29 01:49:16.875422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:16.875385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:17.880049 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:17.880019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:18.188095 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:18.188004    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:18.189154 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:18.189132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:25.419615 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:25.419579    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:49:33.708955 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:33.708923    2564 patch_prober.go:28] interesting pod/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:58384->10.134.0.32:15021: read: connection reset by peer" start-of-body=
Jul 29 01:49:33.709393 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:33.708990    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:58384->10.134.0.32:15021: read: connection reset by peer"
Jul 29 01:49:34.259478 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.259445    2564 generic.go:356] "Generic (PLEG): container finished" podID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerID="3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933" exitCode=0
Jul 29 01:49:34.259712 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.259497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerDied","Data":"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"}
Jul 29 01:49:34.259887 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.259873    2564 scope.go:117] "RemoveContainer" containerID="3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"
Jul 29 01:49:34.260851 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.260821    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:34.260905 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.260889    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:34.260943 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:34.260926    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:49:35.265805 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:35.265771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerStarted","Data":"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"}
Jul 29 01:49:35.874944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:35.874909    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:35.875145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:35.875077    2564 patch_prober.go:28] interesting pod/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 01:49:35.875145 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:35.875131    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 01:49:36.875828 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:36.875789    2564 patch_prober.go:28] interesting pod/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 01:49:36.876311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:36.875854    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 01:49:37.875704 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:37.875664    2564 patch_prober.go:28] interesting pod/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 01:49:37.875908 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:37.875732    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 01:49:38.874887 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:38.874846    2564 patch_prober.go:28] interesting pod/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 29 01:49:38.875101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:38.874914    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 29 01:49:39.878986 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:39.878953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:39.879472 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:39.879331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:39.880082 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:39.880058    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:49:48.024081 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.024038    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:49:48.033693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.033669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.036753 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.036725    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:49:48.037810 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.037783    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-70bd38\"/\"openshift-service-ca.crt\""
Jul 29 01:49:48.037935 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.037783    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-70bd38\"/\"test-model-70bd38-kserve-self-signed-certs\""
Jul 29 01:49:48.038002 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.037929    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-70bd38\"/\"kube-root-ca.crt\""
Jul 29 01:49:48.038150 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.038129    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-70bd38\"/\"default-dockercfg-j4mmg\""
Jul 29 01:49:48.130084 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.130084 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.130311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmc62\" (UniqueName: \"kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.130311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130152    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.130311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.130311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.130292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.230965 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.230928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.230998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231127 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmc62\" (UniqueName: \"kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231275 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231379 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231428 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.231428 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.231417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.233591 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.233561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.233708 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.233609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.238928 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.238907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmc62\" (UniqueName: \"kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62\") pod \"test-model-70bd38-kserve-6f9bd8d75c-6lw4t\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") " pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.344718 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.344636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:48.475816 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:48.475785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:49:48.479623 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:49:48.479596    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95df1b07_c73d_493b_8273_3809b05d5c52.slice/crio-3f72bcd50e481ff224d989c44e57d9c060e82527fe35928f96f3baa50d4463a1 WatchSource:0}: Error finding container 3f72bcd50e481ff224d989c44e57d9c060e82527fe35928f96f3baa50d4463a1: Status 404 returned error can't find the container with id 3f72bcd50e481ff224d989c44e57d9c060e82527fe35928f96f3baa50d4463a1
Jul 29 01:49:49.336836 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:49.336804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" event={"ID":"95df1b07-c73d-493b-8273-3809b05d5c52","Type":"ContainerStarted","Data":"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"}
Jul 29 01:49:49.336836 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:49.336841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" event={"ID":"95df1b07-c73d-493b-8273-3809b05d5c52","Type":"ContainerStarted","Data":"3f72bcd50e481ff224d989c44e57d9c060e82527fe35928f96f3baa50d4463a1"}
Jul 29 01:49:49.354598 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:49.354555    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" podStartSLOduration=1.354542342 podStartE2EDuration="1.354542342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:49:49.353821767 +0000 UTC m=+2232.195569671" watchObservedRunningTime="2026-07-29 01:49:49.354542342 +0000 UTC m=+2232.196290246"
Jul 29 01:49:52.224551 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:52.224511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:49:58.345349 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:58.345311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:58.345349 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:58.345361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:58.357877 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:58.357851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:49:58.385157 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:49:58.385126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:50:37.724578 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:50:37.724544    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:50:51.920523 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:50:51.920475    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:51:13.001561 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:13.001529    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:51:18.150716 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:18.150682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:51:28.020989 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.020924    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" podUID="95df1b07-c73d-493b-8273-3809b05d5c52" containerName="main" containerID="cri-o://9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a" gracePeriod=45
Jul 29 01:51:28.273853 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.273786    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:51:28.345765 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.345765 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345768    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.346026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345805    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.346026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345879    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.346026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmc62\" (UniqueName: \"kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.346026 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.345970    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs\") pod \"95df1b07-c73d-493b-8273-3809b05d5c52\" (UID: \"95df1b07-c73d-493b-8273-3809b05d5c52\") "
Jul 29 01:51:28.346207 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346081    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache" (OuterVolumeSpecName: "model-cache") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:28.346207 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346079    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:28.346207 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346098    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home" (OuterVolumeSpecName: "home") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:28.346326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346277    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.346326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346291    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.346326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.346303    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.348120 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.348096    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm" (OuterVolumeSpecName: "dshm") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:28.348205 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.348181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62" (OuterVolumeSpecName: "kube-api-access-lmc62") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "kube-api-access-lmc62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:28.348243 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.348223    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95df1b07-c73d-493b-8273-3809b05d5c52" (UID: "95df1b07-c73d-493b-8273-3809b05d5c52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:51:28.447743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.447704    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95df1b07-c73d-493b-8273-3809b05d5c52-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.447743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.447734    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmc62\" (UniqueName: \"kubernetes.io/projected/95df1b07-c73d-493b-8273-3809b05d5c52-kube-api-access-lmc62\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.447743 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.447745    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95df1b07-c73d-493b-8273-3809b05d5c52-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:28.780055 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.780024    2564 generic.go:356] "Generic (PLEG): container finished" podID="95df1b07-c73d-493b-8273-3809b05d5c52" containerID="9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a" exitCode=0
Jul 29 01:51:28.780055 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.780061    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"
Jul 29 01:51:28.780319 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.780108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" event={"ID":"95df1b07-c73d-493b-8273-3809b05d5c52","Type":"ContainerDied","Data":"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"}
Jul 29 01:51:28.780319 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.780150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t" event={"ID":"95df1b07-c73d-493b-8273-3809b05d5c52","Type":"ContainerDied","Data":"3f72bcd50e481ff224d989c44e57d9c060e82527fe35928f96f3baa50d4463a1"}
Jul 29 01:51:28.780319 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.780172    2564 scope.go:117] "RemoveContainer" containerID="9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"
Jul 29 01:51:28.789050 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.789029    2564 scope.go:117] "RemoveContainer" containerID="9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"
Jul 29 01:51:28.789338 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:51:28.789318    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a\": container with ID starting with 9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a not found: ID does not exist" containerID="9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"
Jul 29 01:51:28.789407 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.789348    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a"} err="failed to get container status \"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a\": rpc error: code = NotFound desc = could not find container \"9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a\": container with ID starting with 9384f8b9032dbd58a59dac179d2c2b8754f6179a9f3671cc9c93660ac893de6a not found: ID does not exist"
Jul 29 01:51:28.803387 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.803359    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:51:28.806905 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:28.806877    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-70bd38/test-model-70bd38-kserve-6f9bd8d75c-6lw4t"]
Jul 29 01:51:29.805280 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:29.805244    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95df1b07-c73d-493b-8273-3809b05d5c52" path="/var/lib/kubelet/pods/95df1b07-c73d-493b-8273-3809b05d5c52/volumes"
Jul 29 01:51:31.424269 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:31.424227    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:51:31.425034 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:31.425006    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy" containerID="cri-o://02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27" gracePeriod=30
Jul 29 01:51:34.128292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:34.128249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:51:36.672851 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.672827    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:51:36.818943 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.818910    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerID="02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27" exitCode=0
Jul 29 01:51:36.819121 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.818961    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"
Jul 29 01:51:36.819121 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.818966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerDied","Data":"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"}
Jul 29 01:51:36.819121 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4" event={"ID":"e5b91d7e-61f0-49a9-9869-1819e67aa6f2","Type":"ContainerDied","Data":"aa544fef4623bc39efa3996f9097af8a195b0585258abc623aface32f41456ac"}
Jul 29 01:51:36.819121 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819034    2564 scope.go:117] "RemoveContainer" containerID="02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"
Jul 29 01:51:36.819604 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819665    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819752 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819731    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819927 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819768    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g5sm\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819927 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819927 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819858    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.819927 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819898    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.820219 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.819953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data\") pod \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\" (UID: \"e5b91d7e-61f0-49a9-9869-1819e67aa6f2\") "
Jul 29 01:51:36.820351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820215    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:36.820351 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:36.820472 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820456    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.820541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820474    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.820541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820524    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:36.820658 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820577    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:36.821006 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.820981    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:36.822181 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.822155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:36.822397 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.822364    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:51:36.822665 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.822644    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm" (OuterVolumeSpecName: "kube-api-access-7g5sm") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "kube-api-access-7g5sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:36.822828 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.822808    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5b91d7e-61f0-49a9-9869-1819e67aa6f2" (UID: "e5b91d7e-61f0-49a9-9869-1819e67aa6f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:36.838089 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.838070    2564 scope.go:117] "RemoveContainer" containerID="8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"
Jul 29 01:51:36.845607 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.845588    2564 scope.go:117] "RemoveContainer" containerID="02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"
Jul 29 01:51:36.845880 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:51:36.845857    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27\": container with ID starting with 02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27 not found: ID does not exist" containerID="02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"
Jul 29 01:51:36.845932 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.845890    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27"} err="failed to get container status \"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27\": rpc error: code = NotFound desc = could not find container \"02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27\": container with ID starting with 02295640206d2cecbe8c351003f176bcfb012e93849c8b9b91bb0b139d849f27 not found: ID does not exist"
Jul 29 01:51:36.845932 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.845910    2564 scope.go:117] "RemoveContainer" containerID="8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"
Jul 29 01:51:36.846118 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:51:36.846097    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59\": container with ID starting with 8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59 not found: ID does not exist" containerID="8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"
Jul 29 01:51:36.846172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.846127    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59"} err="failed to get container status \"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59\": rpc error: code = NotFound desc = could not find container \"8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59\": container with ID starting with 8180d9050370e30654f0b219d53ecb270a8b6e256a01e87c5295244606c5bb59 not found: ID does not exist"
Jul 29 01:51:36.921678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921642    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921678 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921678    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921693    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921706    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921720    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921733    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g5sm\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-kube-api-access-7g5sm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:36.921878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:36.921745    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5b91d7e-61f0-49a9-9869-1819e67aa6f2-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:37.141693 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:37.141658    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:51:37.145750 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:37.145721    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-70bd38-openshift-default-67547cc8b-wbxc4"]
Jul 29 01:51:37.809837 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:37.809799    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" path="/var/lib/kubelet/pods/e5b91d7e-61f0-49a9-9869-1819e67aa6f2/volumes"
Jul 29 01:51:40.426876 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:40.426840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:51:44.058222 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.058183    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:51:44.058709 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.058406    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy" containerID="cri-o://33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927" gracePeriod=30
Jul 29 01:51:44.905735 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.905696    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:51:44.906245 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906217    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:51:44.906438 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906419    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:51:44.906573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906454    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95df1b07-c73d-493b-8273-3809b05d5c52" containerName="main"
Jul 29 01:51:44.906573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906463    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95df1b07-c73d-493b-8273-3809b05d5c52" containerName="main"
Jul 29 01:51:44.906573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906476    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:51:44.906573 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906485    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:51:44.906708 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906589    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:51:44.906708 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.906603    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95df1b07-c73d-493b-8273-3809b05d5c52" containerName="main"
Jul 29 01:51:44.909562 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.909542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.912338 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.912317    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6127b1-openshift-default-dockercfg-qkc25\""
Jul 29 01:51:44.922244 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.922205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:51:44.991838 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.991748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992042 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.991849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992042 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.991941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992189 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992189 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992306 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992306 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw9bd\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:44.992417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:44.992374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093238 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw9bd\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.093724 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.094155 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.094155 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.094155 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.093964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.094155 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.094058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.094383 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.094162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.095451 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.095432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.095862 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.095845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.102346 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.102321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.102559 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.102532    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw9bd\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd\") pod \"e2e-api-a-6127b1-openshift-default-686d89454-b8wsz\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") " pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.220223 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.220181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:45.362053 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.362017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:51:45.365898 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:51:45.365858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642c3f6f_3a50_4454_951c_cf5d4b894932.slice/crio-696efcf94e6d72610e78c0b212fb4d2e0d00bdc1e7ed877b7f33f55bfca7ddad WatchSource:0}: Error finding container 696efcf94e6d72610e78c0b212fb4d2e0d00bdc1e7ed877b7f33f55bfca7ddad: Status 404 returned error can't find the container with id 696efcf94e6d72610e78c0b212fb4d2e0d00bdc1e7ed877b7f33f55bfca7ddad
Jul 29 01:51:45.368093 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.368064    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:51:45.368187 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.368144    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:51:45.368223 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.368187    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:51:45.861904 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.861864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerStarted","Data":"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"}
Jul 29 01:51:45.862133 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.861940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerStarted","Data":"696efcf94e6d72610e78c0b212fb4d2e0d00bdc1e7ed877b7f33f55bfca7ddad"}
Jul 29 01:51:45.883673 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:45.883614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podStartSLOduration=1.883596716 podStartE2EDuration="1.883596716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:45.882827768 +0000 UTC m=+2348.724575688" watchObservedRunningTime="2026-07-29 01:51:45.883596716 +0000 UTC m=+2348.725344619"
Jul 29 01:51:46.220638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:46.220599    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:46.225618 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:46.225596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:46.866381 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:46.866345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:46.867248 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:46.867227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:51:49.319536 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.319444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:51:49.429293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429261    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429293 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429300    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429338    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hmq6\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket\") pod \"97e43df4-f768-48cc-8142-97eb62f96b9a\" (UID: \"97e43df4-f768-48cc-8142-97eb62f96b9a\") "
Jul 29 01:51:49.429606 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:49.430032 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.429845    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.430089 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.430055    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:49.430143 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.430103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:51:49.430193 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.430171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:49.430276 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.430253    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:49.431901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.431877    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:51:49.431901 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.431885    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:49.432107 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.432086    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6" (OuterVolumeSpecName: "kube-api-access-4hmq6") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "kube-api-access-4hmq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:51:49.432156 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.432140    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97e43df4-f768-48cc-8142-97eb62f96b9a" (UID: "97e43df4-f768-48cc-8142-97eb62f96b9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:51:49.530926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530890    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97e43df4-f768-48cc-8142-97eb62f96b9a-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.530926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530920    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hmq6\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-kube-api-access-4hmq6\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.530926 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530930    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.531165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530940    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.531165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530948    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.531165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530955    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.531165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530963    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.531165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.530973    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97e43df4-f768-48cc-8142-97eb62f96b9a-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:51:49.883321 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.883287    2564 generic.go:356] "Generic (PLEG): container finished" podID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerID="33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927" exitCode=0
Jul 29 01:51:49.883523 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.883338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"
Jul 29 01:51:49.883523 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.883354    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerDied","Data":"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"}
Jul 29 01:51:49.883523 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.883404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8" event={"ID":"97e43df4-f768-48cc-8142-97eb62f96b9a","Type":"ContainerDied","Data":"c104cba3933247c85b83a272e608536522dcdc5df6af6828121d5eb07091d445"}
Jul 29 01:51:49.883523 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.883429    2564 scope.go:117] "RemoveContainer" containerID="33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"
Jul 29 01:51:49.891753 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.891716    2564 scope.go:117] "RemoveContainer" containerID="3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"
Jul 29 01:51:49.899483 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.899465    2564 scope.go:117] "RemoveContainer" containerID="33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"
Jul 29 01:51:49.899774 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:51:49.899754    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927\": container with ID starting with 33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927 not found: ID does not exist" containerID="33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"
Jul 29 01:51:49.899847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.899784    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927"} err="failed to get container status \"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927\": rpc error: code = NotFound desc = could not find container \"33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927\": container with ID starting with 33827e13e69a9e05bc0d7f9e500fb64ca82269ea9cd61c8bc4c7defe22ee2927 not found: ID does not exist"
Jul 29 01:51:49.899847 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.899802    2564 scope.go:117] "RemoveContainer" containerID="3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"
Jul 29 01:51:49.900189 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:51:49.900160    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933\": container with ID starting with 3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933 not found: ID does not exist" containerID="3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"
Jul 29 01:51:49.900286 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.900198    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933"} err="failed to get container status \"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933\": rpc error: code = NotFound desc = could not find container \"3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933\": container with ID starting with 3caef5f6aff62b91b292d9f46c47cee88e916468bb0994f2471e0f124af5b933 not found: ID does not exist"
Jul 29 01:51:49.902485 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.902463    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:51:49.906833 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:49.906813    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-eb1fe1-openshift-default-57555c68f6-bf6d8"]
Jul 29 01:51:51.806474 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:51.806427    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" path="/var/lib/kubelet/pods/97e43df4-f768-48cc-8142-97eb62f96b9a/volumes"
Jul 29 01:51:54.822930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:51:54.822894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:52:02.707046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.706890    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:33664->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Jul 29 01:52:02.707046 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.706980    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:33664->10.134.0.34:15021: read: connection reset by peer"
Jul 29 01:52:02.952349 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.952262    2564 generic.go:356] "Generic (PLEG): container finished" podID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerID="1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa" exitCode=0
Jul 29 01:52:02.952349 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.952335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerDied","Data":"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"}
Jul 29 01:52:02.952741 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.952728    2564 scope.go:117] "RemoveContainer" containerID="1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"
Jul 29 01:52:02.953725 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.953699    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:02.953800 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.953786    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:02.953839 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:02.953820    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:03.958559 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:03.958524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerStarted","Data":"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"}
Jul 29 01:52:04.220958 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:04.220913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:52:04.221180 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:04.221078    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:52:04.221180 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:04.221125    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 01:52:05.221083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:05.221035    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:52:05.221612 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:05.221105    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 01:52:06.221425 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:06.221379    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:52:06.221981 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:06.221456    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 01:52:07.221414 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:07.221363    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 29 01:52:07.221653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:07.221452    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 29 01:52:08.224668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:08.224641    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:52:08.225119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:08.224988    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:52:08.225794 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:08.225771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:52:13.462921 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.462886    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:52:13.463374 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.463352    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:52:13.463374 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.463371    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:52:13.463525 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.463469    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:52:13.463525 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.463484    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:52:13.463525 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.463513    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b91d7e-61f0-49a9-9869-1819e67aa6f2" containerName="istio-proxy"
Jul 29 01:52:13.466849 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.466823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.471962 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.471936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-66baf8-openshift-default-dockercfg-fklhp\""
Jul 29 01:52:13.479822 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.479795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:52:13.545081 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545287 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545287 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545287 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545210    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glhm\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545287 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545480 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545480 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545480 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.545480 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.545427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.645992 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.645956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.645992 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.645992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646297 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glhm\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646701 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646758 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646880 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.646963 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.646857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.647090 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.647049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.648390 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.648360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.649216 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.649193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.657432 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.657398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.658151 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.658128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glhm\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm\") pod \"e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") " pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.780930 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.780824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:13.920370 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.920340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:52:13.922894 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:52:13.922868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b05ae6_962d_455d_bb21_578b86415603.slice/crio-8a98e01ae3acf1a90c7ba60aecbf495df15a4bf771286331152b3a080524552c WatchSource:0}: Error finding container 8a98e01ae3acf1a90c7ba60aecbf495df15a4bf771286331152b3a080524552c: Status 404 returned error can't find the container with id 8a98e01ae3acf1a90c7ba60aecbf495df15a4bf771286331152b3a080524552c
Jul 29 01:52:13.924903 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.924866    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:13.924981 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.924934    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:13.924981 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:13.924963    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:14.006788 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:14.006753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerStarted","Data":"dfc29ff86c5c80818252ec525b98b549fce6a9f8f7003fe8a8fc255e2e14e627"}
Jul 29 01:52:14.006965 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:14.006814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerStarted","Data":"8a98e01ae3acf1a90c7ba60aecbf495df15a4bf771286331152b3a080524552c"}
Jul 29 01:52:14.030219 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:14.030165    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podStartSLOduration=1.030140661 podStartE2EDuration="1.030140661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:52:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:52:14.028963721 +0000 UTC m=+2376.870711650" watchObservedRunningTime="2026-07-29 01:52:14.030140661 +0000 UTC m=+2376.871888565"
Jul 29 01:52:14.781549 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:14.781486    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:14.786597 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:14.786574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:15.011263 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:15.011224    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:15.012340 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:15.012320    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:24.327958 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:24.327927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:52:31.053691 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:31.053650    2564 patch_prober.go:28] interesting pod/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 01:52:31.054121 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:31.053725    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 01:52:33.095151 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.095117    2564 generic.go:356] "Generic (PLEG): container finished" podID="f6b05ae6-962d-455d-bb21-578b86415603" containerID="dfc29ff86c5c80818252ec525b98b549fce6a9f8f7003fe8a8fc255e2e14e627" exitCode=0
Jul 29 01:52:33.095622 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.095179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerDied","Data":"dfc29ff86c5c80818252ec525b98b549fce6a9f8f7003fe8a8fc255e2e14e627"}
Jul 29 01:52:33.095622 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.095607    2564 scope.go:117] "RemoveContainer" containerID="dfc29ff86c5c80818252ec525b98b549fce6a9f8f7003fe8a8fc255e2e14e627"
Jul 29 01:52:33.096688 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.096659    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:33.096808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.096740    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:33.096808 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:33.096789    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:52:34.102593 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:34.102550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerStarted","Data":"958ecc3e928864e6455bba6aa2cd2851a1da5c2b0efdd7e7870982fcf442126e"}
Jul 29 01:52:34.781867 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:34.781835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:34.782089 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:34.782067    2564 patch_prober.go:28] interesting pod/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:52:34.782137 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:34.782114    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:52:35.781552 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:35.781488    2564 patch_prober.go:28] interesting pod/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:52:35.781969 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:35.781568    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:52:36.782148 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:36.782106    2564 patch_prober.go:28] interesting pod/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:52:36.782619 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:36.782166    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:52:37.782091 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:37.782058    2564 patch_prober.go:28] interesting pod/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:52:37.782309 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:37.782115    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:52:38.784991 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:38.784963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:38.785454 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:38.785230    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:52:38.785976 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:52:38.785961    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:53:01.716284 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:01.716205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:53:05.818525 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:05.815398    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:53:05.818525 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:05.815645    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" containerID="cri-o://259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e" gracePeriod=30
Jul 29 01:53:08.227029 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:08.226991    2564 patch_prober.go:28] interesting pod/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 01:53:08.227422 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:08.227052    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:53:11.065220 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.065195    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:53:11.157832 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157746    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.157832 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157800    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.157832 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157817    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.157832 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157835    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw9bd\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.157957    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158006    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token\") pod \"642c3f6f-3a50-4454-951c-cf5d4b894932\" (UID: \"642c3f6f-3a50-4454-951c-cf5d4b894932\") "
Jul 29 01:53:11.158172 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158080    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:11.158493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:11.158493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:11.158493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158329    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.158493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158348    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.158493 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158455    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:11.158851 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.158824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data" (OuterVolumeSpecName: "istio-data") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:11.160136 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.160108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:11.160352 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.160325    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd" (OuterVolumeSpecName: "kube-api-access-mw9bd") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "kube-api-access-mw9bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:11.160543 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.160520    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:53:11.160691 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.160670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token" (OuterVolumeSpecName: "istio-token") pod "642c3f6f-3a50-4454-951c-cf5d4b894932" (UID: "642c3f6f-3a50-4454-951c-cf5d4b894932"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:11.259668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259638    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259668 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259664    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259680    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw9bd\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-kube-api-access-mw9bd\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259695    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259709    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/642c3f6f-3a50-4454-951c-cf5d4b894932-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259718    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.259871 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.259727    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/642c3f6f-3a50-4454-951c-cf5d4b894932-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:11.264731 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.264700    2564 generic.go:356] "Generic (PLEG): container finished" podID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerID="259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e" exitCode=0
Jul 29 01:53:11.264848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.264756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"
Jul 29 01:53:11.264848 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.264791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerDied","Data":"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"}
Jul 29 01:53:11.264929 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.264849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz" event={"ID":"642c3f6f-3a50-4454-951c-cf5d4b894932","Type":"ContainerDied","Data":"696efcf94e6d72610e78c0b212fb4d2e0d00bdc1e7ed877b7f33f55bfca7ddad"}
Jul 29 01:53:11.264929 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.264870    2564 scope.go:117] "RemoveContainer" containerID="259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"
Jul 29 01:53:11.273414 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.273397    2564 scope.go:117] "RemoveContainer" containerID="1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"
Jul 29 01:53:11.280710 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.280692    2564 scope.go:117] "RemoveContainer" containerID="259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"
Jul 29 01:53:11.280954 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:53:11.280936    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e\": container with ID starting with 259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e not found: ID does not exist" containerID="259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"
Jul 29 01:53:11.281002 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.280961    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e"} err="failed to get container status \"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e\": rpc error: code = NotFound desc = could not find container \"259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e\": container with ID starting with 259ca51dcf4515d57574236defe9d020a7ee13aa561a61e1d0f71e47b11cae4e not found: ID does not exist"
Jul 29 01:53:11.281002 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.280979    2564 scope.go:117] "RemoveContainer" containerID="1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"
Jul 29 01:53:11.281203 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:53:11.281184    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa\": container with ID starting with 1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa not found: ID does not exist" containerID="1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"
Jul 29 01:53:11.281259 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.281212    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa"} err="failed to get container status \"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa\": rpc error: code = NotFound desc = could not find container \"1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa\": container with ID starting with 1a6fd036f55e6d0f21a2354eebeaa010c0d3c9fc7b14e9827a4d8434032e78fa not found: ID does not exist"
Jul 29 01:53:11.285319 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.285298    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:53:11.291153 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.291133    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6127b1-openshift-default-686d89454-b8wsz"]
Jul 29 01:53:11.805392 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:11.805358    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" path="/var/lib/kubelet/pods/642c3f6f-3a50-4454-951c-cf5d4b894932/volumes"
Jul 29 01:53:26.316392 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:26.316350    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:53:28.146077 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.146044    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:53:28.146574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.146309    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy" containerID="cri-o://958ecc3e928864e6455bba6aa2cd2851a1da5c2b0efdd7e7870982fcf442126e" gracePeriod=30
Jul 29 01:53:28.981290 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981254    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 01:53:28.981589 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981575    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:53:28.981653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981591    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e43df4-f768-48cc-8142-97eb62f96b9a" containerName="istio-proxy"
Jul 29 01:53:28.981653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981599    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.981653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981604    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.981653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981617    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.981653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981623    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.981831 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981684    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.981831 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.981694    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="642c3f6f-3a50-4454-951c-cf5d4b894932" containerName="istio-proxy"
Jul 29 01:53:28.984610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.984587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:28.987311 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:28.987288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c798cc-openshift-default-dockercfg-sxdrp\""
Jul 29 01:53:29.000330 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.000297    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 01:53:29.104352 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klnnd\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104595 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104801 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104801 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104801 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.104801 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.104743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206032 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.205993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206032 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klnnd\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.206574 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.207057 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.207057 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.206725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.207143 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.207049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.208541 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.208515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.208747 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.208729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.217285 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.217263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.217772 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.217751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klnnd\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd\") pod \"e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") " pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.296388 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.296289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:29.434961 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.434934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 01:53:29.436810 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:53:29.436788    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734ecf5a_8319_4cc7_bb5b_59eabe7373a1.slice/crio-8ee7faeab9ce78229ed23b0fb5ae9b0e43c28eac643cfd793080df5246b27bd7 WatchSource:0}: Error finding container 8ee7faeab9ce78229ed23b0fb5ae9b0e43c28eac643cfd793080df5246b27bd7: Status 404 returned error can't find the container with id 8ee7faeab9ce78229ed23b0fb5ae9b0e43c28eac643cfd793080df5246b27bd7
Jul 29 01:53:29.438938 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.438909    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:29.439075 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.438974    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:29.439075 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:29.439002    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:30.352077 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:30.352040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerStarted","Data":"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"}
Jul 29 01:53:30.352472 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:30.352118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerStarted","Data":"8ee7faeab9ce78229ed23b0fb5ae9b0e43c28eac643cfd793080df5246b27bd7"}
Jul 29 01:53:30.379299 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:30.379247    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" podStartSLOduration=2.379232189 podStartE2EDuration="2.379232189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:53:30.378815501 +0000 UTC m=+2453.220563404" watchObservedRunningTime="2026-07-29 01:53:30.379232189 +0000 UTC m=+2453.220980091"
Jul 29 01:53:31.296784 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:31.296742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:31.301653 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:31.301473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:31.357230 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:31.357204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:31.358198 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:31.358181    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:33.368650 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.368619    2564 generic.go:356] "Generic (PLEG): container finished" podID="f6b05ae6-962d-455d-bb21-578b86415603" containerID="958ecc3e928864e6455bba6aa2cd2851a1da5c2b0efdd7e7870982fcf442126e" exitCode=0
Jul 29 01:53:33.369065 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.368689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerDied","Data":"958ecc3e928864e6455bba6aa2cd2851a1da5c2b0efdd7e7870982fcf442126e"}
Jul 29 01:53:33.369065 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.368743    2564 scope.go:117] "RemoveContainer" containerID="dfc29ff86c5c80818252ec525b98b549fce6a9f8f7003fe8a8fc255e2e14e627"
Jul 29 01:53:33.399789 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.399768    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:53:33.543394 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543361    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543405    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543426    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543465    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543494    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glhm\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543610 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543634    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543682    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:33.543868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs\") pod \"f6b05ae6-962d-455d-bb21-578b86415603\" (UID: \"f6b05ae6-962d-455d-bb21-578b86415603\") "
Jul 29 01:53:33.543868 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.543786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:33.544119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.544061    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.544119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.544081    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.544119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.544079    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:33.544119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.544098    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:33.544328 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.544308    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:33.545767 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.545738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm" (OuterVolumeSpecName: "kube-api-access-5glhm") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "kube-api-access-5glhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:33.545935 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.545897    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:33.546083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.546063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:53:33.546150 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.546064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6b05ae6-962d-455d-bb21-578b86415603" (UID: "f6b05ae6-962d-455d-bb21-578b86415603"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:33.645451 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645420    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645451 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645444    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glhm\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-kube-api-access-5glhm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645451 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645453    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645703 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645461    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6b05ae6-962d-455d-bb21-578b86415603-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645703 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645470    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6b05ae6-962d-455d-bb21-578b86415603-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645703 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645479    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6b05ae6-962d-455d-bb21-578b86415603-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:33.645703 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:33.645487    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6b05ae6-962d-455d-bb21-578b86415603-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:53:34.373828 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:34.373798    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"
Jul 29 01:53:34.374241 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:34.373799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q" event={"ID":"f6b05ae6-962d-455d-bb21-578b86415603","Type":"ContainerDied","Data":"8a98e01ae3acf1a90c7ba60aecbf495df15a4bf771286331152b3a080524552c"}
Jul 29 01:53:34.374241 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:34.373934    2564 scope.go:117] "RemoveContainer" containerID="958ecc3e928864e6455bba6aa2cd2851a1da5c2b0efdd7e7870982fcf442126e"
Jul 29 01:53:34.392853 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:34.392827    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:53:34.395643 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:34.395620    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-66baf8-openshift-default-75dddfb968-gnq2q"]
Jul 29 01:53:35.805190 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:35.805156    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6b05ae6-962d-455d-bb21-578b86415603" path="/var/lib/kubelet/pods/f6b05ae6-962d-455d-bb21-578b86415603/volumes"
Jul 29 01:53:37.523728 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:37.523688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:53:45.437882 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.436585    2564 generic.go:356] "Generic (PLEG): container finished" podID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerID="a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877" exitCode=0
Jul 29 01:53:45.437882 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.436672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerDied","Data":"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"}
Jul 29 01:53:45.437882 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.437126    2564 scope.go:117] "RemoveContainer" containerID="a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"
Jul 29 01:53:45.438873 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.438837    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:45.438941 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.438925    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:45.438981 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:45.438964    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:46.357408 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:46.357368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:46.443106 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:46.443070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerStarted","Data":"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"}
Jul 29 01:53:47.297053 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:47.297013    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:47.298181 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:47.298155    2564 patch_prober.go:28] interesting pod/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 29 01:53:47.298330 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:47.298203    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 29 01:53:48.297285 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:48.297243    2564 patch_prober.go:28] interesting pod/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 29 01:53:48.297820 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:48.297312    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 29 01:53:49.297037 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:49.297000    2564 patch_prober.go:28] interesting pod/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 29 01:53:49.297236 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:49.297057    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 29 01:53:50.301103 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:50.301071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:50.301524 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:50.301341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:50.302044 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:50.302025    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 01:53:57.836994 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.836956    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 01:53:57.837427 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837412    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.837481 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837431    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.837481 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837449    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.837481 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837457    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.837601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837565    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.837601 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.837577    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b05ae6-962d-455d-bb21-578b86415603" containerName="istio-proxy"
Jul 29 01:53:57.841091 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.841066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.843874 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.843853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-0d32f5-openshift-default-dockercfg-rvlvg\""
Jul 29 01:53:57.851400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.851373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 01:53:57.862831 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.862792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjmn\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863005 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.862840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863005 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.862868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863005 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.862899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863005 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.862921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.863019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.863072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863165 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.863108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.863273 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.863178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964438 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964438 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjmn\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.964729 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.965083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.964925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.965083 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.965067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.965292 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.965268    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.965417 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.965293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.965609 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.965585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.966954 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.966935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.967265 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.967246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.973245 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.973218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:57.973478 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:57.973457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjmn\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn\") pod \"e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") " pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:58.154622 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.154531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:58.292411 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.292307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 01:53:58.297552 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:53:58.297527    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa5dff4_9527_4bdf_9585_bea2e18d833d.slice/crio-db8450b20521dee997cad28c6949384d3dfbd7a3fe87a29355f4f03664dab808 WatchSource:0}: Error finding container db8450b20521dee997cad28c6949384d3dfbd7a3fe87a29355f4f03664dab808: Status 404 returned error can't find the container with id db8450b20521dee997cad28c6949384d3dfbd7a3fe87a29355f4f03664dab808
Jul 29 01:53:58.299182 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.299151    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:58.299295 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.299226    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:58.299295 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.299267    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:53:58.497967 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.497930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerStarted","Data":"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"}
Jul 29 01:53:58.498147 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.497995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerStarted","Data":"db8450b20521dee997cad28c6949384d3dfbd7a3fe87a29355f4f03664dab808"}
Jul 29 01:53:58.524681 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:58.524628    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podStartSLOduration=1.524605269 podStartE2EDuration="1.524605269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:53:58.523850411 +0000 UTC m=+2481.365598313" watchObservedRunningTime="2026-07-29 01:53:58.524605269 +0000 UTC m=+2481.366353172"
Jul 29 01:53:59.154714 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:59.154682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:59.159431 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:59.159406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:59.502119 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:59.502093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:53:59.503005 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:53:59.502989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:54:07.529938 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:07.529899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:54:15.202404 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.202349    2564 patch_prober.go:28] interesting pod/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:41964->10.134.0.37:15021: read: connection reset by peer" start-of-body=
Jul 29 01:54:15.202895 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.202439    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": read tcp 10.134.0.2:41964->10.134.0.37:15021: read: connection reset by peer"
Jul 29 01:54:15.576035 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.576001    2564 generic.go:356] "Generic (PLEG): container finished" podID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerID="5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05" exitCode=0
Jul 29 01:54:15.576231 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.576078    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerDied","Data":"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"}
Jul 29 01:54:15.576524 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.576490    2564 scope.go:117] "RemoveContainer" containerID="5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"
Jul 29 01:54:15.577612 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.577586    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:54:15.577694 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.577668    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:54:15.577736 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:15.577717    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 01:54:16.583222 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:16.583181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerStarted","Data":"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"}
Jul 29 01:54:17.155224 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:17.155182    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:54:17.155423 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:17.155384    2564 patch_prober.go:28] interesting pod/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 29 01:54:17.155469 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:17.155431    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 29 01:54:18.155224 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:18.155181    2564 patch_prober.go:28] interesting pod/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 29 01:54:18.155745 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:18.155243    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 29 01:54:19.155308 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:19.155268    2564 patch_prober.go:28] interesting pod/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 29 01:54:19.155745 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:19.155327    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 29 01:54:20.154918 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:20.154881    2564 patch_prober.go:28] interesting pod/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 29 01:54:20.155106 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:20.154938    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 29 01:54:21.158434 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:21.158401    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:54:21.158840 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:21.158701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:54:21.159400 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:21.159384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 01:54:42.616735 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:54:42.616646    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:55:14.409526 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.409468    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:55:14.412585 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.412568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.416811 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.416787    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"auth-test-model-0d32f5-kserve-self-signed-certs\""
Jul 29 01:55:14.418147 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.418064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"default-dockercfg-vvc6c\""
Jul 29 01:55:14.418147 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.418065    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"kube-root-ca.crt\""
Jul 29 01:55:14.418373 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.418144    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"openshift-service-ca.crt\""
Jul 29 01:55:14.429870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.429843    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:55:14.536029 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.535992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.536213 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.536041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.536213 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.536100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.536213 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.536191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.536326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.536216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfwzv\" (UniqueName: \"kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.536326 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.536272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637483 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637483 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637924 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637924 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637924 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.637924 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfwzv\" (UniqueName: \"kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.638153 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.637943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.638366 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.638343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.638481 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.638340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.640944 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.640913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.641047 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.640980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.649584 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.649457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfwzv\" (UniqueName: \"kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv\") pod \"auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") " pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.721805 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.721752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:14.854854 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:14.854807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:55:14.857803 ip-10-0-140-185 kubenswrapper[2564]: W0729 01:55:14.857777    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a6d32ff_fbfe_4b6b_b615_9bf14f0352cb.slice/crio-74af3646f9d91672f6d3cf54e091e5fe4961e7be4da1ebfb99a4da1fd9c0eabd WatchSource:0}: Error finding container 74af3646f9d91672f6d3cf54e091e5fe4961e7be4da1ebfb99a4da1fd9c0eabd: Status 404 returned error can't find the container with id 74af3646f9d91672f6d3cf54e091e5fe4961e7be4da1ebfb99a4da1fd9c0eabd
Jul 29 01:55:15.841336 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:15.841301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" event={"ID":"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb","Type":"ContainerStarted","Data":"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"}
Jul 29 01:55:15.841336 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:15.841345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" event={"ID":"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb","Type":"ContainerStarted","Data":"74af3646f9d91672f6d3cf54e091e5fe4961e7be4da1ebfb99a4da1fd9c0eabd"}
Jul 29 01:55:15.858235 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:15.858185    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" podStartSLOduration=1.858167716 podStartE2EDuration="1.858167716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:55:15.85716038 +0000 UTC m=+2558.698908282" watchObservedRunningTime="2026-07-29 01:55:15.858167716 +0000 UTC m=+2558.699915619"
Jul 29 01:55:18.023317 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:18.023279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:55:24.722409 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:24.722352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:24.722870 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:24.722441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:24.735190 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:24.735155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:24.891974 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:24.891946    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:55:42.016149 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:55:42.016111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:56:03.617173 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:56:03.617083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:56:21.616101 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:56:21.616061    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:56:43.920111 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:56:43.920072    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:56:59.521457 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:56:59.521414    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:57:19.922426 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:57:19.922386    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:57:33.424773 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:57:33.424692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:57:56.926253 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:57:56.926205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:58:14.528618 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:58:14.528577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:58:36.427467 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:58:36.427425    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:58:54.919420 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:58:54.919380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:59:21.217680 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:21.217645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:59:27.699621 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:27.699586    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:59:38.223108 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:38.223068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 01:59:42.718620 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:42.718575    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" podUID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" containerName="main" containerID="cri-o://c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c" gracePeriod=45
Jul 29 01:59:42.962614 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:42.962587    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:59:43.022940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.022843    2564 generic.go:356] "Generic (PLEG): container finished" podID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" containerID="c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c" exitCode=0
Jul 29 01:59:43.022940 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.022893    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"
Jul 29 01:59:43.023128 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.022936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" event={"ID":"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb","Type":"ContainerDied","Data":"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"}
Jul 29 01:59:43.023128 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.022977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz" event={"ID":"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb","Type":"ContainerDied","Data":"74af3646f9d91672f6d3cf54e091e5fe4961e7be4da1ebfb99a4da1fd9c0eabd"}
Jul 29 01:59:43.023128 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.023001    2564 scope.go:117] "RemoveContainer" containerID="c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"
Jul 29 01:59:43.030971 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.030952    2564 scope.go:117] "RemoveContainer" containerID="c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"
Jul 29 01:59:43.031289 ip-10-0-140-185 kubenswrapper[2564]: E0729 01:59:43.031271    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c\": container with ID starting with c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c not found: ID does not exist" containerID="c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"
Jul 29 01:59:43.031340 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.031300    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c"} err="failed to get container status \"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c\": rpc error: code = NotFound desc = could not find container \"c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c\": container with ID starting with c41e44e19aa8592a5de755f6240261721ccb6e1112a263521d3424cb6a7abe1c not found: ID does not exist"
Jul 29 01:59:43.069793 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069761    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfwzv\" (UniqueName: \"kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.069947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069809    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.069947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.069947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.069947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.069947 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.069933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir\") pod \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\" (UID: \"0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb\") "
Jul 29 01:59:43.070201 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.070135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:43.070201 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.070175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home" (OuterVolumeSpecName: "home") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:43.070370 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.070348    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:43.072168 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.072133    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv" (OuterVolumeSpecName: "kube-api-access-jfwzv") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "kube-api-access-jfwzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:59:43.072168 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.072143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm" (OuterVolumeSpecName: "dshm") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:59:43.072168 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.072163    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" (UID: "0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:59:43.171638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171601    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfwzv\" (UniqueName: \"kubernetes.io/projected/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-kube-api-access-jfwzv\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.171638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171631    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.171638 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171644    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.171878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171656    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.171878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171663    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.171878 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.171671    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 01:59:43.344383 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.344346    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:59:43.348532 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.348492    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/auth-test-model-0d32f5-kserve-5dcd878d5f-5vczz"]
Jul 29 01:59:43.804949 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:43.804914    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" path="/var/lib/kubelet/pods/0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb/volumes"
Jul 29 01:59:48.317212 ip-10-0-140-185 kubenswrapper[2564]: I0729 01:59:48.317163    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:00:03.723909 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.723878    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:00:03.724308 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.724182    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" containerName="main"
Jul 29 02:00:03.724308 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.724191    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" containerName="main"
Jul 29 02:00:03.724308 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.724252    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a6d32ff-fbfe-4b6b-b615-9bf14f0352cb" containerName="main"
Jul 29 02:00:03.727239 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.727221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.732418 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.732387    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"kube-root-ca.crt\""
Jul 29 02:00:03.732418 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.732410    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"default-dockercfg-vvc6c\""
Jul 29 02:00:03.732653 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.732433    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"sub-test-model-0d32f5-kserve-self-signed-certs\""
Jul 29 02:00:03.732653 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.732442    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"openshift-service-ca.crt\""
Jul 29 02:00:03.737548 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.737525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:00:03.859411 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.859411 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.859729 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.859729 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.859729 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656m8\" (UniqueName: \"kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.859729 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.859721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960486 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960486 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656m8\" (UniqueName: \"kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960991 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.960991 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.960954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.961082 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.961015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.962904 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.962883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.963046 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.963027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:03.969938 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:03.969913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-656m8\" (UniqueName: \"kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8\") pod \"sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") " pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:04.037783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:04.037690    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:04.174147 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:04.174111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:00:04.177590 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:00:04.177565    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9acc3a6_757f_48c9_83b9_4cbea1791e36.slice/crio-918a8fbe6ce15b904d53667842edfa8d8a4faa31ca61235cb30eefa5f6e4df23 WatchSource:0}: Error finding container 918a8fbe6ce15b904d53667842edfa8d8a4faa31ca61235cb30eefa5f6e4df23: Status 404 returned error can't find the container with id 918a8fbe6ce15b904d53667842edfa8d8a4faa31ca61235cb30eefa5f6e4df23
Jul 29 02:00:05.129771 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:05.129737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" event={"ID":"f9acc3a6-757f-48c9-83b9-4cbea1791e36","Type":"ContainerStarted","Data":"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"}
Jul 29 02:00:05.129771 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:05.129777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" event={"ID":"f9acc3a6-757f-48c9-83b9-4cbea1791e36","Type":"ContainerStarted","Data":"918a8fbe6ce15b904d53667842edfa8d8a4faa31ca61235cb30eefa5f6e4df23"}
Jul 29 02:00:05.147026 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:05.146969    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" podStartSLOduration=2.146948923 podStartE2EDuration="2.146948923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:00:05.146896497 +0000 UTC m=+2847.988644401" watchObservedRunningTime="2026-07-29 02:00:05.146948923 +0000 UTC m=+2847.988696826"
Jul 29 02:00:07.527293 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:07.527255    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:00:14.038020 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:14.037978    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:14.038481 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:14.038063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:14.050745 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:14.050716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:14.189065 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:14.189037    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:00:36.318349 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:36.318240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:00:55.421836 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:00:55.421789    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:01:02.010339 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:02.010305    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:01:13.224738 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:13.224700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:01:17.030084 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.030043    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" podUID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" containerName="main" containerID="cri-o://7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d" gracePeriod=45
Jul 29 02:01:17.281458 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.281392    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:01:17.309513 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309525    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-656m8\" (UniqueName: \"kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8\") pod \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\" (UID: \"f9acc3a6-757f-48c9-83b9-4cbea1791e36\") "
Jul 29 02:01:17.309968 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309810    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home" (OuterVolumeSpecName: "home") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:17.309968 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309839    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:17.309968 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309890    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:17.309968 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309957    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.310147 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.309975    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.311721 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.311696    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm" (OuterVolumeSpecName: "dshm") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:01:17.312013 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.311982    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8" (OuterVolumeSpecName: "kube-api-access-656m8") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "kube-api-access-656m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:01:17.312105 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.312018    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9acc3a6-757f-48c9-83b9-4cbea1791e36" (UID: "f9acc3a6-757f-48c9-83b9-4cbea1791e36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:01:17.410579 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.410537    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.410579 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.410570    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9acc3a6-757f-48c9-83b9-4cbea1791e36-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.410579 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.410587    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9acc3a6-757f-48c9-83b9-4cbea1791e36-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.410833 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.410598    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-656m8\" (UniqueName: \"kubernetes.io/projected/f9acc3a6-757f-48c9-83b9-4cbea1791e36-kube-api-access-656m8\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:01:17.463475 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.463437    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" containerID="7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d" exitCode=0
Jul 29 02:01:17.463666 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.463483    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"
Jul 29 02:01:17.463666 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.463544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" event={"ID":"f9acc3a6-757f-48c9-83b9-4cbea1791e36","Type":"ContainerDied","Data":"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"}
Jul 29 02:01:17.463666 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.463589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2" event={"ID":"f9acc3a6-757f-48c9-83b9-4cbea1791e36","Type":"ContainerDied","Data":"918a8fbe6ce15b904d53667842edfa8d8a4faa31ca61235cb30eefa5f6e4df23"}
Jul 29 02:01:17.463666 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.463607    2564 scope.go:117] "RemoveContainer" containerID="7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"
Jul 29 02:01:17.472619 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.472594    2564 scope.go:117] "RemoveContainer" containerID="7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"
Jul 29 02:01:17.472918 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:01:17.472898    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d\": container with ID starting with 7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d not found: ID does not exist" containerID="7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"
Jul 29 02:01:17.472988 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.472926    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d"} err="failed to get container status \"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d\": rpc error: code = NotFound desc = could not find container \"7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d\": container with ID starting with 7f0b714b447749f6a40cf03990e710381ea04c100c0ef393ee5fc6518c29ee6d not found: ID does not exist"
Jul 29 02:01:17.484000 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.483970    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:01:17.487676 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.487649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/sub-test-model-0d32f5-kserve-6f947ffb4c-sncc2"]
Jul 29 02:01:17.805410 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:17.805381    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" path="/var/lib/kubelet/pods/f9acc3a6-757f-48c9-83b9-4cbea1791e36/volumes"
Jul 29 02:01:24.421459 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.421414    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:01:24.421911 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.421765    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" containerName="main"
Jul 29 02:01:24.421911 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.421777    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" containerName="main"
Jul 29 02:01:24.421911 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.421833    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9acc3a6-757f-48c9-83b9-4cbea1791e36" containerName="main"
Jul 29 02:01:24.426119 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.426096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.430301 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.430274    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"default-dockercfg-vvc6c\""
Jul 29 02:01:24.430301 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.430293    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"openshift-service-ca.crt\""
Jul 29 02:01:24.430497 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.430286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"rate-test-model-0d32f5-kserve-self-signed-certs\""
Jul 29 02:01:24.430497 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.430313    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-0d32f5\"/\"kube-root-ca.crt\""
Jul 29 02:01:24.434408 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.434358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:01:24.470588 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.470588 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.470820 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.470820 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.470820 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h5cd\" (UniqueName: \"kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.470921 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.470827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572027 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.571981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572210 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572210 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572282 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572226    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h5cd\" (UniqueName: \"kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572649 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.572750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.572685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.574434 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.574412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.574814 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.574793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.583756 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.583732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h5cd\" (UniqueName: \"kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd\") pod \"rate-test-model-0d32f5-kserve-64c6664947-4dvkk\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") " pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.737251 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.737215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:24.873958 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:24.873916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:01:24.877784 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:01:24.877753    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfab8127b_8a38_4a55_b106_d5300a339e89.slice/crio-c7cd0a9b582086b9c41fe5b62041f7c45f15f226ac25a59050ab37481f613e40 WatchSource:0}: Error finding container c7cd0a9b582086b9c41fe5b62041f7c45f15f226ac25a59050ab37481f613e40: Status 404 returned error can't find the container with id c7cd0a9b582086b9c41fe5b62041f7c45f15f226ac25a59050ab37481f613e40
Jul 29 02:01:25.501623 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:25.501581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" event={"ID":"fab8127b-8a38-4a55-b106-d5300a339e89","Type":"ContainerStarted","Data":"695da70c348008b53c1dbe452ae1758266804a8f8b6c960c2cc52237bfb16156"}
Jul 29 02:01:25.501623 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:25.501620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" event={"ID":"fab8127b-8a38-4a55-b106-d5300a339e89","Type":"ContainerStarted","Data":"c7cd0a9b582086b9c41fe5b62041f7c45f15f226ac25a59050ab37481f613e40"}
Jul 29 02:01:25.519059 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:25.519008    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" podStartSLOduration=1.518990799 podStartE2EDuration="1.518990799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:01:25.51683223 +0000 UTC m=+2928.358580137" watchObservedRunningTime="2026-07-29 02:01:25.518990799 +0000 UTC m=+2928.360738738"
Jul 29 02:01:28.617916 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:28.617880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:01:34.737868 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:34.737828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:34.738305 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:34.737896    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:34.751313 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:34.751286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:35.557350 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:35.557317    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:01:59.826241 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:01:59.826146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:02:13.923359 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:13.923324    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:02:28.026088 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:28.026050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:02:32.618421 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:32.618390    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:02:44.419954 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:44.419916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:02:47.637241 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.637176    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" podUID="fab8127b-8a38-4a55-b106-d5300a339e89" containerName="main" containerID="cri-o://695da70c348008b53c1dbe452ae1758266804a8f8b6c960c2cc52237bfb16156" gracePeriod=45
Jul 29 02:02:47.871039 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.871004    2564 generic.go:356] "Generic (PLEG): container finished" podID="fab8127b-8a38-4a55-b106-d5300a339e89" containerID="695da70c348008b53c1dbe452ae1758266804a8f8b6c960c2cc52237bfb16156" exitCode=0
Jul 29 02:02:47.871178 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.871063    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" event={"ID":"fab8127b-8a38-4a55-b106-d5300a339e89","Type":"ContainerDied","Data":"695da70c348008b53c1dbe452ae1758266804a8f8b6c960c2cc52237bfb16156"}
Jul 29 02:02:47.885926 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.885900    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:02:47.910319 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910229    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h5cd\" (UniqueName: \"kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910319 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910319 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910317    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910656 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910341    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910656 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910656 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910398    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home\") pod \"fab8127b-8a38-4a55-b106-d5300a339e89\" (UID: \"fab8127b-8a38-4a55-b106-d5300a339e89\") "
Jul 29 02:02:47.910833 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910671    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.910833 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910683    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache" (OuterVolumeSpecName: "model-cache") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.910946 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.910844    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home" (OuterVolumeSpecName: "home") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.912593 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.912565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm" (OuterVolumeSpecName: "dshm") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:02:47.912943 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.912921    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd" (OuterVolumeSpecName: "kube-api-access-8h5cd") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "kube-api-access-8h5cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:02:47.912943 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:47.912929    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fab8127b-8a38-4a55-b106-d5300a339e89" (UID: "fab8127b-8a38-4a55-b106-d5300a339e89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:02:48.011043 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011002    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h5cd\" (UniqueName: \"kubernetes.io/projected/fab8127b-8a38-4a55-b106-d5300a339e89-kube-api-access-8h5cd\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.011043 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011037    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fab8127b-8a38-4a55-b106-d5300a339e89-tls-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.011043 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011047    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-dshm\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.011043 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011055    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-tmp-dir\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.011324 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011064    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-model-cache\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.011324 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.011071    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fab8127b-8a38-4a55-b106-d5300a339e89-home\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:02:48.880378 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.880343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk" event={"ID":"fab8127b-8a38-4a55-b106-d5300a339e89","Type":"ContainerDied","Data":"c7cd0a9b582086b9c41fe5b62041f7c45f15f226ac25a59050ab37481f613e40"}
Jul 29 02:02:48.880378 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.880372    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"
Jul 29 02:02:48.880857 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.880395    2564 scope.go:117] "RemoveContainer" containerID="695da70c348008b53c1dbe452ae1758266804a8f8b6c960c2cc52237bfb16156"
Jul 29 02:02:48.901756 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.901727    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:02:48.905558 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:48.905530    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-0d32f5/rate-test-model-0d32f5-kserve-64c6664947-4dvkk"]
Jul 29 02:02:49.805026 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:49.804989    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab8127b-8a38-4a55-b106-d5300a339e89" path="/var/lib/kubelet/pods/fab8127b-8a38-4a55-b106-d5300a339e89/volumes"
Jul 29 02:02:51.954121 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.954077    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:02:51.954631 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.954610    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab8127b-8a38-4a55-b106-d5300a339e89" containerName="main"
Jul 29 02:02:51.954631 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.954630    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab8127b-8a38-4a55-b106-d5300a339e89" containerName="main"
Jul 29 02:02:51.954810 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.954739    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab8127b-8a38-4a55-b106-d5300a339e89" containerName="main"
Jul 29 02:02:51.959373 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.959349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:51.962083 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.962063    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-59f277-openshift-default-dockercfg-9bm8g\""
Jul 29 02:02:51.969971 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:51.969948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:02:52.044961 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.044925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.044961 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.044962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045228 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045228 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045228 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045228 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045533 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045533 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbz2\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.045533 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.045340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146437 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbz2\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146437 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146754 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146754 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146901 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146901 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146901 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.146901 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146897    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147122 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.146932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147122 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.147048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147122 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.147081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147261 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.147178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147314 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.147260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.147773 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.147751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.149191 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.149160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.149326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.149309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.153847 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.153824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.154207 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.154186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbz2\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2\") pod \"e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") " pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.270594 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.270555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:52.408948 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.408914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:02:52.412075 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:02:52.412047    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd345c7_4244_48e3_b523_9eed792d6b92.slice/crio-8ff22829511c3fd537e0d79ec38c18ab38d629793f997dd1165cf8dfd317daa4 WatchSource:0}: Error finding container 8ff22829511c3fd537e0d79ec38c18ab38d629793f997dd1165cf8dfd317daa4: Status 404 returned error can't find the container with id 8ff22829511c3fd537e0d79ec38c18ab38d629793f997dd1165cf8dfd317daa4
Jul 29 02:02:52.414605 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.414566    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:02:52.414677 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.414665    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:02:52.414718 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.414705    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:02:52.902646 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.902612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerStarted","Data":"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"}
Jul 29 02:02:52.902837 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.902664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerStarted","Data":"8ff22829511c3fd537e0d79ec38c18ab38d629793f997dd1165cf8dfd317daa4"}
Jul 29 02:02:52.929037 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:52.928979    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podStartSLOduration=1.9289582360000002 podStartE2EDuration="1.928958236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:02:52.927161478 +0000 UTC m=+3015.768909394" watchObservedRunningTime="2026-07-29 02:02:52.928958236 +0000 UTC m=+3015.770706142"
Jul 29 02:02:53.270752 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:53.270716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:53.275725 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:53.275700    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:53.907238 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:53.907205    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:02:53.908345 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:02:53.908321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:03:03.116641 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:03.116609    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:03:09.949709 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:09.949668    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 02:03:09.950096 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:09.949746    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 02:03:10.985208 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.985115    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerID="b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c" exitCode=0
Jul 29 02:03:10.985208 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.985187    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerDied","Data":"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"}
Jul 29 02:03:10.985698 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.985597    2564 scope.go:117] "RemoveContainer" containerID="b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"
Jul 29 02:03:10.986667 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.986636    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:10.986785 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.986722    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:10.986785 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:10.986770    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:11.991486 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:11.991454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerStarted","Data":"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"}
Jul 29 02:03:12.271273 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:12.271172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:03:12.271443 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:12.271406    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 02:03:12.271497 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:12.271457    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 02:03:13.271630 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:13.271592    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 02:03:13.272030 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:13.271659    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 02:03:14.271301 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:14.271258    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 02:03:14.271492 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:14.271323    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 02:03:15.271862 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:15.271820    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 02:03:15.272283 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:15.271881    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 02:03:16.274754 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:16.274714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:03:16.275151 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:16.274998    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:03:16.275643 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:16.275628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:03:20.708982 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.708951    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:03:20.712718 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.712692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.715687 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.715655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-7f1f73-openshift-default-dockercfg-f4ljq\""
Jul 29 02:03:20.725311 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.725284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.808942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.808999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9h9l\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.815543 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.809304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910032 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.909992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910244 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910244 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910244 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910244 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910244 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9h9l\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910546 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910546 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910546 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910707 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910707 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.910880 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.911075 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.910979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.911178 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.911014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.913199 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.912814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.913199 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.913165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.919333 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.919302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:20.919439 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:20.919353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9h9l\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l\") pod \"e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") " pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:21.025750 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:21.025713    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:21.169860 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:21.169832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:03:21.172169 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:03:21.172139    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717eec74_c5af_4066_8655_c9605cf5cd17.slice/crio-b953b5fe4b5cffdd91960ac0ee10688bda27dc7c876786e5ef58c55991a0f0d7 WatchSource:0}: Error finding container b953b5fe4b5cffdd91960ac0ee10688bda27dc7c876786e5ef58c55991a0f0d7: Status 404 returned error can't find the container with id b953b5fe4b5cffdd91960ac0ee10688bda27dc7c876786e5ef58c55991a0f0d7
Jul 29 02:03:21.174432 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:21.174402    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:21.174515 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:21.174472    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:21.174557 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:21.174522    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:22.038716 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:22.038679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerStarted","Data":"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"}
Jul 29 02:03:22.039132 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:22.038737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerStarted","Data":"b953b5fe4b5cffdd91960ac0ee10688bda27dc7c876786e5ef58c55991a0f0d7"}
Jul 29 02:03:22.061201 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:22.061140    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podStartSLOduration=2.061124366 podStartE2EDuration="2.061124366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:03:22.060115876 +0000 UTC m=+3044.901863780" watchObservedRunningTime="2026-07-29 02:03:22.061124366 +0000 UTC m=+3044.902872315"
Jul 29 02:03:23.026343 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:23.026304    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:23.031465 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:23.031432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:23.043514 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:23.043486    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:23.044616 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:23.044596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:33.117398 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:33.117312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:03:41.152647 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.152611    2564 generic.go:356] "Generic (PLEG): container finished" podID="717eec74-c5af-4066-8655-c9605cf5cd17" containerID="643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380" exitCode=0
Jul 29 02:03:41.153125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.152681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerDied","Data":"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"}
Jul 29 02:03:41.153125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.153055    2564 scope.go:117] "RemoveContainer" containerID="643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"
Jul 29 02:03:41.154091 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.154064    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:41.154174 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.154161    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:41.154219 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:41.154210    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:03:42.165467 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:42.165427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerStarted","Data":"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"}
Jul 29 02:03:43.026403 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:43.026363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:43.026620 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:43.026589    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 29 02:03:43.026668 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:43.026636    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 29 02:03:44.026915 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:44.026879    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 29 02:03:44.027339 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:44.026937    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 29 02:03:45.026437 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:45.026401    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 29 02:03:45.026629 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:45.026459    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 29 02:03:46.026376 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:46.026330    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 29 02:03:46.026807 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:46.026401    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 29 02:03:47.027159 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:47.027109    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 29 02:03:47.027716 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:47.027174    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 29 02:03:48.029786 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:48.029753    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:48.030460 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:48.030437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:03:48.031077 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:03:48.031057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:04:09.917273 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:09.917241    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:04:42.223055 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:42.223012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:04:53.954876 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:53.954846    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:04:53.958344 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:53.958315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:53.963561 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:53.963532    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-382dad-openshift-default-dockercfg-gxrv4\""
Jul 29 02:04:53.983894 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:53.983861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:04:54.047305 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.045836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.047654 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.047631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.048535 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.048490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.048783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.048767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.048975 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.048961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.051411 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.051197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.051762 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.051743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.051952 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.051936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssskv\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.052134 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.052117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153347 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153347 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153624 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153624 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153624 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153774 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153774 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssskv\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153774 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153774 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.153988 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.153836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.154071 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.154047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.154136 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.154076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.154136 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.154128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.154277 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.154256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.155967 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.155938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.156067 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.155992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.161881 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.161850    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.162575 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.162546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssskv\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv\") pod \"e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") " pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.268896 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.268855    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:54.414614 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.414577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:04:54.417964 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:04:54.417933    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697143f7_ada4_41e7_bebb_27f6f1caf0e1.slice/crio-2eb53f513a01b144106d6350be8511809b36b449441b505b38890038d31d1e75 WatchSource:0}: Error finding container 2eb53f513a01b144106d6350be8511809b36b449441b505b38890038d31d1e75: Status 404 returned error can't find the container with id 2eb53f513a01b144106d6350be8511809b36b449441b505b38890038d31d1e75
Jul 29 02:04:54.420247 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.420210    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:04:54.420327 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.420299    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:04:54.420380 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.420345    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:04:54.488622 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.488590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerStarted","Data":"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"}
Jul 29 02:04:54.488759 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:54.488642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerStarted","Data":"2eb53f513a01b144106d6350be8511809b36b449441b505b38890038d31d1e75"}
Jul 29 02:04:55.518998 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:55.518940    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podStartSLOduration=2.518919569 podStartE2EDuration="2.518919569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:04:55.515575592 +0000 UTC m=+3138.357323492" watchObservedRunningTime="2026-07-29 02:04:55.518919569 +0000 UTC m=+3138.360667486"
Jul 29 02:04:56.269149 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:56.269111    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:56.274072 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:56.274045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:56.498387 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:56.498355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:04:56.499261 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:04:56.499242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:02.434146 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:02.434060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:05:10.564912 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.564828    2564 generic.go:356] "Generic (PLEG): container finished" podID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerID="b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584" exitCode=0
Jul 29 02:05:10.564912 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.564866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerDied","Data":"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"}
Jul 29 02:05:10.565366 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.565248    2564 scope.go:117] "RemoveContainer" containerID="b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"
Jul 29 02:05:10.566467 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.566428    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:05:10.566558 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.566524    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:05:10.566601 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:10.566560    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 02:05:11.498472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:11.498433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:11.573727 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:11.573693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerStarted","Data":"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"}
Jul 29 02:05:12.269790 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:12.269747    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:12.271054 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:12.271022    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 02:05:12.271201 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:12.271087    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 02:05:13.269804 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:13.269768    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 02:05:13.270221 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:13.269826    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 02:05:14.270064 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:14.270023    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 02:05:14.270611 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:14.270097    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 02:05:15.269941 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:15.269907    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 02:05:15.270190 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:15.270168    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 02:05:16.273776 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:16.273744    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:16.274281 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:16.274135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:16.274802 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:16.274784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:32.632861 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:32.632816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:05:35.182919 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:35.182873    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:05:35.183366 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:35.183101    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy" containerID="cri-o://0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9" gracePeriod=30
Jul 29 02:05:40.440625 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.440598    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:40.512092 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512055    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512092 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssskv\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512155    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512170    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512201    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512267    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512340 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512331    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy\") pod \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\" (UID: \"697143f7-ada4-41e7-bebb-27f6f1caf0e1\") "
Jul 29 02:05:40.512747 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512454    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:05:40.512747 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512580    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:05:40.512859 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512838    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.512926 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512860    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.512926 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:05:40.512926 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.512876    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:05:40.513289 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.513260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:05:40.514616 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.514586    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv" (OuterVolumeSpecName: "kube-api-access-ssskv") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "kube-api-access-ssskv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:40.514723 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.514587    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:05:40.514723 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.514690    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:05:40.514801 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.514779    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "697143f7-ada4-41e7-bebb-27f6f1caf0e1" (UID: "697143f7-ada4-41e7-bebb-27f6f1caf0e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:05:40.613471 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613441    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssskv\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-kube-api-access-ssskv\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613471 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613471    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613471 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613487    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613767 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613531    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613767 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613543    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613767 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613556    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.613767 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.613567    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697143f7-ada4-41e7-bebb-27f6f1caf0e1-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:05:40.710521 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.710473    2564 generic.go:356] "Generic (PLEG): container finished" podID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerID="0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9" exitCode=0
Jul 29 02:05:40.710690 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.710534    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"
Jul 29 02:05:40.710690 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.710554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerDied","Data":"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"}
Jul 29 02:05:40.710690 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.710621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf" event={"ID":"697143f7-ada4-41e7-bebb-27f6f1caf0e1","Type":"ContainerDied","Data":"2eb53f513a01b144106d6350be8511809b36b449441b505b38890038d31d1e75"}
Jul 29 02:05:40.710690 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.710653    2564 scope.go:117] "RemoveContainer" containerID="0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"
Jul 29 02:05:40.720900 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.720879    2564 scope.go:117] "RemoveContainer" containerID="b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"
Jul 29 02:05:40.732227 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.732205    2564 scope.go:117] "RemoveContainer" containerID="0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"
Jul 29 02:05:40.732573 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:05:40.732546    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9\": container with ID starting with 0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9 not found: ID does not exist" containerID="0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"
Jul 29 02:05:40.732695 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.732579    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9"} err="failed to get container status \"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9\": rpc error: code = NotFound desc = could not find container \"0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9\": container with ID starting with 0583da19eb6acaf078fd2de9db8205ee31b77545ddc1ecaeff1e68bc2ab334f9 not found: ID does not exist"
Jul 29 02:05:40.732695 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.732599    2564 scope.go:117] "RemoveContainer" containerID="b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"
Jul 29 02:05:40.732870 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:05:40.732853    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584\": container with ID starting with b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584 not found: ID does not exist" containerID="b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"
Jul 29 02:05:40.732924 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.732877    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584"} err="failed to get container status \"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584\": rpc error: code = NotFound desc = could not find container \"b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584\": container with ID starting with b64de93d4955c2837c5b5e0fe2c331c4fe3bb4680a17aa6de6d234f20ca15584 not found: ID does not exist"
Jul 29 02:05:40.754469 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.754434    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:05:40.757884 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:40.757852    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-382dad-openshift-default-6cfd76c6d-tbzpf"]
Jul 29 02:05:41.811045 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:41.807000    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" path="/var/lib/kubelet/pods/697143f7-ada4-41e7-bebb-27f6f1caf0e1/volumes"
Jul 29 02:05:53.650377 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:05:53.650338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:06:04.535974 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:04.535934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:06:49.428539 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:49.428484    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:06:49.428975 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:49.428804    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy" containerID="cri-o://88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2" gracePeriod=30
Jul 29 02:06:54.676190 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.676162    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:06:54.795108 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795069    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795159    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795188    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795326 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795655 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slbz2\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795655 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795450    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:54.795655 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795655 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs\") pod \"5fd345c7-4244-48e3-b523-9eed792d6b92\" (UID: \"5fd345c7-4244-48e3-b523-9eed792d6b92\") "
Jul 29 02:06:54.795866 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795801    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:54.795996 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795974    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.796060 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:54.796060 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.795999    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.796060 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.796032    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:54.796220 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.796074    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:06:54.797628 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.797595    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2" (OuterVolumeSpecName: "kube-api-access-slbz2") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "kube-api-access-slbz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:06:54.797757 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.797653    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:06:54.797821 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.797774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:06:54.797900 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.797882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fd345c7-4244-48e3-b523-9eed792d6b92" (UID: "5fd345c7-4244-48e3-b523-9eed792d6b92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896652    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896689    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slbz2\" (UniqueName: \"kubernetes.io/projected/5fd345c7-4244-48e3-b523-9eed792d6b92-kube-api-access-slbz2\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896704    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896721    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896735    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fd345c7-4244-48e3-b523-9eed792d6b92-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896746    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:54.896758 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:54.896759    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fd345c7-4244-48e3-b523-9eed792d6b92-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:06:55.044589 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.044551    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerID="88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2" exitCode=0
Jul 29 02:06:55.044783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.044602    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"
Jul 29 02:06:55.044783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.044601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerDied","Data":"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"}
Jul 29 02:06:55.044783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.044732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz" event={"ID":"5fd345c7-4244-48e3-b523-9eed792d6b92","Type":"ContainerDied","Data":"8ff22829511c3fd537e0d79ec38c18ab38d629793f997dd1165cf8dfd317daa4"}
Jul 29 02:06:55.044783 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.044767    2564 scope.go:117] "RemoveContainer" containerID="88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"
Jul 29 02:06:55.054067 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.054046    2564 scope.go:117] "RemoveContainer" containerID="b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"
Jul 29 02:06:55.061975 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.061955    2564 scope.go:117] "RemoveContainer" containerID="88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"
Jul 29 02:06:55.062282 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:06:55.062263    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2\": container with ID starting with 88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2 not found: ID does not exist" containerID="88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"
Jul 29 02:06:55.062359 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.062296    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2"} err="failed to get container status \"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2\": rpc error: code = NotFound desc = could not find container \"88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2\": container with ID starting with 88f26a8c5857613566fc0aee53847cf02744d1d78b04147e9d5de12a93966cd2 not found: ID does not exist"
Jul 29 02:06:55.062359 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.062322    2564 scope.go:117] "RemoveContainer" containerID="b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"
Jul 29 02:06:55.062609 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:06:55.062580    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c\": container with ID starting with b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c not found: ID does not exist" containerID="b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"
Jul 29 02:06:55.062667 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.062621    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c"} err="failed to get container status \"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c\": rpc error: code = NotFound desc = could not find container \"b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c\": container with ID starting with b1836500bca3b64b806a34f4a8eeb7e7fe381278dd8c7f3d31445d622e996d7c not found: ID does not exist"
Jul 29 02:06:55.066960 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.066935    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:06:55.071252 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.071225    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-59f277-openshift-default-7457d56bb6-7f7bz"]
Jul 29 02:06:55.805033 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:06:55.805000    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" path="/var/lib/kubelet/pods/5fd345c7-4244-48e3-b523-9eed792d6b92/volumes"
Jul 29 02:07:03.832002 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:03.831968    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:07:07.295443 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:07.295403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:07:07.295892 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:07.295692    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy" containerID="cri-o://31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8" gracePeriod=30
Jul 29 02:07:12.548675 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.548649    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:07:12.647023 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.646928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647023 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.646975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647023 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.646997    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647303 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647116    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647303 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9h9l\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647303 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647303 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:12.647303 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647605 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647331    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647605 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket\") pod \"717eec74-c5af-4066-8655-c9605cf5cd17\" (UID: \"717eec74-c5af-4066-8655-c9605cf5cd17\") "
Jul 29 02:07:12.647605 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647554    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:12.647810 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647763    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.647810 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647795    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/717eec74-c5af-4066-8655-c9605cf5cd17-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.647949 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647869    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:12.647949 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647900    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data" (OuterVolumeSpecName: "istio-data") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:12.647949 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.647922    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:12.649465 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.649432    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:12.649589 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.649465    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token" (OuterVolumeSpecName: "istio-token") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:12.649673 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.649655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:07:12.649713 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.649665    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l" (OuterVolumeSpecName: "kube-api-access-v9h9l") pod "717eec74-c5af-4066-8655-c9605cf5cd17" (UID: "717eec74-c5af-4066-8655-c9605cf5cd17"). InnerVolumeSpecName "kube-api-access-v9h9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:12.748728 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748691    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.748728 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748719    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.748728 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748729    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.748728 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748738    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.749008 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748748    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/717eec74-c5af-4066-8655-c9605cf5cd17-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.749008 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748757    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/717eec74-c5af-4066-8655-c9605cf5cd17-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:12.749008 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:12.748765    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9h9l\" (UniqueName: \"kubernetes.io/projected/717eec74-c5af-4066-8655-c9605cf5cd17-kube-api-access-v9h9l\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:13.129439 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.129402    2564 generic.go:356] "Generic (PLEG): container finished" podID="717eec74-c5af-4066-8655-c9605cf5cd17" containerID="31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8" exitCode=0
Jul 29 02:07:13.129639 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.129447    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"
Jul 29 02:07:13.129639 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.129448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerDied","Data":"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"}
Jul 29 02:07:13.129639 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.129578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq" event={"ID":"717eec74-c5af-4066-8655-c9605cf5cd17","Type":"ContainerDied","Data":"b953b5fe4b5cffdd91960ac0ee10688bda27dc7c876786e5ef58c55991a0f0d7"}
Jul 29 02:07:13.129639 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.129609    2564 scope.go:117] "RemoveContainer" containerID="31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"
Jul 29 02:07:13.139072 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.139053    2564 scope.go:117] "RemoveContainer" containerID="643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"
Jul 29 02:07:13.147106 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.147087    2564 scope.go:117] "RemoveContainer" containerID="31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"
Jul 29 02:07:13.147396 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:13.147378    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8\": container with ID starting with 31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8 not found: ID does not exist" containerID="31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"
Jul 29 02:07:13.147444 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.147406    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8"} err="failed to get container status \"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8\": rpc error: code = NotFound desc = could not find container \"31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8\": container with ID starting with 31b8ee39f9b7c3be777698eff3ce25bc756f8f2082db87b7792fa2e4e661b4f8 not found: ID does not exist"
Jul 29 02:07:13.147444 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.147427    2564 scope.go:117] "RemoveContainer" containerID="643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"
Jul 29 02:07:13.147716 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:13.147691    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380\": container with ID starting with 643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380 not found: ID does not exist" containerID="643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"
Jul 29 02:07:13.147810 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.147724    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380"} err="failed to get container status \"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380\": rpc error: code = NotFound desc = could not find container \"643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380\": container with ID starting with 643d124d26586b9676cb99359ed2e36f0d76028699dcf3b4b6729bfeb1feb380 not found: ID does not exist"
Jul 29 02:07:13.154003 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.153976    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:07:13.158781 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.158754    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-7f1f73-openshift-default-6bcc87ff5b-grkhq"]
Jul 29 02:07:13.805276 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:13.805240    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" path="/var/lib/kubelet/pods/717eec74-c5af-4066-8655-c9605cf5cd17/volumes"
Jul 29 02:07:21.526582 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:21.526549    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:07:25.111622 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:25.111585    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 02:07:25.112090 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:25.111805    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy" containerID="cri-o://d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9" gracePeriod=30
Jul 29 02:07:30.365257 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.365228    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 02:07:30.400171 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400096    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400171 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400148    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400222    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400372 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400345    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klnnd\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd\") pod \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\" (UID: \"734ecf5a-8319-4cc7-bb5b-59eabe7373a1\") "
Jul 29 02:07:30.400706 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:30.400822 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400712    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.400822 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400550    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:30.400822 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:30.400984 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.400827    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:30.401118 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.401069    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:30.403145 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.403112    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:07:30.403264 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.403191    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:30.403264 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.403193    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:30.403264 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.403195    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd" (OuterVolumeSpecName: "kube-api-access-klnnd") pod "734ecf5a-8319-4cc7-bb5b-59eabe7373a1" (UID: "734ecf5a-8319-4cc7-bb5b-59eabe7373a1"). InnerVolumeSpecName "kube-api-access-klnnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:30.501433 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501393    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501433 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501426    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klnnd\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-kube-api-access-klnnd\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501433 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501436    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501433 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501445    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501736 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501453    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501736 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501461    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501736 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501469    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:30.501736 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:30.501477    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/734ecf5a-8319-4cc7-bb5b-59eabe7373a1-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:31.216585 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.216548    2564 generic.go:356] "Generic (PLEG): container finished" podID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerID="d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9" exitCode=0
Jul 29 02:07:31.216787 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.216602    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"
Jul 29 02:07:31.216787 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.216638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerDied","Data":"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"}
Jul 29 02:07:31.216787 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.216695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn" event={"ID":"734ecf5a-8319-4cc7-bb5b-59eabe7373a1","Type":"ContainerDied","Data":"8ee7faeab9ce78229ed23b0fb5ae9b0e43c28eac643cfd793080df5246b27bd7"}
Jul 29 02:07:31.216787 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.216726    2564 scope.go:117] "RemoveContainer" containerID="d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"
Jul 29 02:07:31.225903 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.225886    2564 scope.go:117] "RemoveContainer" containerID="a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"
Jul 29 02:07:31.234593 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.234381    2564 scope.go:117] "RemoveContainer" containerID="d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"
Jul 29 02:07:31.234725 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:31.234705    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9\": container with ID starting with d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9 not found: ID does not exist" containerID="d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"
Jul 29 02:07:31.234771 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.234734    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9"} err="failed to get container status \"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9\": rpc error: code = NotFound desc = could not find container \"d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9\": container with ID starting with d00da9cf8115fb8d77b16256f3c8811aef96a749388d972d91ef6dd239238bf9 not found: ID does not exist"
Jul 29 02:07:31.234771 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.234754    2564 scope.go:117] "RemoveContainer" containerID="a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"
Jul 29 02:07:31.235535 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:31.235183    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877\": container with ID starting with a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877 not found: ID does not exist" containerID="a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"
Jul 29 02:07:31.235535 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.235227    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877"} err="failed to get container status \"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877\": rpc error: code = NotFound desc = could not find container \"a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877\": container with ID starting with a119662b8620050ffaef6120e1939caf294228118c22f635fcfdd9a528380877 not found: ID does not exist"
Jul 29 02:07:31.239967 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.239946    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 02:07:31.245401 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.245379    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c798cc-openshift-default-7db7b9b86d-2h4wn"]
Jul 29 02:07:31.805552 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:31.805521    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" path="/var/lib/kubelet/pods/734ecf5a-8319-4cc7-bb5b-59eabe7373a1/volumes"
Jul 29 02:07:39.131760 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:39.131719    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d7xz8"]
Jul 29 02:07:42.856273 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:42.856243    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 02:07:42.856757 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:42.856476    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy" containerID="cri-o://ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6" gracePeriod=30
Jul 29 02:07:48.109801 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.109772    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 02:07:48.260252 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsjmn\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260261    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260291    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260317    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260357    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260451    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260876 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260527    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket\") pod \"baa5dff4-9527-4bdf-9585-bea2e18d833d\" (UID: \"baa5dff4-9527-4bdf-9585-bea2e18d833d\") "
Jul 29 02:07:48.260876 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260654    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:48.260987 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260889    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:48.260987 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260921    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.261095 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.260986    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:48.261226 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.261205    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:07:48.261385 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.261354    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data" (OuterVolumeSpecName: "istio-data") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:48.262691 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.262669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token" (OuterVolumeSpecName: "istio-token") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:48.262757 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.262712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn" (OuterVolumeSpecName: "kube-api-access-nsjmn") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "kube-api-access-nsjmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:07:48.262935 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.262916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:07:48.262994 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.262928    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "baa5dff4-9527-4bdf-9585-bea2e18d833d" (UID: "baa5dff4-9527-4bdf-9585-bea2e18d833d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:07:48.293972 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.293940    2564 generic.go:356] "Generic (PLEG): container finished" podID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerID="ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6" exitCode=0
Jul 29 02:07:48.294125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.293979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerDied","Data":"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"}
Jul 29 02:07:48.294125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.293986    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"
Jul 29 02:07:48.294125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.294023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx" event={"ID":"baa5dff4-9527-4bdf-9585-bea2e18d833d","Type":"ContainerDied","Data":"db8450b20521dee997cad28c6949384d3dfbd7a3fe87a29355f4f03664dab808"}
Jul 29 02:07:48.294125 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.294046    2564 scope.go:117] "RemoveContainer" containerID="ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"
Jul 29 02:07:48.302966 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.302947    2564 scope.go:117] "RemoveContainer" containerID="5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"
Jul 29 02:07:48.310975 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.310957    2564 scope.go:117] "RemoveContainer" containerID="ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"
Jul 29 02:07:48.311259 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:48.311239    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6\": container with ID starting with ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6 not found: ID does not exist" containerID="ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"
Jul 29 02:07:48.311336 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.311272    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6"} err="failed to get container status \"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6\": rpc error: code = NotFound desc = could not find container \"ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6\": container with ID starting with ecc5e9bd77dd253c73d4b7f1af4eff1809cc31a587c2041645890394a7ca71b6 not found: ID does not exist"
Jul 29 02:07:48.311336 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.311299    2564 scope.go:117] "RemoveContainer" containerID="5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"
Jul 29 02:07:48.311575 ip-10-0-140-185 kubenswrapper[2564]: E0729 02:07:48.311554    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05\": container with ID starting with 5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05 not found: ID does not exist" containerID="5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"
Jul 29 02:07:48.311622 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.311581    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05"} err="failed to get container status \"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05\": rpc error: code = NotFound desc = could not find container \"5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05\": container with ID starting with 5e9f86f2e6af8723867435ae5455f14132874613ddd4ed5fc7dc9c5caab8ef05 not found: ID does not exist"
Jul 29 02:07:48.315711 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.315688    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 02:07:48.321468 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.321445    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-0d32f5-openshift-default-67854996b4-wv5qx"]
Jul 29 02:07:48.362175 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362147    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-envoy\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362175 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362174    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-workload-certs\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362175 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362182    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-data\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362391 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362190    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362391 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362210    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/baa5dff4-9527-4bdf-9585-bea2e18d833d-istio-podinfo\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362391 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362218    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/baa5dff4-9527-4bdf-9585-bea2e18d833d-istiod-ca-cert\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362391 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362229    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/baa5dff4-9527-4bdf-9585-bea2e18d833d-credential-socket\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.362391 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.362238    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsjmn\" (UniqueName: \"kubernetes.io/projected/baa5dff4-9527-4bdf-9585-bea2e18d833d-kube-api-access-nsjmn\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\""
Jul 29 02:07:48.922086 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:48.922040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dd887db67-8c85z_411d001c-586c-45fd-a89e-33360ca1bd15/manager/0.log"
Jul 29 02:07:49.472552 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:49.472521    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-spf82_bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d/copy-manifests/0.log"
Jul 29 02:07:49.486346 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:49.486318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-spf82_bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d/manager/0.log"
Jul 29 02:07:49.804937 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:49.804854    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" path="/var/lib/kubelet/pods/baa5dff4-9527-4bdf-9585-bea2e18d833d/volumes"
Jul 29 02:07:52.239611 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:52.239582    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d7xz8_a7601482-7113-4ccc-8119-1845b7f973cc/limitador/0.log"
Jul 29 02:07:52.807682 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:52.807653    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x2bp5_4e4cd9f9-0136-480e-8deb-5e3eaae21bd7/discovery/0.log"
Jul 29 02:07:54.278083 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:07:54.278052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bbcp2_d0df4b13-235c-4e50-aa04-8936cdeaf384/main/0.log"
Jul 29 02:08:02.612333 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:02.612257    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pvzzv_ae66d154-203d-4bc9-bab1-374aa5460475/global-pull-secret-syncer/0.log"
Jul 29 02:08:02.760085 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:02.760049    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c64gs_ed690a15-659f-4bf7-9a02-7f0ac2f29205/konnectivity-agent/0.log"
Jul 29 02:08:02.780859 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:02.780829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-185.ec2.internal_92aa1923735291b61478f523669c7af8/haproxy/0.log"
Jul 29 02:08:08.117914 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:08.117888    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d7xz8_a7601482-7113-4ccc-8119-1845b7f973cc/limitador/0.log"
Jul 29 02:08:09.968370 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:09.968342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/alertmanager/0.log"
Jul 29 02:08:09.991392 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:09.991364    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/config-reloader/0.log"
Jul 29 02:08:10.015454 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.014784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/kube-rbac-proxy-web/0.log"
Jul 29 02:08:10.045033 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.045007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/kube-rbac-proxy/0.log"
Jul 29 02:08:10.066831 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.066800    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/kube-rbac-proxy-metric/0.log"
Jul 29 02:08:10.092373 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.092345    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/prom-label-proxy/0.log"
Jul 29 02:08:10.127400 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.127373    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_76e9f3ab-f970-4f07-a563-dacf9fde63c8/init-config-reloader/0.log"
Jul 29 02:08:10.299080 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.299000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-8cv7n_584fe601-cf41-4130-aa3f-45180f03c0e5/monitoring-plugin/0.log"
Jul 29 02:08:10.496551 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.496488    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjgwt_fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5/node-exporter/0.log"
Jul 29 02:08:10.518300 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.518274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjgwt_fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5/kube-rbac-proxy/0.log"
Jul 29 02:08:10.541223 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.541195    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjgwt_fd22e5df-f6f0-44b7-ac1d-4c1b4769c4c5/init-textfile/0.log"
Jul 29 02:08:10.895876 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.895851    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7c97d774-khbft_69598438-0f24-4882-ac97-edea77b479d8/telemeter-client/0.log"
Jul 29 02:08:10.915950 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.915923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7c97d774-khbft_69598438-0f24-4882-ac97-edea77b479d8/reload/0.log"
Jul 29 02:08:10.936331 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:10.936307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7b7c97d774-khbft_69598438-0f24-4882-ac97-edea77b479d8/kube-rbac-proxy/0.log"
Jul 29 02:08:12.120053 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120017    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"]
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120314    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120326    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120335    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120340    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120350    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120355    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120364    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120370    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120378    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120384    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120393    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120398    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120407    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120412    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120423    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120427    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy"
Jul 29 02:08:12.120472 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120478    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120485    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="717eec74-c5af-4066-8655-c9605cf5cd17" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120491    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120511    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="734ecf5a-8319-4cc7-bb5b-59eabe7373a1" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120516    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120521    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="697143f7-ada4-41e7-bebb-27f6f1caf0e1" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120527    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120532    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa5dff4-9527-4bdf-9585-bea2e18d833d" containerName="istio-proxy"
Jul 29 02:08:12.121169 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.120536    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd345c7-4244-48e3-b523-9eed792d6b92" containerName="istio-proxy"
Jul 29 02:08:12.123866 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.123849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.126373 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.126349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dv4l\"/\"default-dockercfg-tzxr4\""
Jul 29 02:08:12.126545 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.126370    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dv4l\"/\"openshift-service-ca.crt\""
Jul 29 02:08:12.127595 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.127573    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dv4l\"/\"kube-root-ca.crt\""
Jul 29 02:08:12.134559 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.134533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"]
Jul 29 02:08:12.164203 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.164172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn6hf\" (UniqueName: \"kubernetes.io/projected/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-kube-api-access-wn6hf\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.164203 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.164206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-podres\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.164449 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.164228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-proc\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.164449 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.164247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-lib-modules\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.164449 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.164330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-sys\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265225 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-proc\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265225 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-lib-modules\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-sys\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-proc\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn6hf\" (UniqueName: \"kubernetes.io/projected/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-kube-api-access-wn6hf\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-lib-modules\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-sys\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-podres\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.265532 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.265483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-podres\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.273731 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.273708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn6hf\" (UniqueName: \"kubernetes.io/projected/4f7c6d35-2f6e-437e-9e06-e933cb6c2162-kube-api-access-wn6hf\") pod \"perf-node-gather-daemonset-pb5xb\" (UID: \"4f7c6d35-2f6e-437e-9e06-e933cb6c2162\") " pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.434386 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.434243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:12.568820 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:12.568786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"]
Jul 29 02:08:12.572262 ip-10-0-140-185 kubenswrapper[2564]: W0729 02:08:12.572228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f7c6d35_2f6e_437e_9e06_e933cb6c2162.slice/crio-b65182c63cf03382d2228a628451fce685f8b0b652cc6167a43121af921140e4 WatchSource:0}: Error finding container b65182c63cf03382d2228a628451fce685f8b0b652cc6167a43121af921140e4: Status 404 returned error can't find the container with id b65182c63cf03382d2228a628451fce685f8b0b652cc6167a43121af921140e4
Jul 29 02:08:13.410262 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:13.410197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb" event={"ID":"4f7c6d35-2f6e-437e-9e06-e933cb6c2162","Type":"ContainerStarted","Data":"1656c3c8cd38cfa1f749f20080ed07fe22411d3fea11dfdbcf73a1d044983bc5"}
Jul 29 02:08:13.410705 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:13.410284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb" event={"ID":"4f7c6d35-2f6e-437e-9e06-e933cb6c2162","Type":"ContainerStarted","Data":"b65182c63cf03382d2228a628451fce685f8b0b652cc6167a43121af921140e4"}
Jul 29 02:08:13.410705 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:13.410313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:13.430370 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:13.430320    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb" podStartSLOduration=1.430302364 podStartE2EDuration="1.430302364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:08:13.428810362 +0000 UTC m=+3336.270558280" watchObservedRunningTime="2026-07-29 02:08:13.430302364 +0000 UTC m=+3336.272050299"
Jul 29 02:08:15.165728 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:15.165698    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvjff_8d2757b5-86c6-4e3c-b2b7-e0c0b126b961/dns/0.log"
Jul 29 02:08:15.186354 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:15.186328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvjff_8d2757b5-86c6-4e3c-b2b7-e0c0b126b961/kube-rbac-proxy/0.log"
Jul 29 02:08:15.209351 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:15.209325    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7mfs5_c5f91e9d-8e53-4d5d-b62d-d31e1fa892f6/dns-node-resolver/0.log"
Jul 29 02:08:15.840752 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:15.840722    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gl4ch_2705e66e-d0e1-4f2a-8bf6-18248372d4ba/node-ca/0.log"
Jul 29 02:08:16.891808 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:16.891775    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x2bp5_4e4cd9f9-0136-480e-8deb-5e3eaae21bd7/discovery/0.log"
Jul 29 02:08:17.894667 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:17.894636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5g9sb_de7bf872-8bee-47e0-8dbc-a365d94c4852/serve-healthcheck-canary/0.log"
Jul 29 02:08:18.394012 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:18.393984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2b7vw_ac04d27e-e3e8-4d01-94c5-2e5be91676a0/kube-rbac-proxy/0.log"
Jul 29 02:08:18.415285 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:18.415258    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2b7vw_ac04d27e-e3e8-4d01-94c5-2e5be91676a0/exporter/0.log"
Jul 29 02:08:18.438407 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:18.438382    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2b7vw_ac04d27e-e3e8-4d01-94c5-2e5be91676a0/extractor/0.log"
Jul 29 02:08:19.423839 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:19.423812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dv4l/perf-node-gather-daemonset-pb5xb"
Jul 29 02:08:21.280773 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:21.280731    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dd887db67-8c85z_411d001c-586c-45fd-a89e-33360ca1bd15/manager/0.log"
Jul 29 02:08:21.657259 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:21.657220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-spf82_bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d/manager/0.log"
Jul 29 02:08:21.677572 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:21.677549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f677d9b6b-spf82_bfb264a9-c9be-4aa2-bbc3-fc6e6819ee6d/copy-manifests/0.log"
Jul 29 02:08:22.785839 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:22.785806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x2bp5_4e4cd9f9-0136-480e-8deb-5e3eaae21bd7/discovery/0.log"
Jul 29 02:08:22.937229 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:22.937197    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856ff8b689-jkjsb_77bf2aeb-6b53-4976-9f79-ab67e46f003c/manager/0.log"
Jul 29 02:08:22.968196 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:22.968168    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-t8kp7_f2c6eb71-1bf7-4f81-903a-84b1b1da2bee/openshift-lws-operator/0.log"
Jul 29 02:08:24.417052 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:24.417014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-x2bp5_4e4cd9f9-0136-480e-8deb-5e3eaae21bd7/discovery/0.log"
Jul 29 02:08:29.333065 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.333029    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/kube-multus-additional-cni-plugins/0.log"
Jul 29 02:08:29.353769 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.353739    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/egress-router-binary-copy/0.log"
Jul 29 02:08:29.377321 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.377290    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/cni-plugins/0.log"
Jul 29 02:08:29.398894 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.398867    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/bond-cni-plugin/0.log"
Jul 29 02:08:29.421657 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.421627    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/routeoverride-cni/0.log"
Jul 29 02:08:29.442973 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.442944    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/whereabouts-cni-bincopy/0.log"
Jul 29 02:08:29.463659 ip-10-0-140-185 kubenswrapper[2564]: I0729 02:08:29.463629    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9gtcl_2f70949d-dcd7-43f0-8c99-f390bfaf2fe3/whereabouts-cni/0.log"